-- Logs begin at Thu 2022-06-02 18:13:20 UTC, end at Thu 2022-06-02 19:47:32 UTC. -- Jun 02 18:46:25.382219 dv-cinder-797608-28-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 02 18:46:25.391363 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 02 18:46:25.393376 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 18:46:25 2022] *** Jun 02 18:46:25.393376 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 18:46:25.393376 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 18:46:25.393376 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: nodename: dv-cinder-797608-28-iscsi Jun 02 18:46:25.393376 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: machine: x86_64 Jun 02 18:46:25.393376 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: clock source: unix Jun 02 18:46:25.393376 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: pcre jit disabled Jun 02 18:46:25.393376 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: detected number of CPU cores: 4 Jun 02 18:46:25.393376 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: current working directory: / Jun 02 18:46:25.393376 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: detected binary path: /usr/bin/uwsgi-core Jun 02 18:46:25.393948 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: your processes number limit is 47680 Jun 02 18:46:25.393948 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: your memory page size is 4096 bytes Jun 02 18:46:25.393948 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: detected max file descriptor number: 2048 Jun 02 18:46:25.393948 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: lock engine: pthread robust mutexes Jun 02 18:46:25.393948 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: thunder lock: enabled Jun 02 18:46:25.393948 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 02 18:46:25.393948 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 18:46:25.437257 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: Python main interpreter initialized at 0x5580290589c0 Jun 02 18:46:25.437257 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: python threads support enabled Jun 02 18:46:25.437257 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: your server socket listen backlog is limited to 100 connections Jun 02 18:46:25.437257 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: your mercy for graceful operations on workers is 90 seconds Jun 02 18:46:25.437603 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 18:46:25.437670 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: *** Operational MODE: preforking *** Jun 02 18:46:25.437966 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: *** uWSGI is running in multiple interpreter mode *** Jun 02 18:46:25.437966 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: spawned uWSGI master process (pid: 80248) Jun 02 18:46:25.438172 dv-cinder-797608-28-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 02 18:46:25.439194 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: spawned uWSGI worker 1 (pid: 80258, cores: 1) Jun 02 18:46:25.439194 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: spawned uWSGI worker 2 (pid: 80259, cores: 1) Jun 02 18:46:25.439194 dv-cinder-797608-28-iscsi devstack@keystone.service[80248]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 18:46:31.096281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 18:46:31.096281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: from cryptography.utils import int_from_bytes Jun 02 18:46:31.097082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 18:46:31.097082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: from cryptography.utils import int_from_bytes Jun 02 18:46:31.104023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 18:46:31.104023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: from cryptography.utils import int_from_bytes Jun 02 18:46:31.104564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 18:46:31.104564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: from cryptography.utils import int_from_bytes Jun 02 18:46:31.147091 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 18:46:31.147279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 18:46:31.147463 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] command line args: [] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 18:46:31.147704 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 18:46:31.147906 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ================================================================================ {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 18:46:31.148157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] admin_token = **** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.148401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] config_dir = [] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.148563 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.148777 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] config_source = [] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.148938 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] debug = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.149156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.149501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.149707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.149990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.150240 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.150459 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] list_limit = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.150632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] log_config_append = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.150811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.150985 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] log_dir = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.151180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] log_file = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.151394 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.151643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.151909 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.152152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.152298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.152393 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 18:46:31.152485 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.152610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 18:46:31.152710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.152783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] command line args: [] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 18:46:31.152968 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.153060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 18:46:31.153185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.153301 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ================================================================================ {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 18:46:31.153399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.153493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] admin_token = **** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.153632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.153728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] config_dir = [] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.153831 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.153906 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.154090 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] config_source = [] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.154222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.154319 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] debug = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.154400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.154470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.154710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.154798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.154985 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.155197 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.155349 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.155430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] publish_errors = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.155603 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.155732 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.155853 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.155994 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.156069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] list_limit = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.156240 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.156331 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] log_config_append = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.156444 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.156582 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.156664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] standard_threads = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.156839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] log_dir = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.156928 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.157096 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] log_file = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.157177 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.157258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.157428 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] use_journal = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.157509 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.157586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] use_json = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.157764 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] use_stderr = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.157865 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.157946 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] use_syslog = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.158179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.158263 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.158431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.158551 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.158670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.158823 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.158929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.159082 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.159164 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.159402 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.159491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.159639 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.159800 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.159889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.160107 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.160190 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.160354 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.160488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.160601 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.160836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.160911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.161068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.161184 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.161313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.161547 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.161621 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.161803 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.162004 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.162127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.162281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.162395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.162536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.162790 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.163032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.163106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.163241 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] publish_errors = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.163327 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.163477 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.163559 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.163706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.163781 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.163880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.164034 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.164108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.164224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.164342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.164460 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.164572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] standard_threads = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.164689 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.164798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.164918 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.165037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.165150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.165227 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.165369 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] use_journal = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.165451 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.165528 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] use_json = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.165634 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.165709 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] use_stderr = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.165880 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.165982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] use_syslog = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.166107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 18:46:31.166187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.166350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.166424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.166580 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.166666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.166819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.166906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.167060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.167141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.167285 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.167368 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.167518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.167594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.167750 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.167829 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.167978 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.168063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.168207 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.168287 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.168436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.168517 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.168666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.168750 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.168897 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.168980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.169138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.169213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.169361 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.169513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.169586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.169655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.169829 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.169926 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.170066 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.170188 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.170321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.170429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.170563 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.170788 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.170877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.171024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.171164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.171260 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.171406 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.171483 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.171661 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.171746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.171920 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.171996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.172147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.172223 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.172395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.172474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.172627 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.172703 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.172854 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.172927 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.173213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.173329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.173329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.173533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.173629 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.173734 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.174004 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.174106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.174230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.174306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.174306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.174501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.174582 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.174704 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.174812 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.174937 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.175013 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.175126 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.175212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.175284 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.175403 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.175478 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.175578 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.175654 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.175824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.175901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.176051 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.176134 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.176280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.176401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.176509 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.176598 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.176736 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.176825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.176972 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.177048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.177210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.177287 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.177437 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.177519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.177663 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.177786 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.177921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.178048 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.178126 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.178241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.178349 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.178426 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.178602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.178691 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.178830 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.178907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.179066 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.179142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.179299 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.179390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.179532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.179614 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.179763 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.179846 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.179991 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.180082 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.180216 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.180291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.180442 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.180516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.180676 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.180763 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.180907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.180984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.181134 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.181291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.181366 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.181434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.181604 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.181688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.181851 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.181945 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.182097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.182195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.182317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.182397 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.182583 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.182659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.182812 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] auth.external = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.182897 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.183045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.183123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.183281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.183355 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.183513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.183604 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.183745 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.183836 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] auth.password = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.183977 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.184053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] auth.token = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.184219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.184296 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.184450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.184534 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.184680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.184757 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.184909 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.184984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.185140 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.185223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.185372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.185448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.185601 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.185676 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.185917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] credential.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.186063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.186176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.186285 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.186369 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.186441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.186626 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.186705 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.186862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.186941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.187106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.187183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.187340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.187419 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.187602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.187693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.187835 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.187912 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.188069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.188147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.188297 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.188382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.188527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.188605 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.188754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.188831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.188983 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.189062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.189210 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.189292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.189444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.189549 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.189674 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.189783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] federation.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.189947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.190025 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.190180 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.190268 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.190434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.190519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.190688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.190766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.190925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.191008 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.191152 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] auth.external = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.191230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.191379 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.191456 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.191634 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.191709 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.191888 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.191967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.192114 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] auth.password = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.192190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.192341 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] auth.token = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.192419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.192574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.192653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.192805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.192882 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.193047 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.193124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.193273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.193352 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.193502 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.193578 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.193743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.193868 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.193997 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.194077 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.194225 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] credential.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.194303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.194469 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.194554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.194701 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.194776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.194934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.195010 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.195163 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.195241 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.195394 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.195473 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.195620 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.195695 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.195870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.195954 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.196116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.196196 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.196344 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.196420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.196594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.196679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.196866 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.196945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.197106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.197183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.197345 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.197422 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.197574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.197653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.197823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.197904 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.198056 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.198134 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] federation.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.198291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.198372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.198531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.198610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.198772 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.198858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.198998 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.199074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.199238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.199314 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.199470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.199558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.199719 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.199803 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.199950 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.200026 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.200195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.200279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.200428 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.200505 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.200658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.200735 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.200890 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.200975 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.201117 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.201192 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.201364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.201441 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.201611 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.201702 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.201872 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.202028 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.202106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.202285 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.202363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.202516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.202596 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.202753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.202830 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.203005 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.203082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.203238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.203322 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.203469 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.203545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.203697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.203774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.203925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.204004 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.204163 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.204239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.204403 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.204480 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.204635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.204714 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.204877 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.204955 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.205119 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.205260 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.205388 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.205498 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.205624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.205749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.205884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.206024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.206113 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.206276 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.206354 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.206511 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.206589 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.206743 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.206830 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.206981 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.207059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.207215 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.207291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.207793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.207962 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.208048 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.208200 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.208277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.208447 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.208524 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.208699 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.208777 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.208929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.209072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.209173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.209251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.209407 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.209485 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.209633 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.209708 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.209890 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.209971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.210119 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.210199 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.210354 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.210469 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.210584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.210660 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.210821 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.210902 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.211056 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.211133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.211291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.211367 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.211536 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.211644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.211763 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.211840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.211996 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.212081 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.212224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.212301 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.212454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.212530 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.212691 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.212776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.212922 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.213005 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.213153 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.213234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.213382 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.213467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.213610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.213687 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.213875 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.213982 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] resource.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.214124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.214217 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.214353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.214429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.214597 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.214674 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.214843 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.214928 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.215088 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.215165 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.215319 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.215395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.215544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.215629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.215776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.215854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.216006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.216121 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.216238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] role.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.216357 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.216482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] role.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.216590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.216714 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.216838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.216963 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.217194 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.217284 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.217448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.217527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.217696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.217773 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.217982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.218060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.218185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.218263 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.218430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.218508 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.218672 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.218751 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.218906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.218984 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.219141 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.219217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.219375 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.219454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.219618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.219696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.219865 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.219942 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.220098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.220268 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.220346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.220502 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.220580 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.220754 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.220840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.221004 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.221082 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.221234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.221310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.221470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.221555 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.221706 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.221783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.221980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.222060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.222210 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.222290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.222442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.222519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.222675 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.222752 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] resource.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.222910 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.222989 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.223141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.223219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.223373 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.223449 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.223621 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.223707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.223868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.223946 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.224116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.224253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.224340 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.224413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.224561 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.224637 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.224794 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.224870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] token.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.225026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] role.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.225105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.225269 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] role.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.225346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.225497 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.225575 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.225743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.225845 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.226013 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.226091 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.226247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.226323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.226490 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.226569 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.226731 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.226812 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.226972 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.227048 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.227204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.227284 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.227440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.227517 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.227668 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.227752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.227913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.227991 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.228163 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.228240 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.228392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.228469 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.228633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.228713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.228934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.229011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.229193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.connection = **** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.229283 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.229438 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.229525 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.229683 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.229761 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.229945 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.230024 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.230183 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.230280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.230411 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.230494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.230643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.230719 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.230878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.230964 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.231114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.231191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.231343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.231419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.231573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.231658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.231802 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.231881 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.232037 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.232112 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.232287 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.232379 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.232520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.232619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.232790 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.232868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.233021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.233107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.233259 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.233337 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.233492 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.233569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] token.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.233663 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 18:46:31.233814 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.234066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.234300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.234553 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.234797 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.235030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.235271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.235509 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.235754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.235989 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.236221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.236465 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.236762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.237012 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.237238 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.237476 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.237776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.238055 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.connection = **** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.238298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.238545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.238780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.239014 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.239243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.239477 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.239707 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.239938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.240178 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.240410 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.240649 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.240879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.241122 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.241352 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.241603 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.241855 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.242096 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.242327 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 18:46:31.242494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 18:46:31.262820 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.263048 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.263275 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.267374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.267605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.267831 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.271972 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.276187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.300259 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.300457 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.302746 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.302945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.354352 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.354512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.403133 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.403309 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.403309 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.403453 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.469907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.470099 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.470343 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.470577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.470710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.470782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.470858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.470931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.471008 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.471186 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.471402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.471589 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.494572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.494808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.495014 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.495233 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.495430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.495669 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.495860 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.496353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.496587 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.496777 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.497021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.497200 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.497436 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.497614 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.507456 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.508616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.520254 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.520503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.520904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.521039 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.521146 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.521247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.521359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.521461 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.521571 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.521671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.521769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.521894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.521894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.522105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 18:46:31.539619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.539841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 18:46:31.540176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.540345 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 18:46:31.540624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.540750 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.540855 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.540945 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 18:46:31.541106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.541313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.541445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.541589 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 18:46:31.541922 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.542191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.542549 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.542877 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.552336 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.552610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.552867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.553115 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.554306 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.554578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.554845 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.555124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.561282 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.563194 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.564636 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.564910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.565189 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.565574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.565874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.566134 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.566394 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.566519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.566667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.566833 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.566918 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.567041 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.567243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.567413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.567559 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.567690 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.567817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.568120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.568394 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.568637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.568928 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.569183 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.594021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.595611 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.595807 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.595925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.597493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.597769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.601073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.601374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.601626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.603007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.603285 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.603559 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.609203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.609422 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.610850 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.611130 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.614031 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.614314 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.614585 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.614857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.615130 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.615404 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.615530 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.615641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.615925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.616051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.616221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.616503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.616759 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.617032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.617297 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.617563 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.634273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.634546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.636027 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.636298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.639097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.640955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.642758 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.643040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.644618 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.644909 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.647901 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.649891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.651443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.653449 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.656629 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.656916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.657188 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.657465 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.657684 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.658090 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.658817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.659104 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.659387 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.659665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.659936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.660223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.676811 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.677177 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.677438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.677706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.679129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.679410 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.679679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.679952 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.685462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.687375 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.687647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.687870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.689588 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.689849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.690722 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.690995 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.691336 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.691686 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.692051 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.693105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.693386 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.693716 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.694034 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.694344 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.708633 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.709115 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.709362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.709529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.709529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.709881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.710059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.710202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.710397 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.710687 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.710949 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.711156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.711156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.711156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.733999 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.734344 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.737453 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.737960 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.740737 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.741247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.742451 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.742843 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.744059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.744329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.744466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.744565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.744747 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.745024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.751983 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.752507 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.753575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.754135 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.756897 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.757179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.757315 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.757400 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.757531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.757698 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.757859 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.758112 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.766807 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.767084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.767220 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.767311 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.767515 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.767890 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.775101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.775376 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.775647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.775783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 18:46:31.775873 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.775957 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.776161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.776300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.776424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.776523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.776755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.776903 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.776993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.777076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.777277 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.777471 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.777564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.777641 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.777784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.777904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.778063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.778209 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.778356 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.778440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.778521 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.778601 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.778854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.779108 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 18:46:31.816212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580290589c0 pid: 80259 (default app) Jun 02 18:46:31.816934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580290589c0 pid: 80258 (default app) Jun 02 18:46:31.819656 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38521940-ba07-47f7-a17b-aa391d3cfe18 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:31.819946 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38521940-ba07-47f7-a17b-aa391d3cfe18 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:31.820220 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38521940-ba07-47f7-a17b-aa391d3cfe18 None None] PATH_INFO: `/v3` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:31.827510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Thu Jun 2 18:46:31 2022] GET /identity/v3/ => generated 255 bytes in 11 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:46:39.890706 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e8836-4f39-439f-8cfb-6fb3c35e9e0c None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:39.891272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e8836-4f39-439f-8cfb-6fb3c35e9e0c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:39.891272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e8836-4f39-439f-8cfb-6fb3c35e9e0c None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:39.895684 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:46:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:46:39.901818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c357be-4425-433c-9d3a-caff804c916a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:39.902250 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c357be-4425-433c-9d3a-caff804c916a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:39.902424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c357be-4425-433c-9d3a-caff804c916a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:39.970412 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: INFO dbcounter [None req-24c357be-4425-433c-9d3a-caff804c916a None None] Registered counter for database keystone Jun 02 18:46:39.995496 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG oslo_db.sqlalchemy.engines [None req-24c357be-4425-433c-9d3a-caff804c916a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 18:46:40.007731 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writer thread running {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 18:46:40.304030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG passlib.handlers.bcrypt [None req-24c357be-4425-433c-9d3a-caff804c916a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80259) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 18:46:40.304349 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG passlib.handlers.bcrypt [None req-24c357be-4425-433c-9d3a-caff804c916a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80259) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 18:46:40.360638 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-24c357be-4425-433c-9d3a-caff804c916a None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:46:40.362375 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-24c357be-4425-433c-9d3a-caff804c916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:46:40.499105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:46:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 598 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 02 18:46:40.651326 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e8836-4f39-439f-8cfb-6fb3c35e9e0c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:40.734889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: INFO dbcounter [None req-268e8836-4f39-439f-8cfb-6fb3c35e9e0c None None] Registered counter for database keystone Jun 02 18:46:40.756662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG oslo_db.sqlalchemy.engines [None req-268e8836-4f39-439f-8cfb-6fb3c35e9e0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80258) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 18:46:40.766775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writer thread running {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 18:46:41.000427 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e8836-4f39-439f-8cfb-6fb3c35e9e0c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:41.005832 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de8073-d2c0-4010-a649-a98d40b5b479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:41.006527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de8073-d2c0-4010-a649-a98d40b5b479 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:41.006812 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de8073-d2c0-4010-a649-a98d40b5b479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:41.007096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de8073-d2c0-4010-a649-a98d40b5b479 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:41.016426 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de8073-d2c0-4010-a649-a98d40b5b479 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:41.067706 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c0de8073-d2c0-4010-a649-a98d40b5b479 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 18:46:41.068044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de8073-d2c0-4010-a649-a98d40b5b479 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:41.079459 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Thu Jun 2 18:46:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 18:46:41.087145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c357be-4425-433c-9d3a-caff804c916a None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:41.109761 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c357be-4425-433c-9d3a-caff804c916a None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:41.115148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9606b3d-6d42-42b1-a0b3-07101d71e4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:41.116276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9606b3d-6d42-42b1-a0b3-07101d71e4ae admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:41.116560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9606b3d-6d42-42b1-a0b3-07101d71e4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:41.116831 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9606b3d-6d42-42b1-a0b3-07101d71e4ae admin admin] PATH_INFO: `/v3/projects/b970ca87a411459db54f4a7b6d487f4a` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:41.118356 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9606b3d-6d42-42b1-a0b3-07101d71e4ae admin admin] RBAC: Authorizing `identity:get_project(project_id=b970ca87a411459db54f4a7b6d487f4a)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:41.169355 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c9606b3d-6d42-42b1-a0b3-07101d71e4ae admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 18:46:41.169692 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9606b3d-6d42-42b1-a0b3-07101d71e4ae admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:41.174443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Thu Jun 2 18:46:41 2022] GET /identity/v3/projects/b970ca87a411459db54f4a7b6d487f4a => generated 344 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:46:43.400444 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4f028-b03a-4b41-8771-ff48cd833f08 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:43.401034 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4f028-b03a-4b41-8771-ff48cd833f08 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:43.401034 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4f028-b03a-4b41-8771-ff48cd833f08 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:43.405348 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:46:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:46:43.412130 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfc73d-0059-4a60-bea2-4d69da5c6a27 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:43.412593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfc73d-0059-4a60-bea2-4d69da5c6a27 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:43.412687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfc73d-0059-4a60-bea2-4d69da5c6a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:43.436662 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4fbfc73d-0059-4a60-bea2-4d69da5c6a27 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:46:43.438216 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4fbfc73d-0059-4a60-bea2-4d69da5c6a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:46:43.447571 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:46:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 18:46:43.471064 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4f028-b03a-4b41-8771-ff48cd833f08 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:43.490450 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4f028-b03a-4b41-8771-ff48cd833f08 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:43.496353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6684438-93b7-4ff4-9490-b4761cc4f674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:43.496994 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6684438-93b7-4ff4-9490-b4761cc4f674 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:43.497283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6684438-93b7-4ff4-9490-b4761cc4f674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:43.497564 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6684438-93b7-4ff4-9490-b4761cc4f674 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:43.506439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6684438-93b7-4ff4-9490-b4761cc4f674 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:43.508234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6684438-93b7-4ff4-9490-b4761cc4f674 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:43.517911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Thu Jun 2 18:46:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 18:46:43.523943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfc73d-0059-4a60-bea2-4d69da5c6a27 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:43.535701 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfc73d-0059-4a60-bea2-4d69da5c6a27 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:43.542207 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3e6ad-7f3c-4b2b-bf13-96e1c5cc432c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:43.543091 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3e6ad-7f3c-4b2b-bf13-96e1c5cc432c admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:43.543366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3e6ad-7f3c-4b2b-bf13-96e1c5cc432c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:43.543638 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3e6ad-7f3c-4b2b-bf13-96e1c5cc432c admin admin] PATH_INFO: `/v3/users/f2f2aaa398bb4bba874340ea4e3288dd` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:43.545423 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3e6ad-7f3c-4b2b-bf13-96e1c5cc432c admin admin] RBAC: Authorizing `identity:get_user(user_id=f2f2aaa398bb4bba874340ea4e3288dd)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:43.547324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3e6ad-7f3c-4b2b-bf13-96e1c5cc432c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:43.548921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Thu Jun 2 18:46:43 2022] GET /identity/v3/users/f2f2aaa398bb4bba874340ea4e3288dd => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:46:45.831269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697626f-6707-4956-8534-25a60421d1b5 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:45.831790 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697626f-6707-4956-8534-25a60421d1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:45.831790 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697626f-6707-4956-8534-25a60421d1b5 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:45.833409 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:46:45.837766 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd6109-46c0-4ba8-9bd0-d6b8a60e5996 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:45.838211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd6109-46c0-4ba8-9bd0-d6b8a60e5996 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:45.838380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd6109-46c0-4ba8-9bd0-d6b8a60e5996 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:45.838816 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63570f-fb9f-4cad-bb56-6bd0cdf30b52 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:45.839268 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63570f-fb9f-4cad-bb56-6bd0cdf30b52 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:45.839807 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63570f-fb9f-4cad-bb56-6bd0cdf30b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:45.840501 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:46:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:46:45.846136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ae3bc-3155-4970-b243-7506665dc526 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:45.846538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ae3bc-3155-4970-b243-7506665dc526 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:45.846946 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ae3bc-3155-4970-b243-7506665dc526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:45.867854 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2c8ae3bc-3155-4970-b243-7506665dc526 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:46:45.869051 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2c8ae3bc-3155-4970-b243-7506665dc526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:46:45.887033 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG passlib.handlers.bcrypt [None req-8c63570f-fb9f-4cad-bb56-6bd0cdf30b52 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80258) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 18:46:45.887467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG passlib.handlers.bcrypt [None req-8c63570f-fb9f-4cad-bb56-6bd0cdf30b52 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80258) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 18:46:45.933476 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-8c63570f-fb9f-4cad-bb56-6bd0cdf30b52 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:46:45.935085 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8c63570f-fb9f-4cad-bb56-6bd0cdf30b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:46:45.953227 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 7/12] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:46:45.975389 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ae3bc-3155-4970-b243-7506665dc526 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:46.000480 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:46.035950 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 6/13] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:46:46.058711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63570f-fb9f-4cad-bb56-6bd0cdf30b52 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:46.079328 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ae3bc-3155-4970-b243-7506665dc526 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:46.113736 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18cb24-122e-4051-aed7-1393610d0b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:46.114327 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18cb24-122e-4051-aed7-1393610d0b07 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:46.114611 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18cb24-122e-4051-aed7-1393610d0b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:46.114884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18cb24-122e-4051-aed7-1393610d0b07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:46.163346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63570f-fb9f-4cad-bb56-6bd0cdf30b52 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:46.165669 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:46.182859 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18cb24-122e-4051-aed7-1393610d0b07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:46.184365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18cb24-122e-4051-aed7-1393610d0b07 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:46.200537 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb66ac-0401-4c79-bf6d-e9d4db69d241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:46.201699 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb66ac-0401-4c79-bf6d-e9d4db69d241 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:46.202275 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb66ac-0401-4c79-bf6d-e9d4db69d241 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:46.202569 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb66ac-0401-4c79-bf6d-e9d4db69d241 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:46.207125 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:46.214890 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb66ac-0401-4c79-bf6d-e9d4db69d241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:46:46.226350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-e6fb66ac-0401-4c79-bf6d-e9d4db69d241 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:46:46.226350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:46:46.226350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:46:46.226350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:46:46.226350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:46:46.226350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:46:46.226350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:46:46.226350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:46:46.226350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:46:46.226350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:46:46.226350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:46:46.226350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:46:46.226350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:46:46.226350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:46:46.226350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:46:46.226350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:46:46.227257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:46:46.227257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:46:46.227257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:46:46.227257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:46:46.227257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:46:46.227257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:46:46.227257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:46:46.227257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:46:46.227257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:46:46.227257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:46:46.227257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:46:46.227257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:46:46.227257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:46:46.227257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:46:46.227257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:46:46.227257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:46:46.228044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:46:46.228044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:46:46.228044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:46:46.228044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:46:46.228044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:46:46.228044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:46:46.228044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:46:46.228044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:46:46.228044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:46:46.228044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:46:46.228044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:46:46.228044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:46:46.228044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:46:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:46:46.233685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb66ac-0401-4c79-bf6d-e9d4db69d241 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:46.285295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 8/15] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:46:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:46:46.290827 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18cb24-122e-4051-aed7-1393610d0b07 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:46.335413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb66ac-0401-4c79-bf6d-e9d4db69d241 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:46.370194 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa24a8-8bc0-465f-9e74-d5a6e9e98a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:46.370789 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa24a8-8bc0-465f-9e74-d5a6e9e98a07 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:46.371147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa24a8-8bc0-465f-9e74-d5a6e9e98a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:46.371418 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa24a8-8bc0-465f-9e74-d5a6e9e98a07 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:46.372168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa24a8-8bc0-465f-9e74-d5a6e9e98a07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:46:46.372471 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa24a8-8bc0-465f-9e74-d5a6e9e98a07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:46.373957 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa24a8-8bc0-465f-9e74-d5a6e9e98a07 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:46.386158 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 8/16] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:46:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:46:46.390073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18cb24-122e-4051-aed7-1393610d0b07 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:46.391584 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa24a8-8bc0-465f-9e74-d5a6e9e98a07 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:46.413945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:46.419752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:46.426632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0c323-1969-437c-b873-5403493faeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:46.427436 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0c323-1969-437c-b873-5403493faeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:46.427709 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0c323-1969-437c-b873-5403493faeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:46.427977 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0c323-1969-437c-b873-5403493faeb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:46.438271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0c323-1969-437c-b873-5403493faeb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:46.439727 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0c323-1969-437c-b873-5403493faeb9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:46.460350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-93d0c323-1969-437c-b873-5403493faeb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:46:46.460350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:46:46.460350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:46:46.460350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:46:46.460350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:46:46.460350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:46:46.460350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:46:46.460350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:46:46.460350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:46:46.460350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:46:46.460350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:46:46.460350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:46:46.460350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:46:46.460350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:46:46.460350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:46:46.461211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:46:46.461211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:46:46.461211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:46:46.461211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:46:46.461211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:46:46.461211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:46:46.461211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:46:46.461211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:46:46.461211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:46:46.461211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:46:46.461211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:46:46.461211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:46:46.461211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:46:46.461211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:46:46.461211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:46:46.461211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:46:46.461211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:46:46.462062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:46:46.462062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:46:46.462062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:46:46.462062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:46:46.462062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:46:46.467467 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0c323-1969-437c-b873-5403493faeb9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:46.497170 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa24a8-8bc0-465f-9e74-d5a6e9e98a07 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:46.530739 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03084832-29b0-40ba-9547-6c50b7381b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:46.531630 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03084832-29b0-40ba-9547-6c50b7381b2f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:46.531907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03084832-29b0-40ba-9547-6c50b7381b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:46.532176 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03084832-29b0-40ba-9547-6c50b7381b2f None admin] PATH_INFO: `/v3/users/f2f2aaa398bb4bba874340ea4e3288dd` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:46.533738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03084832-29b0-40ba-9547-6c50b7381b2f None admin] RBAC: Authorizing `identity:get_user(user_id=f2f2aaa398bb4bba874340ea4e3288dd)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:46.535250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03084832-29b0-40ba-9547-6c50b7381b2f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:46.536879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 9/18] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:46:46 2022] GET /identity/v3/users/f2f2aaa398bb4bba874340ea4e3288dd => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:46:46.542307 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03084832-29b0-40ba-9547-6c50b7381b2f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:46.573126 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0c323-1969-437c-b873-5403493faeb9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:46.607932 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6167e0c-cf74-470a-9dd1-d1a4ea820f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:46.608608 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6167e0c-cf74-470a-9dd1-d1a4ea820f75 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:46.608890 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6167e0c-cf74-470a-9dd1-d1a4ea820f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:46.609168 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6167e0c-cf74-470a-9dd1-d1a4ea820f75 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:46.609933 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6167e0c-cf74-470a-9dd1-d1a4ea820f75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:46:46.610252 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6167e0c-cf74-470a-9dd1-d1a4ea820f75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:46.611659 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6167e0c-cf74-470a-9dd1-d1a4ea820f75 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:46.628680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 10/19] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:46:46.633598 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:46.641553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03084832-29b0-40ba-9547-6c50b7381b2f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:46.677873 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf10a9b-89b1-4e2e-945c-694860876e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:46.678689 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf10a9b-89b1-4e2e-945c-694860876e02 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:46.678965 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf10a9b-89b1-4e2e-945c-694860876e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:46.679224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf10a9b-89b1-4e2e-945c-694860876e02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:46.680458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf10a9b-89b1-4e2e-945c-694860876e02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:46.681970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf10a9b-89b1-4e2e-945c-694860876e02 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:46.683602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 10/20] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:46:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:46:46.690123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6167e0c-cf74-470a-9dd1-d1a4ea820f75 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:46.731363 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:46.804056 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6167e0c-cf74-470a-9dd1-d1a4ea820f75 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:46.840126 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f15573-b525-4afe-be90-1036c05c8e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:46.840795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f15573-b525-4afe-be90-1036c05c8e5b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:46.841088 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f15573-b525-4afe-be90-1036c05c8e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:46.841350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f15573-b525-4afe-be90-1036c05c8e5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:46.842483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f15573-b525-4afe-be90-1036c05c8e5b None admin] RBAC: Adding query filter params (role.id=8560bac1acf74dce81ea6a76f751b641, scope.domain.id=default, user.id=f2f2aaa398bb4bba874340ea4e3288dd) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:46:46.842803 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f15573-b525-4afe-be90-1036c05c8e5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:46.844273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f15573-b525-4afe-be90-1036c05c8e5b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:46.851456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 11/21] 10.222.0.15 () {56 vars in 1322 bytes} [Thu Jun 2 18:46:46 2022] GET /identity/v3/role_assignments?user.id=f2f2aaa398bb4bba874340ea4e3288dd&scope.domain.id=default&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 233 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:46:49.394835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49485a9-7998-4717-ab18-3182a9fc0f6b None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:49.395955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49485a9-7998-4717-ab18-3182a9fc0f6b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:49.396458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49485a9-7998-4717-ab18-3182a9fc0f6b None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:49.398290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 11/22] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:46:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:46:49.404473 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0746fec-b6e5-47e0-ba09-e6ff7d6c8404 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:49.405447 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0746fec-b6e5-47e0-ba09-e6ff7d6c8404 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:49.406003 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0746fec-b6e5-47e0-ba09-e6ff7d6c8404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:49.430939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f0746fec-b6e5-47e0-ba09-e6ff7d6c8404 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:46:49.432510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f0746fec-b6e5-47e0-ba09-e6ff7d6c8404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:46:49.547197 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 12/23] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:46:49.591277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49485a9-7998-4717-ab18-3182a9fc0f6b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:49.717246 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49485a9-7998-4717-ab18-3182a9fc0f6b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:49.746139 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45587eb-793c-4bec-a2da-453d3dd081d2 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:49.746765 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45587eb-793c-4bec-a2da-453d3dd081d2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:49.747235 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45587eb-793c-4bec-a2da-453d3dd081d2 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:49.748907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:46:49.754498 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3ea7f-3f91-4da7-a4e8-e28479a37fa2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:49.755017 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3ea7f-3f91-4da7-a4e8-e28479a37fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:49.755515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3ea7f-3f91-4da7-a4e8-e28479a37fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:49.784431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0da3ea7f-3f91-4da7-a4e8-e28479a37fa2 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:46:49.786767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0da3ea7f-3f91-4da7-a4e8-e28479a37fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:46:49.793352 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d706af0-b6e4-4518-9dcb-5f29e8ef5daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:49.794429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d706af0-b6e4-4518-9dcb-5f29e8ef5daf None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:49.794910 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d706af0-b6e4-4518-9dcb-5f29e8ef5daf None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:49.795450 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d706af0-b6e4-4518-9dcb-5f29e8ef5daf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:49.829433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d706af0-b6e4-4518-9dcb-5f29e8ef5daf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:49.831352 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d706af0-b6e4-4518-9dcb-5f29e8ef5daf None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:49.842365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:49.857269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-4d706af0-b6e4-4518-9dcb-5f29e8ef5daf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:46:49.857269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:46:49.857269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:46:49.857269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:46:49.857269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:46:49.857269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:46:49.857269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:46:49.857269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:46:49.857269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:46:49.857269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:46:49.857269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:46:49.857269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:46:49.857269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:46:49.857269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:46:49.857269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:46:49.858370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:46:49.858370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:46:49.858370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:46:49.858370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:46:49.858370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:46:49.858370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:46:49.858370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:46:49.858370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:46:49.858370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:46:49.858370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:46:49.858370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:46:49.858370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:46:49.858370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:46:49.858370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:46:49.858370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:46:49.858370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:46:49.858370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:46:49.859154 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:46:49.859154 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:46:49.859154 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:46:49.859154 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:46:49.861272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 12/25] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:46:49.862874 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc358d23-dfbd-47d0-ae1b-1d2e40ce4041 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:49.863356 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc358d23-dfbd-47d0-ae1b-1d2e40ce4041 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:49.863817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc358d23-dfbd-47d0-ae1b-1d2e40ce4041 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:49.865295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 13/26] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:46:49.867202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc358d23-dfbd-47d0-ae1b-1d2e40ce4041 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:49.885250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:49.941594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 14/27] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:46:49.942944 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fd565-9be0-4e3b-9322-48b9acbf2ba5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:49.943233 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fd565-9be0-4e3b-9322-48b9acbf2ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:49.943508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fd565-9be0-4e3b-9322-48b9acbf2ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:49.965167 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-338fd565-9be0-4e3b-9322-48b9acbf2ba5 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:46:49.966654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-338fd565-9be0-4e3b-9322-48b9acbf2ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:46:50.044022 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc358d23-dfbd-47d0-ae1b-1d2e40ce4041 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:50.062593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 15/28] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:46:50.064438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fd565-9be0-4e3b-9322-48b9acbf2ba5 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:50.094441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b154ed4-6213-448f-8b0d-b73ff06e0fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:50.095376 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b154ed4-6213-448f-8b0d-b73ff06e0fbc None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:50.095810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b154ed4-6213-448f-8b0d-b73ff06e0fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:50.096214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b154ed4-6213-448f-8b0d-b73ff06e0fbc None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:50.097267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b154ed4-6213-448f-8b0d-b73ff06e0fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:46:50.097852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b154ed4-6213-448f-8b0d-b73ff06e0fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:50.099439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b154ed4-6213-448f-8b0d-b73ff06e0fbc None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:50.121026 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 14/29] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:46:50.122752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5637e-d5da-4538-8083-7106c4d40228 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:50.123274 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5637e-d5da-4538-8083-7106c4d40228 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:50.123706 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5637e-d5da-4538-8083-7106c4d40228 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:50.125450 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 15/30] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:46:50.126419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5637e-d5da-4538-8083-7106c4d40228 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:50.177109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:50.191080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fd565-9be0-4e3b-9322-48b9acbf2ba5 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:50.210024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:50.239178 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5637e-d5da-4538-8083-7106c4d40228 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:50.239638 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa96b62-ebb8-4969-bd30-69ea56c697fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:50.240475 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa96b62-ebb8-4969-bd30-69ea56c697fc None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:50.240852 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa96b62-ebb8-4969-bd30-69ea56c697fc None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:50.241484 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa96b62-ebb8-4969-bd30-69ea56c697fc None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:50.243270 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa96b62-ebb8-4969-bd30-69ea56c697fc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:50.244811 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa96b62-ebb8-4969-bd30-69ea56c697fc None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:50.278344 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbefbf-4e5d-49fb-a51e-dc4f0a2a5150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:50.279317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbefbf-4e5d-49fb-a51e-dc4f0a2a5150 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:50.279814 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbefbf-4e5d-49fb-a51e-dc4f0a2a5150 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:50.280220 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbefbf-4e5d-49fb-a51e-dc4f0a2a5150 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:50.281157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbefbf-4e5d-49fb-a51e-dc4f0a2a5150 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:50.282780 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbefbf-4e5d-49fb-a51e-dc4f0a2a5150 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:50.381078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 16/31] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Jun 2 18:46:50 2022] POST /identity/v3/roles => generated 219 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:46:50.382550 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa96b62-ebb8-4969-bd30-69ea56c697fc None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:50.415822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 16/32] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Jun 2 18:46:50 2022] POST /identity/v3/roles => generated 225 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:46:50.417955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb1008-abef-4e7b-bf4d-2091e68a7001 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:50.418420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb1008-abef-4e7b-bf4d-2091e68a7001 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:50.418939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb1008-abef-4e7b-bf4d-2091e68a7001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:50.454091 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-22bb1008-abef-4e7b-bf4d-2091e68a7001 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:46:50.455980 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-22bb1008-abef-4e7b-bf4d-2091e68a7001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:46:50.551447 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa96b62-ebb8-4969-bd30-69ea56c697fc None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:50.593348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a3982-96d2-4855-888d-9efaad3f7c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:50.594569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a3982-96d2-4855-888d-9efaad3f7c5d None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:50.595061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a3982-96d2-4855-888d-9efaad3f7c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:50.595543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a3982-96d2-4855-888d-9efaad3f7c5d None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:50.596508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a3982-96d2-4855-888d-9efaad3f7c5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:50.598529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a3982-96d2-4855-888d-9efaad3f7c5d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:50.612867 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 17/33] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:46:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:46:50.614480 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bd7b7-b456-42dc-8660-3580fed48cf9 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:50.614935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bd7b7-b456-42dc-8660-3580fed48cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:50.615388 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bd7b7-b456-42dc-8660-3580fed48cf9 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:50.616880 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 18/34] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:46:50.624983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f9d1b-2d72-442f-8511-9607ad4b3ed9 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:50.627153 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f9d1b-2d72-442f-8511-9607ad4b3ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:50.627593 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f9d1b-2d72-442f-8511-9607ad4b3ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:50.653210 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:50.660522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 17/35] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 2 18:46:50 2022] POST /identity/v3/projects => generated 301 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:46:50.661950 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a3982-96d2-4855-888d-9efaad3f7c5d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:50.671254 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f55f9d1b-2d72-442f-8511-9607ad4b3ed9 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:46:50.674348 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f55f9d1b-2d72-442f-8511-9607ad4b3ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:46:50.807743 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:50.825666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 19/36] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:46:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:46:50.848428 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a3982-96d2-4855-888d-9efaad3f7c5d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:50.853227 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f9d1b-2d72-442f-8511-9607ad4b3ed9 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:50.887822 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492ee0e-d745-4b32-9124-3a16f696f61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:50.888693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492ee0e-d745-4b32-9124-3a16f696f61d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:50.889057 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492ee0e-d745-4b32-9124-3a16f696f61d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:50.889347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492ee0e-d745-4b32-9124-3a16f696f61d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:50.902980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492ee0e-d745-4b32-9124-3a16f696f61d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:46:50.912263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-2492ee0e-d745-4b32-9124-3a16f696f61d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:46:50.912263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:46:50.912263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:46:50.912263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:46:50.912263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:46:50.912263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:46:50.912263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:46:50.912263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:46:50.912263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:46:50.912263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:46:50.912263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:46:50.912263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:46:50.912263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:46:50.912263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:46:50.912263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:46:50.912263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:46:50.913148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:46:50.913148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:46:50.913148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:46:50.913148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:46:50.913148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:46:50.913148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:46:50.913148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:46:50.913148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:46:50.913148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:46:50.913148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:46:50.913148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:46:50.913148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:46:50.913148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:46:50.913148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:46:50.913148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:46:50.913148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:46:50.918070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:46:50.918070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:46:50.918070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:46:50.918070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:46:50.918070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:46:50.918070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:46:50.918070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:46:50.918070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:46:50.918070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:46:50.918070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:46:50.918070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:46:50.918070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:46:50.918070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 18/37] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:46:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:46:50.928813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492ee0e-d745-4b32-9124-3a16f696f61d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:50.979225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f9d1b-2d72-442f-8511-9607ad4b3ed9 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:51.002846 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:51.021314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595b5c7-5ec5-49c7-86ec-fde422390e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:51.022392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595b5c7-5ec5-49c7-86ec-fde422390e78 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:51.022933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595b5c7-5ec5-49c7-86ec-fde422390e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:51.023216 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595b5c7-5ec5-49c7-86ec-fde422390e78 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:51.023991 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595b5c7-5ec5-49c7-86ec-fde422390e78 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:51.025618 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595b5c7-5ec5-49c7-86ec-fde422390e78 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:51.042879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 20/38] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Jun 2 18:46:50 2022] POST /identity/v3/roles => generated 223 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 18:46:51.055588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492ee0e-d745-4b32-9124-3a16f696f61d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:51.063194 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc86f4d-4881-4d97-ba77-004c603c7f4a None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:51.063508 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc86f4d-4881-4d97-ba77-004c603c7f4a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:51.063761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc86f4d-4881-4d97-ba77-004c603c7f4a None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:51.065421 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 21/39] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:46:51.071211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd469e-c92f-43ef-b33c-cc0473e66c3e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:51.071508 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd469e-c92f-43ef-b33c-cc0473e66c3e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:51.071787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd469e-c92f-43ef-b33c-cc0473e66c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:51.090144 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-46fd469e-c92f-43ef-b33c-cc0473e66c3e None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:46:51.091392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-46fd469e-c92f-43ef-b33c-cc0473e66c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:46:51.100249 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be48ae-dda7-4d76-9245-128931625f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:51.100947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be48ae-dda7-4d76-9245-128931625f92 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:51.101237 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be48ae-dda7-4d76-9245-128931625f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:51.101519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be48ae-dda7-4d76-9245-128931625f92 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:51.104276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be48ae-dda7-4d76-9245-128931625f92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:46:51.104276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be48ae-dda7-4d76-9245-128931625f92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:51.105497 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be48ae-dda7-4d76-9245-128931625f92 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:51.125083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 19/40] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:46:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:46:51.126483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be48ae-dda7-4d76-9245-128931625f92 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:51.156624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:51.180288 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 22/41] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:46:51.204317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd469e-c92f-43ef-b33c-cc0473e66c3e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:51.238794 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be48ae-dda7-4d76-9245-128931625f92 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:51.267222 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:51.282156 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c352e7-bb7e-49d3-87de-58d8f9564bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:51.283062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c352e7-bb7e-49d3-87de-58d8f9564bbd None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:51.283349 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c352e7-bb7e-49d3-87de-58d8f9564bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:51.283636 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c352e7-bb7e-49d3-87de-58d8f9564bbd None admin] PATH_INFO: `/v3/users/f2f2aaa398bb4bba874340ea4e3288dd` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:51.285067 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c352e7-bb7e-49d3-87de-58d8f9564bbd None admin] RBAC: Authorizing `identity:get_user(user_id=f2f2aaa398bb4bba874340ea4e3288dd)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:51.286566 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c352e7-bb7e-49d3-87de-58d8f9564bbd None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:51.288232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 20/42] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:46:51 2022] GET /identity/v3/users/f2f2aaa398bb4bba874340ea4e3288dd => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:46:51.294405 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c352e7-bb7e-49d3-87de-58d8f9564bbd None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:51.321453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd469e-c92f-43ef-b33c-cc0473e66c3e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:51.355955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e340bd-e531-47a1-a8db-8c765677d5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:51.356773 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e340bd-e531-47a1-a8db-8c765677d5ca None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:51.357060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e340bd-e531-47a1-a8db-8c765677d5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:51.357338 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e340bd-e531-47a1-a8db-8c765677d5ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:51.358708 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e340bd-e531-47a1-a8db-8c765677d5ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:51.360183 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e340bd-e531-47a1-a8db-8c765677d5ca None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:51.361823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 23/43] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:46:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:46:51.367357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e340bd-e531-47a1-a8db-8c765677d5ca None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:51.396865 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c352e7-bb7e-49d3-87de-58d8f9564bbd None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:51.420703 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:51.431754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e8f6f-5a31-4acf-bd0a-6239b54fcc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:51.432502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e8f6f-5a31-4acf-bd0a-6239b54fcc87 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:51.432789 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e8f6f-5a31-4acf-bd0a-6239b54fcc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:51.433070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e8f6f-5a31-4acf-bd0a-6239b54fcc87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:51.434300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e8f6f-5a31-4acf-bd0a-6239b54fcc87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:51.435859 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e8f6f-5a31-4acf-bd0a-6239b54fcc87 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:51.437670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 21/44] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:46:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:46:51.443033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e8f6f-5a31-4acf-bd0a-6239b54fcc87 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:51.467299 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e340bd-e531-47a1-a8db-8c765677d5ca None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:51.499514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:51.502999 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bb68c-8f01-4358-839d-9dc6704a0adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:51.503680 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bb68c-8f01-4358-839d-9dc6704a0adb None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:51.503961 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bb68c-8f01-4358-839d-9dc6704a0adb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:51.504238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bb68c-8f01-4358-839d-9dc6704a0adb None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:51.504959 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6bb68c-8f01-4358-839d-9dc6704a0adb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:51.506469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6bb68c-8f01-4358-839d-9dc6704a0adb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:51.538388 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 24/45] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 2 18:46:51 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 18:46:51.543117 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e8f6f-5a31-4acf-bd0a-6239b54fcc87 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:51.580092 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bb5f4-619b-4baf-b1d0-81c45b87bd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:51.581055 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bb5f4-619b-4baf-b1d0-81c45b87bd1c None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:51.581342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bb5f4-619b-4baf-b1d0-81c45b87bd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:51.581624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bb5f4-619b-4baf-b1d0-81c45b87bd1c None admin] PATH_INFO: `/v3/domains/default/users/f2f2aaa398bb4bba874340ea4e3288dd/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:51.584132 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bb5f4-619b-4baf-b1d0-81c45b87bd1c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f2f2aaa398bb4bba874340ea4e3288dd, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:51.585660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bb5f4-619b-4baf-b1d0-81c45b87bd1c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:51.603340 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 22/46] 10.222.0.15 () {58 vars in 1361 bytes} [Thu Jun 2 18:46:51 2022] PUT /identity/v3/domains/default/users/f2f2aaa398bb4bba874340ea4e3288dd/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 18:46:53.822343 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a27998-fd4f-4c61-b53b-e705ac467653 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:53.822883 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a27998-fd4f-4c61-b53b-e705ac467653 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:53.822883 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a27998-fd4f-4c61-b53b-e705ac467653 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:53.824371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 25/47] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:46:53.830071 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42c535-46b3-45d8-bfd9-1f3407bae433 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:53.830506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42c535-46b3-45d8-bfd9-1f3407bae433 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:53.830684 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42c535-46b3-45d8-bfd9-1f3407bae433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:53.849388 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0b42c535-46b3-45d8-bfd9-1f3407bae433 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:46:53.850978 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0b42c535-46b3-45d8-bfd9-1f3407bae433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:46:53.923418 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 23/48] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:46:53.946335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f310a4-6f9d-4a71-bd21-ac840a0ea5e4 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:53.946539 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42c535-46b3-45d8-bfd9-1f3407bae433 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:53.946698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f310a4-6f9d-4a71-bd21-ac840a0ea5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:53.947010 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f310a4-6f9d-4a71-bd21-ac840a0ea5e4 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:53.948615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 26/49] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:46:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:46:53.953597 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449abc3a-6727-4314-a1b5-59c16148fc57 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:53.953923 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449abc3a-6727-4314-a1b5-59c16148fc57 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:53.954204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449abc3a-6727-4314-a1b5-59c16148fc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:53.972252 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-449abc3a-6727-4314-a1b5-59c16148fc57 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:46:53.973452 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-449abc3a-6727-4314-a1b5-59c16148fc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:46:53.994249 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:54.042550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 27/50] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:46:54.050765 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42c535-46b3-45d8-bfd9-1f3407bae433 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:54.066238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449abc3a-6727-4314-a1b5-59c16148fc57 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:54.084792 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416ff67-9a74-424d-9829-8a91cc5022ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:54.085538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416ff67-9a74-424d-9829-8a91cc5022ed None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:54.085850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416ff67-9a74-424d-9829-8a91cc5022ed None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:54.086130 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416ff67-9a74-424d-9829-8a91cc5022ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:54.096276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416ff67-9a74-424d-9829-8a91cc5022ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:46:54.099652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:54.104108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-1416ff67-9a74-424d-9829-8a91cc5022ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:46:54.104108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:46:54.104108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:46:54.104108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:46:54.104108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:46:54.104108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:46:54.104108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:46:54.104108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:46:54.104108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:46:54.104108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:46:54.104108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:46:54.104108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:46:54.104108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:46:54.104108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:46:54.104108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:46:54.104108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:46:54.104974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:46:54.104974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:46:54.104974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:46:54.104974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:46:54.104974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:46:54.104974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:46:54.104974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:46:54.104974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:46:54.104974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:46:54.104974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:46:54.104974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:46:54.104974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:46:54.104974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:46:54.104974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:46:54.104974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:46:54.104974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:46:54.105713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:46:54.105713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:46:54.105713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:46:54.105713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:46:54.105713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:46:54.105713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:46:54.105713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:46:54.105713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:46:54.105713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:46:54.105713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:46:54.105713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:46:54.105713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:46:54.105713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 24/51] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:46:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:46:54.112562 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416ff67-9a74-424d-9829-8a91cc5022ed None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:54.166590 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449abc3a-6727-4314-a1b5-59c16148fc57 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:54.200655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12531128-2a77-4346-9d8e-8de0279ed67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:54.201499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12531128-2a77-4346-9d8e-8de0279ed67f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:54.201777 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12531128-2a77-4346-9d8e-8de0279ed67f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:54.202100 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12531128-2a77-4346-9d8e-8de0279ed67f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:54.203293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12531128-2a77-4346-9d8e-8de0279ed67f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:54.204750 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12531128-2a77-4346-9d8e-8de0279ed67f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:54.206392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 28/52] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:46:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:46:54.211538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416ff67-9a74-424d-9829-8a91cc5022ed None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:54.212413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12531128-2a77-4346-9d8e-8de0279ed67f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:54.220906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:54.245248 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd3c82-d5dd-4af9-96f5-116681ea61d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:54.245955 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd3c82-d5dd-4af9-96f5-116681ea61d5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:54.246236 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd3c82-d5dd-4af9-96f5-116681ea61d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:54.246517 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd3c82-d5dd-4af9-96f5-116681ea61d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:54.247270 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd3c82-d5dd-4af9-96f5-116681ea61d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:46:54.247575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd3c82-d5dd-4af9-96f5-116681ea61d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:54.249140 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd3c82-d5dd-4af9-96f5-116681ea61d5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:54.257076 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 25/53] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:46:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:46:54.262649 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd3c82-d5dd-4af9-96f5-116681ea61d5 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:54.314219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12531128-2a77-4346-9d8e-8de0279ed67f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:54.315829 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:54.351297 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933956c9-c9c5-49ca-bd0a-75e1a2ff0f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:54.351885 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933956c9-c9c5-49ca-bd0a-75e1a2ff0f45 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:54.352152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933956c9-c9c5-49ca-bd0a-75e1a2ff0f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:54.352444 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933956c9-c9c5-49ca-bd0a-75e1a2ff0f45 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:54.353161 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933956c9-c9c5-49ca-bd0a-75e1a2ff0f45 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:54.354647 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933956c9-c9c5-49ca-bd0a-75e1a2ff0f45 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:54.361656 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd3c82-d5dd-4af9-96f5-116681ea61d5 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:54.382767 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 29/54] 10.222.0.15 () {60 vars in 1140 bytes} [Thu Jun 2 18:46:54 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:46:54.396405 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb588c0-1816-4bea-8813-33ec7f7dc9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:54.397421 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb588c0-1816-4bea-8813-33ec7f7dc9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:54.397702 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb588c0-1816-4bea-8813-33ec7f7dc9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:54.398003 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb588c0-1816-4bea-8813-33ec7f7dc9d9 None admin] PATH_INFO: `/v3/users/f2f2aaa398bb4bba874340ea4e3288dd` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:54.399325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb588c0-1816-4bea-8813-33ec7f7dc9d9 None admin] RBAC: Authorizing `identity:get_user(user_id=f2f2aaa398bb4bba874340ea4e3288dd)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:54.400939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb588c0-1816-4bea-8813-33ec7f7dc9d9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:54.402729 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 26/55] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:46:54 2022] GET /identity/v3/users/f2f2aaa398bb4bba874340ea4e3288dd => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:46:54.409756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933956c9-c9c5-49ca-bd0a-75e1a2ff0f45 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:54.520024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933956c9-c9c5-49ca-bd0a-75e1a2ff0f45 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:54.559037 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749211e-e5de-46df-b824-b70894182462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:54.559856 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749211e-e5de-46df-b824-b70894182462 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:54.560134 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749211e-e5de-46df-b824-b70894182462 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:54.560404 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749211e-e5de-46df-b824-b70894182462 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:54.561939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749211e-e5de-46df-b824-b70894182462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:54.563420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749211e-e5de-46df-b824-b70894182462 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:54.565094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 30/56] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:46:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:46:54.573470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb588c0-1816-4bea-8813-33ec7f7dc9d9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:54.617093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:54.676508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb588c0-1816-4bea-8813-33ec7f7dc9d9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:54.710216 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c5ab3-42a6-41fa-9112-876deef232e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:54.710878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c5ab3-42a6-41fa-9112-876deef232e8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:54.711158 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c5ab3-42a6-41fa-9112-876deef232e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:54.711434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c5ab3-42a6-41fa-9112-876deef232e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:54.712270 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c5ab3-42a6-41fa-9112-876deef232e8 None admin] RBAC: Adding query filter params (role.id=8560bac1acf74dce81ea6a76f751b641, scope.domain.id=default, user.id=f2f2aaa398bb4bba874340ea4e3288dd) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:46:54.712579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c5ab3-42a6-41fa-9112-876deef232e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:54.714058 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c5ab3-42a6-41fa-9112-876deef232e8 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:54.720466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 27/57] 10.222.0.15 () {56 vars in 1322 bytes} [Thu Jun 2 18:46:54 2022] GET /identity/v3/role_assignments?user.id=f2f2aaa398bb4bba874340ea4e3288dd&scope.domain.id=default&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:46:56.628336 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db65d6-1437-40af-a5fc-90528828bdbf None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:56.629158 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db65d6-1437-40af-a5fc-90528828bdbf None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:56.629158 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db65d6-1437-40af-a5fc-90528828bdbf None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:56.631494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 31/58] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:46:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:46:56.639728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e2702-8b00-45a5-b036-6039830e9a36 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:56.640183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e2702-8b00-45a5-b036-6039830e9a36 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:56.640282 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e2702-8b00-45a5-b036-6039830e9a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:56.658938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-895e2702-8b00-45a5-b036-6039830e9a36 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:46:56.660136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-895e2702-8b00-45a5-b036-6039830e9a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:46:56.731407 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 28/59] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:46:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:46:56.762823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db65d6-1437-40af-a5fc-90528828bdbf None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:56.792436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:56.874612 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db65d6-1437-40af-a5fc-90528828bdbf None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:56.909448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9c88a-f53e-4b5b-8ba4-12cc9d0b61e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:56.910273 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9c88a-f53e-4b5b-8ba4-12cc9d0b61e8 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:56.910555 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9c88a-f53e-4b5b-8ba4-12cc9d0b61e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:56.910829 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9c88a-f53e-4b5b-8ba4-12cc9d0b61e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:56.912507 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9c88a-f53e-4b5b-8ba4-12cc9d0b61e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:56.914460 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9c88a-f53e-4b5b-8ba4-12cc9d0b61e8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:56.916100 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 32/60] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:46:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:46:56.922426 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e2702-8b00-45a5-b036-6039830e9a36 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:46:56.959227 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:46:57.032078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e2702-8b00-45a5-b036-6039830e9a36 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:46:57.069142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77120f1a-90c2-4e1f-8356-240d098baa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:46:57.069762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77120f1a-90c2-4e1f-8356-240d098baa86 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:46:57.070076 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77120f1a-90c2-4e1f-8356-240d098baa86 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:46:57.070353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77120f1a-90c2-4e1f-8356-240d098baa86 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:46:57.071071 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77120f1a-90c2-4e1f-8356-240d098baa86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:46:57.072555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77120f1a-90c2-4e1f-8356-240d098baa86 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:46:57.102032 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 29/61] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 2 18:46:56 2022] POST /identity/v3/users => generated 275 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:47:00.640768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e54832-bec9-443f-a973-491b2e49ef23 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:00.641640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e54832-bec9-443f-a973-491b2e49ef23 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:00.642109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e54832-bec9-443f-a973-491b2e49ef23 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:00.643823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 33/62] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:00.649446 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025cd04-15e3-4fb9-b905-a00f4092834e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:00.650251 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025cd04-15e3-4fb9-b905-a00f4092834e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:00.650775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025cd04-15e3-4fb9-b905-a00f4092834e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:00.674898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-3025cd04-15e3-4fb9-b905-a00f4092834e None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:00.676400 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3025cd04-15e3-4fb9-b905-a00f4092834e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:00.693485 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c61e1f-6762-4c8d-b33d-f3d96c07da5c None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:00.693860 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c61e1f-6762-4c8d-b33d-f3d96c07da5c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:00.694069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c61e1f-6762-4c8d-b33d-f3d96c07da5c None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:00.695459 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 34/63] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:47:00.698729 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fc2dd-8e1e-40d2-9e51-6f6f9cb6e715 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:00.699022 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fc2dd-8e1e-40d2-9e51-6f6f9cb6e715 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:00.699306 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fc2dd-8e1e-40d2-9e51-6f6f9cb6e715 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:00.700698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 35/64] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:47:00.704674 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fefc2f-1a5a-4932-86ef-9d9b55b113ba None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:00.704674 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fefc2f-1a5a-4932-86ef-9d9b55b113ba None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:00.704674 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fefc2f-1a5a-4932-86ef-9d9b55b113ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:00.721436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-34fefc2f-1a5a-4932-86ef-9d9b55b113ba None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:00.723204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-34fefc2f-1a5a-4932-86ef-9d9b55b113ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:00.768362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 30/65] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:00.777923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbe97d-536e-4202-9a0c-611ba910a498 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:00.777923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbe97d-536e-4202-9a0c-611ba910a498 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:00.777923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbe97d-536e-4202-9a0c-611ba910a498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:00.800492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f1bbe97d-536e-4202-9a0c-611ba910a498 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:00.802083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f1bbe97d-536e-4202-9a0c-611ba910a498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:00.817210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 36/66] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:47:00.821896 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fefc2f-1a5a-4932-86ef-9d9b55b113ba None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:00.823384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:00.845526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:00.903061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 31/67] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:00.904515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbe97d-536e-4202-9a0c-611ba910a498 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:00.947207 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fefc2f-1a5a-4932-86ef-9d9b55b113ba None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:00.983186 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5a627-2dd5-4868-82de-3d579bdb7cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:00.984361 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5a627-2dd5-4868-82de-3d579bdb7cea None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:00.984856 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5a627-2dd5-4868-82de-3d579bdb7cea None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:00.985312 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5a627-2dd5-4868-82de-3d579bdb7cea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:00.996190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5a627-2dd5-4868-82de-3d579bdb7cea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:01.004643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-a5b5a627-2dd5-4868-82de-3d579bdb7cea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:01.004643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:01.004643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:01.004643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:01.004643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:01.004643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:01.004643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:01.004643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:01.004643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:01.004643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:01.004643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:01.004643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:01.004643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:01.004643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:01.004643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:01.004643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:01.005490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:01.005490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:01.005490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:01.005490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:01.005490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:01.005490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:01.005490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:01.005490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:01.005490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:01.005490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:01.005490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:01.005490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:01.005490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:01.005490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:01.005490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:01.005490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:01.006264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:01.006264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:01.006264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:01.006264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:01.006264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:01.006264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:01.006264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:01.006264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:01.006264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:01.006264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:01.006264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:01.006264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:01.008896 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 37/68] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:47:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:01.014598 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5a627-2dd5-4868-82de-3d579bdb7cea None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:01.018045 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbe97d-536e-4202-9a0c-611ba910a498 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:01.062164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566c66b-b32d-4b41-90c8-907d4e34ccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:01.062976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566c66b-b32d-4b41-90c8-907d4e34ccea None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:01.063262 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566c66b-b32d-4b41-90c8-907d4e34ccea None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:01.063532 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566c66b-b32d-4b41-90c8-907d4e34ccea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:01.077267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566c66b-b32d-4b41-90c8-907d4e34ccea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:01.087510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-f566c66b-b32d-4b41-90c8-907d4e34ccea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:47:01.087510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:01.087510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:01.087510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:01.087510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:01.087510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:01.087510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:01.087510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:01.087510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:01.087510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:01.087510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:01.087510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:01.087510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:01.087510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:01.087510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:01.087510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:01.088366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:01.088366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:01.088366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:01.088366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:01.088366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:01.088366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:01.088366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:01.088366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:01.088366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:01.088366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:01.088366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:01.088366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:01.088366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:01.088366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:01.088366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:01.088366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:01.089101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:01.089101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:01.089101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:01.089101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:01.089101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:01.089101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:01.089101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:01.089101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:01.089101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:01.089101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:01.089101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:47:01.089101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:01.089101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 32/69] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:47:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:01.089714 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566c66b-b32d-4b41-90c8-907d4e34ccea None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:01.103858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:01.104961 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:01.132384 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5a627-2dd5-4868-82de-3d579bdb7cea None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:01.167350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd219294-11cc-4ae0-8641-0504b8180fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:01.168159 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd219294-11cc-4ae0-8641-0504b8180fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:01.168440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd219294-11cc-4ae0-8641-0504b8180fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:01.168710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd219294-11cc-4ae0-8641-0504b8180fd1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:01.178856 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd219294-11cc-4ae0-8641-0504b8180fd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:01.186769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-cd219294-11cc-4ae0-8641-0504b8180fd1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:01.186769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:01.186769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:01.186769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:01.186769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:01.186769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:01.186769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:01.186769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:01.186769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:01.186769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:01.186769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:01.186769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:01.186769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:01.186769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:01.186769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:01.186769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:01.187711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:01.187711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:01.187711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:01.187711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:01.187711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:01.187711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:01.187711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:01.187711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:01.187711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:01.187711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:01.187711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:01.187711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:01.187711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:01.187711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:01.187711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:01.187711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:01.188650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:01.188650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:01.188650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:01.188650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:01.188650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:01.188650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:01.188650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:01.188650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:01.188650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:01.188650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:01.188650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:01.188650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:01.188650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 38/70] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:01.189376 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd219294-11cc-4ae0-8641-0504b8180fd1 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:01.207657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566c66b-b32d-4b41-90c8-907d4e34ccea None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:01.245350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c9bc7-d6a2-49d4-b784-2bb650a206d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:01.246062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c9bc7-d6a2-49d4-b784-2bb650a206d1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:01.246348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c9bc7-d6a2-49d4-b784-2bb650a206d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:01.246624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c9bc7-d6a2-49d4-b784-2bb650a206d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:01.247404 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c9bc7-d6a2-49d4-b784-2bb650a206d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:01.247709 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c9bc7-d6a2-49d4-b784-2bb650a206d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:01.249488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c9bc7-d6a2-49d4-b784-2bb650a206d1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:01.257354 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 33/71] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:47:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:01.258617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd108758-7542-43ff-8e39-ee8fa4535e79 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:01.258900 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd108758-7542-43ff-8e39-ee8fa4535e79 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:01.259175 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd108758-7542-43ff-8e39-ee8fa4535e79 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:01.260403 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 34/72] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:01.262893 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90f12d-9d2b-4f05-8424-6746d89b89d1 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:01.263178 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90f12d-9d2b-4f05-8424-6746d89b89d1 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:01.263453 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90f12d-9d2b-4f05-8424-6746d89b89d1 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:01.264971 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 35/73] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:01.265957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90f12d-9d2b-4f05-8424-6746d89b89d1 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:01.300577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd219294-11cc-4ae0-8641-0504b8180fd1 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:01.338066 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161a179-69a8-4537-a96b-03eba2cb4f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:01.338674 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161a179-69a8-4537-a96b-03eba2cb4f50 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:01.338958 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161a179-69a8-4537-a96b-03eba2cb4f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:01.339234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161a179-69a8-4537-a96b-03eba2cb4f50 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:01.339996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161a179-69a8-4537-a96b-03eba2cb4f50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:01.340308 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161a179-69a8-4537-a96b-03eba2cb4f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:01.341750 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161a179-69a8-4537-a96b-03eba2cb4f50 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:01.346425 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:01.353846 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 39/74] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:01.353846 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161a179-69a8-4537-a96b-03eba2cb4f50 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:01.354336 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:01.383682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90f12d-9d2b-4f05-8424-6746d89b89d1 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:01.417522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70bf3d-a271-4e7e-a3c3-79f906afa775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:01.418289 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70bf3d-a271-4e7e-a3c3-79f906afa775 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:01.418574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70bf3d-a271-4e7e-a3c3-79f906afa775 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:01.418853 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70bf3d-a271-4e7e-a3c3-79f906afa775 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:01.419619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70bf3d-a271-4e7e-a3c3-79f906afa775 None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:01.419966 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70bf3d-a271-4e7e-a3c3-79f906afa775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:01.421365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70bf3d-a271-4e7e-a3c3-79f906afa775 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:01.430564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 36/75] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:01.432741 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdd651-3dc5-4952-a181-9696700974a7 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:01.433033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdd651-3dc5-4952-a181-9696700974a7 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:01.433312 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdd651-3dc5-4952-a181-9696700974a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:01.449120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-21cdd651-3dc5-4952-a181-9696700974a7 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:01.450358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-21cdd651-3dc5-4952-a181-9696700974a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:01.454415 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161a179-69a8-4537-a96b-03eba2cb4f50 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:01.487213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66a015-d82a-4c70-b521-1571b7e36cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:01.488101 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66a015-d82a-4c70-b521-1571b7e36cae None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:01.488391 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66a015-d82a-4c70-b521-1571b7e36cae None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:01.488662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66a015-d82a-4c70-b521-1571b7e36cae None admin] PATH_INFO: `/v3/users/3356491ab76f4af58ad2cc7077ba8a43` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:01.503713 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66a015-d82a-4c70-b521-1571b7e36cae None admin] RBAC: Authorizing `identity:get_user(user_id=3356491ab76f4af58ad2cc7077ba8a43)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:01.505270 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66a015-d82a-4c70-b521-1571b7e36cae None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:01.506989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 40/76] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:01 2022] GET /identity/v3/users/3356491ab76f4af58ad2cc7077ba8a43 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:01.511431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f16ae-ca3a-4285-9d5c-bffdaf60e9df None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:01.511719 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f16ae-ca3a-4285-9d5c-bffdaf60e9df None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:01.511996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f16ae-ca3a-4285-9d5c-bffdaf60e9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:01.514879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 37/77] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:01.515764 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdd651-3dc5-4952-a181-9696700974a7 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:01.535787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-613f16ae-ca3a-4285-9d5c-bffdaf60e9df None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:01.537018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-613f16ae-ca3a-4285-9d5c-bffdaf60e9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:01.579121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:01.592010 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:01.603069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 41/78] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:01.617933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f16ae-ca3a-4285-9d5c-bffdaf60e9df None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:01.622055 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdd651-3dc5-4952-a181-9696700974a7 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:01.655622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57faffb2-a154-468a-bacc-279e612a1aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:01.656517 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faffb2-a154-468a-bacc-279e612a1aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:01.656808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faffb2-a154-468a-bacc-279e612a1aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:01.657086 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faffb2-a154-468a-bacc-279e612a1aa1 None admin] PATH_INFO: `/v3/users/f2f2aaa398bb4bba874340ea4e3288dd` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:01.658320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57faffb2-a154-468a-bacc-279e612a1aa1 None admin] RBAC: Authorizing `identity:get_user(user_id=f2f2aaa398bb4bba874340ea4e3288dd)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:01.659803 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57faffb2-a154-468a-bacc-279e612a1aa1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:01.661468 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 38/79] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:01 2022] GET /identity/v3/users/f2f2aaa398bb4bba874340ea4e3288dd => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:01.662270 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57faffb2-a154-468a-bacc-279e612a1aa1 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:01.711802 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f16ae-ca3a-4285-9d5c-bffdaf60e9df None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:01.746287 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735156a9-0b1c-40ea-b1e3-540586bcc79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:01.747175 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735156a9-0b1c-40ea-b1e3-540586bcc79b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:01.747457 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735156a9-0b1c-40ea-b1e3-540586bcc79b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:01.747733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735156a9-0b1c-40ea-b1e3-540586bcc79b None admin] PATH_INFO: `/v3/users/3356491ab76f4af58ad2cc7077ba8a43` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:01.749014 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735156a9-0b1c-40ea-b1e3-540586bcc79b None admin] RBAC: Authorizing `identity:get_user(user_id=3356491ab76f4af58ad2cc7077ba8a43)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:01.750533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735156a9-0b1c-40ea-b1e3-540586bcc79b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:01.752178 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 42/80] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:01 2022] GET /identity/v3/users/3356491ab76f4af58ad2cc7077ba8a43 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:01.752946 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735156a9-0b1c-40ea-b1e3-540586bcc79b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:01.769054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57faffb2-a154-468a-bacc-279e612a1aa1 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:01.797941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:01.804169 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9b5d1-2c29-49ec-b1d3-ba70ff6c13a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:01.804834 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9b5d1-2c29-49ec-b1d3-ba70ff6c13a7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:01.805122 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9b5d1-2c29-49ec-b1d3-ba70ff6c13a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:01.805408 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9b5d1-2c29-49ec-b1d3-ba70ff6c13a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:01.808676 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:01.849390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735156a9-0b1c-40ea-b1e3-540586bcc79b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:01.872680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9b5d1-2c29-49ec-b1d3-ba70ff6c13a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:01.874399 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9b5d1-2c29-49ec-b1d3-ba70ff6c13a7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:01.881698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9a23b-1e67-4991-833a-55eed5562fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:01.882516 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9a23b-1e67-4991-833a-55eed5562fff None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:01.882794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9a23b-1e67-4991-833a-55eed5562fff None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:01.883062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9a23b-1e67-4991-833a-55eed5562fff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:01.884516 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9a23b-1e67-4991-833a-55eed5562fff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:01.885989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9a23b-1e67-4991-833a-55eed5562fff None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:01.887606 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 43/81] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:47:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:01.888352 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9a23b-1e67-4991-833a-55eed5562fff None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:01.975249 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 39/82] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:01.976102 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9b5d1-2c29-49ec-b1d3-ba70ff6c13a7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:01.988382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9a23b-1e67-4991-833a-55eed5562fff None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:02.007160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:02.016560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:02.026289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb31085-317e-41f2-ad3e-d55800d36182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:02.027099 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb31085-317e-41f2-ad3e-d55800d36182 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:02.027383 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb31085-317e-41f2-ad3e-d55800d36182 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:02.027652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb31085-317e-41f2-ad3e-d55800d36182 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:02.038940 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb31085-317e-41f2-ad3e-d55800d36182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:02.047106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-2cb31085-317e-41f2-ad3e-d55800d36182 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:02.047106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:02.047106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:02.047106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:02.047106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:02.047106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:02.047106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:02.047106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:02.047106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:02.047106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:02.047106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:02.047106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:02.047106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:02.047106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:02.047106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:02.047106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:02.048102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:02.048102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:02.048102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:02.048102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:02.048102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:02.048102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:02.048102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:02.048102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:02.048102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:02.048102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:02.048102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:02.048102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:02.048102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:02.048102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:02.048102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:02.048102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:02.048852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:02.048852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:02.048852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:02.048852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:02.048852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:02.048852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:02.048852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:02.048852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:02.048852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:02.048852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:02.048852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:02.048852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:02.048852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 44/83] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:02.049481 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb31085-317e-41f2-ad3e-d55800d36182 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:02.079422 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9b5d1-2c29-49ec-b1d3-ba70ff6c13a7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:02.112867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4b83d-0bfb-419f-9255-23ac27e7997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:02.113456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4b83d-0bfb-419f-9255-23ac27e7997d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:02.113744 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4b83d-0bfb-419f-9255-23ac27e7997d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:02.114044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4b83d-0bfb-419f-9255-23ac27e7997d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:02.149102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb31085-317e-41f2-ad3e-d55800d36182 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:02.181002 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4b83d-0bfb-419f-9255-23ac27e7997d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:02.181160 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbdadc-af07-46a2-a8ba-dd7bbfe19a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:02.181718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbdadc-af07-46a2-a8ba-dd7bbfe19a80 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:02.182032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbdadc-af07-46a2-a8ba-dd7bbfe19a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:02.182310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbdadc-af07-46a2-a8ba-dd7bbfe19a80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:02.182524 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4b83d-0bfb-419f-9255-23ac27e7997d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:02.212899 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:02.236102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:02.251136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbdadc-af07-46a2-a8ba-dd7bbfe19a80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:02.252731 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbdadc-af07-46a2-a8ba-dd7bbfe19a80 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:02.281430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 40/84] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:02.282494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4b83d-0bfb-419f-9255-23ac27e7997d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:02.351388 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 45/85] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:02.352350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbdadc-af07-46a2-a8ba-dd7bbfe19a80 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:02.384665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4b83d-0bfb-419f-9255-23ac27e7997d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:02.417547 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:02.425735 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890c789-659f-41be-917c-fdcbdbc33658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:02.426457 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890c789-659f-41be-917c-fdcbdbc33658 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:02.426736 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890c789-659f-41be-917c-fdcbdbc33658 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:02.427678 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890c789-659f-41be-917c-fdcbdbc33658 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:02.427678 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890c789-659f-41be-917c-fdcbdbc33658 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:02.429157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890c789-659f-41be-917c-fdcbdbc33658 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:02.442701 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:02.450968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 41/86] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 2 18:47:02 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:47:02.452041 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890c789-659f-41be-917c-fdcbdbc33658 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:02.459009 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbdadc-af07-46a2-a8ba-dd7bbfe19a80 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:02.495961 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a80df4-5e8d-4922-b378-9a3b3f68ea02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:02.496851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a80df4-5e8d-4922-b378-9a3b3f68ea02 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:02.497129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a80df4-5e8d-4922-b378-9a3b3f68ea02 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:02.497403 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a80df4-5e8d-4922-b378-9a3b3f68ea02 None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:02.499048 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a80df4-5e8d-4922-b378-9a3b3f68ea02 None admin] RBAC: Authorizing `identity:get_project(project_id=cb94aac4115444f781367f00674d4de8)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:02.500529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a80df4-5e8d-4922-b378-9a3b3f68ea02 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:02.505365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 46/87] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:02 2022] GET /identity/v3/projects/cb94aac4115444f781367f00674d4de8 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:02.505365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a80df4-5e8d-4922-b378-9a3b3f68ea02 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:02.592215 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890c789-659f-41be-917c-fdcbdbc33658 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:02.622889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a80df4-5e8d-4922-b378-9a3b3f68ea02 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:02.627472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b13993-49c3-41c4-b9ba-2f7a0aad0316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:02.628178 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b13993-49c3-41c4-b9ba-2f7a0aad0316 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:02.628459 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b13993-49c3-41c4-b9ba-2f7a0aad0316 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:02.628732 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b13993-49c3-41c4-b9ba-2f7a0aad0316 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:02.629495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b13993-49c3-41c4-b9ba-2f7a0aad0316 None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:02.629825 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b13993-49c3-41c4-b9ba-2f7a0aad0316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:02.631297 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b13993-49c3-41c4-b9ba-2f7a0aad0316 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:02.642899 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 42/88] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:02.646835 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b13993-49c3-41c4-b9ba-2f7a0aad0316 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:02.664727 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c124fe-388b-43dc-a384-9aeca3f9baff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:02.665723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c124fe-388b-43dc-a384-9aeca3f9baff None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:02.666031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c124fe-388b-43dc-a384-9aeca3f9baff None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:02.666309 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c124fe-388b-43dc-a384-9aeca3f9baff None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:02.667522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c124fe-388b-43dc-a384-9aeca3f9baff None admin] RBAC: Authorizing `identity:get_project(project_id=cb94aac4115444f781367f00674d4de8)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:02.669278 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c124fe-388b-43dc-a384-9aeca3f9baff None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:02.675941 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 47/89] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:02 2022] GET /identity/v3/projects/cb94aac4115444f781367f00674d4de8 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:02.675941 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c124fe-388b-43dc-a384-9aeca3f9baff None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:02.709307 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:02.716237 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:02.784785 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b13993-49c3-41c4-b9ba-2f7a0aad0316 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:02.814704 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c124fe-388b-43dc-a384-9aeca3f9baff None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:02.832658 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9c1eb-ca6b-4252-9ae0-35fc734aff0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:02.835688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9c1eb-ca6b-4252-9ae0-35fc734aff0a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:02.835688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9c1eb-ca6b-4252-9ae0-35fc734aff0a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:02.835688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9c1eb-ca6b-4252-9ae0-35fc734aff0a None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:02.837200 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9c1eb-ca6b-4252-9ae0-35fc734aff0a None admin] RBAC: Authorizing `identity:get_project(project_id=cb94aac4115444f781367f00674d4de8)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:02.838665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9c1eb-ca6b-4252-9ae0-35fc734aff0a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:02.840344 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 43/90] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:02 2022] GET /identity/v3/projects/cb94aac4115444f781367f00674d4de8 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:02.841120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9c1eb-ca6b-4252-9ae0-35fc734aff0a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:02.855226 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f361a-7066-4627-b285-82972d7f7257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:02.855904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f361a-7066-4627-b285-82972d7f7257 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:02.856273 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f361a-7066-4627-b285-82972d7f7257 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:02.856511 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f361a-7066-4627-b285-82972d7f7257 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:02.857349 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f361a-7066-4627-b285-82972d7f7257 None admin] RBAC: Adding query filter params (role.id=1ecbde8dcaa44047899f618334033d43, scope.project.id=cb94aac4115444f781367f00674d4de8, user.id=3356491ab76f4af58ad2cc7077ba8a43) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:02.857733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f361a-7066-4627-b285-82972d7f7257 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:02.859232 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f361a-7066-4627-b285-82972d7f7257 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:02.868606 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 48/91] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:47:02 2022] GET /identity/v3/role_assignments?user.id=3356491ab76f4af58ad2cc7077ba8a43&scope.project.id=cb94aac4115444f781367f00674d4de8&role.id=1ecbde8dcaa44047899f618334033d43 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:02.869956 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f361a-7066-4627-b285-82972d7f7257 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:02.979567 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:02.990325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9c1eb-ca6b-4252-9ae0-35fc734aff0a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:02.993868 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f361a-7066-4627-b285-82972d7f7257 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:03.022235 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:03.035512 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bc195-f05e-4519-9a6f-ca1bfc5b849e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:03.036291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bc195-f05e-4519-9a6f-ca1bfc5b849e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:03.036635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bc195-f05e-4519-9a6f-ca1bfc5b849e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:03.037008 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bc195-f05e-4519-9a6f-ca1bfc5b849e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:03.038008 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bc195-f05e-4519-9a6f-ca1bfc5b849e None admin] RBAC: Adding query filter params (role.id=8560bac1acf74dce81ea6a76f751b641, scope.project.id=cb94aac4115444f781367f00674d4de8, user.id=f2f2aaa398bb4bba874340ea4e3288dd) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:03.038399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bc195-f05e-4519-9a6f-ca1bfc5b849e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:03.040013 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bc195-f05e-4519-9a6f-ca1bfc5b849e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:03.047293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 49/92] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:47:02 2022] GET /identity/v3/role_assignments?user.id=f2f2aaa398bb4bba874340ea4e3288dd&scope.project.id=cb94aac4115444f781367f00674d4de8&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:03.048351 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bc195-f05e-4519-9a6f-ca1bfc5b849e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:03.074619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831de06-932f-42a1-bf25-6af7514aa111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:03.075590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831de06-932f-42a1-bf25-6af7514aa111 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:03.075874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831de06-932f-42a1-bf25-6af7514aa111 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:03.076272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831de06-932f-42a1-bf25-6af7514aa111 None admin] PATH_INFO: `/v3/users/3356491ab76f4af58ad2cc7077ba8a43` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:03.077683 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831de06-932f-42a1-bf25-6af7514aa111 None admin] RBAC: Authorizing `identity:get_user(user_id=3356491ab76f4af58ad2cc7077ba8a43)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:03.079355 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831de06-932f-42a1-bf25-6af7514aa111 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:03.081131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 44/93] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:02 2022] GET /identity/v3/users/3356491ab76f4af58ad2cc7077ba8a43 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:03.102936 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831de06-932f-42a1-bf25-6af7514aa111 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:03.184115 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bc195-f05e-4519-9a6f-ca1bfc5b849e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:03.226130 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9fc38-f2a3-4996-b9cb-f4191deb64da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:03.226816 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9fc38-f2a3-4996-b9cb-f4191deb64da None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:03.227228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9fc38-f2a3-4996-b9cb-f4191deb64da None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:03.227505 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9fc38-f2a3-4996-b9cb-f4191deb64da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:03.228493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9fc38-f2a3-4996-b9cb-f4191deb64da None admin] RBAC: Adding query filter params (role.id=3e320079a5ce471e863ad87a36be46b1, scope.project.id=cb94aac4115444f781367f00674d4de8, user.id=3356491ab76f4af58ad2cc7077ba8a43) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:03.228906 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9fc38-f2a3-4996-b9cb-f4191deb64da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:03.230740 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9fc38-f2a3-4996-b9cb-f4191deb64da None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:03.237148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 50/94] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:47:03 2022] GET /identity/v3/role_assignments?user.id=3356491ab76f4af58ad2cc7077ba8a43&scope.project.id=cb94aac4115444f781367f00674d4de8&role.id=3e320079a5ce471e863ad87a36be46b1 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:03.293639 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831de06-932f-42a1-bf25-6af7514aa111 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:03.341900 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef65638-d7ee-4ca9-b2f9-3f14fc3e1c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:03.343014 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef65638-d7ee-4ca9-b2f9-3f14fc3e1c81 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:03.343503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef65638-d7ee-4ca9-b2f9-3f14fc3e1c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:03.343969 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef65638-d7ee-4ca9-b2f9-3f14fc3e1c81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:03.416088 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:03.442033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef65638-d7ee-4ca9-b2f9-3f14fc3e1c81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:03.444002 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef65638-d7ee-4ca9-b2f9-3f14fc3e1c81 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:03.574597 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 45/95] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:03.580668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9fc38-f2a3-4996-b9cb-f4191deb64da None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:03.597632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:03.707169 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9fc38-f2a3-4996-b9cb-f4191deb64da None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:03.741913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc532ae9-7085-4817-bd6e-ded1c8e916cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:03.742788 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc532ae9-7085-4817-bd6e-ded1c8e916cf None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:03.743067 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc532ae9-7085-4817-bd6e-ded1c8e916cf None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:03.743340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc532ae9-7085-4817-bd6e-ded1c8e916cf None admin] PATH_INFO: `/v3/projects/ab299c26666049b2b09419a176ca48a6` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:03.744518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc532ae9-7085-4817-bd6e-ded1c8e916cf None admin] RBAC: Authorizing `identity:get_project(project_id=ab299c26666049b2b09419a176ca48a6)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:03.746017 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc532ae9-7085-4817-bd6e-ded1c8e916cf None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:03.747899 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 51/96] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:03 2022] GET /identity/v3/projects/ab299c26666049b2b09419a176ca48a6 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:03.753879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef65638-d7ee-4ca9-b2f9-3f14fc3e1c81 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:03.854629 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:03.872260 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef65638-d7ee-4ca9-b2f9-3f14fc3e1c81 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:03.906757 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab775b-39f4-4e3e-b627-4faaf25701ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:03.907790 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab775b-39f4-4e3e-b627-4faaf25701ce None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:03.908291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab775b-39f4-4e3e-b627-4faaf25701ce None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:03.908755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab775b-39f4-4e3e-b627-4faaf25701ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:03.909817 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab775b-39f4-4e3e-b627-4faaf25701ce None admin] RBAC: Adding query filter params (role.id=3e320079a5ce471e863ad87a36be46b1, scope.project.id=ab299c26666049b2b09419a176ca48a6, user.id=3356491ab76f4af58ad2cc7077ba8a43) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:03.910334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab775b-39f4-4e3e-b627-4faaf25701ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:03.911970 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab775b-39f4-4e3e-b627-4faaf25701ce None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:03.918278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 46/97] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:47:03 2022] GET /identity/v3/role_assignments?user.id=3356491ab76f4af58ad2cc7077ba8a43&scope.project.id=ab299c26666049b2b09419a176ca48a6&role.id=3e320079a5ce471e863ad87a36be46b1 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:05.639503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872641d-9767-4be3-b541-bf612e9e4522 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:05.640054 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872641d-9767-4be3-b541-bf612e9e4522 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:05.640054 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872641d-9767-4be3-b541-bf612e9e4522 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:05.641712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 52/98] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:05.647089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2fe2-93ea-4bd9-b83f-b3db9584eb8e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:05.647878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2fe2-93ea-4bd9-b83f-b3db9584eb8e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:05.648377 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2fe2-93ea-4bd9-b83f-b3db9584eb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:05.674151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-59ad2fe2-93ea-4bd9-b83f-b3db9584eb8e None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:05.675753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-59ad2fe2-93ea-4bd9-b83f-b3db9584eb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:05.765204 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 47/99] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:05.801223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872641d-9767-4be3-b541-bf612e9e4522 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:05.933273 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:05.958725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872641d-9767-4be3-b541-bf612e9e4522 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:05.970639 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0efda-6670-42de-863f-444d28219d7e None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:05.971219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0efda-6670-42de-863f-444d28219d7e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:05.971694 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0efda-6670-42de-863f-444d28219d7e None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:05.973512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 48/100] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:05.978314 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19de31f-f57f-464d-be91-5b0958299d0f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:05.978814 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19de31f-f57f-464d-be91-5b0958299d0f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:05.979413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19de31f-f57f-464d-be91-5b0958299d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:06.009567 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f19de31f-f57f-464d-be91-5b0958299d0f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:06.011287 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f19de31f-f57f-464d-be91-5b0958299d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:06.018531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459701c-13b8-44ba-afc0-7025ed4ff089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:06.019365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459701c-13b8-44ba-afc0-7025ed4ff089 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:06.019651 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459701c-13b8-44ba-afc0-7025ed4ff089 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:06.019925 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459701c-13b8-44ba-afc0-7025ed4ff089 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:06.050589 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459701c-13b8-44ba-afc0-7025ed4ff089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:06.058408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-4459701c-13b8-44ba-afc0-7025ed4ff089 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 18:47:06.058408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:06.058408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:06.058408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:06.058408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:06.058408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:06.058408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:06.058408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:06.058408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:06.058408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:06.058408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:06.058408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:06.058408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:06.058408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:06.058408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:06.058408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:06.059365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:06.059365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:06.059365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:06.059365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:06.059365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:06.059365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:06.059365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:06.059365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:06.059365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:06.059365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:06.059365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:06.059365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:06.059365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:06.059365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:06.059365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:06.059365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:06.060142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:06.060142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:06.060142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:06.060142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:06.060142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:06.060142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:06.060142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:06.060142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:06.060142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:06.060142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:06.060142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 18:47:06.060142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:06.066235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 53/101] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:06.073204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459701c-13b8-44ba-afc0-7025ed4ff089 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:06.133407 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 49/102] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:47:06.173727 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19de31f-f57f-464d-be91-5b0958299d0f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:06.193559 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:06.278856 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459701c-13b8-44ba-afc0-7025ed4ff089 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:06.367941 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4179d-25ff-42e0-a9de-4cc7b7065adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:06.368549 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4179d-25ff-42e0-a9de-4cc7b7065adc None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:06.368831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4179d-25ff-42e0-a9de-4cc7b7065adc None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:06.369105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4179d-25ff-42e0-a9de-4cc7b7065adc None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:06.369890 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4179d-25ff-42e0-a9de-4cc7b7065adc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:06.370201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4179d-25ff-42e0-a9de-4cc7b7065adc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:06.371614 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4179d-25ff-42e0-a9de-4cc7b7065adc None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:06.388424 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 54/103] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:06.390311 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19de31f-f57f-464d-be91-5b0958299d0f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:06.393926 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4179d-25ff-42e0-a9de-4cc7b7065adc None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:06.397748 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:06.442226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440a45f-584a-4fc2-82c7-6499002aca63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:06.443419 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440a45f-584a-4fc2-82c7-6499002aca63 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:06.443833 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440a45f-584a-4fc2-82c7-6499002aca63 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:06.444255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440a45f-584a-4fc2-82c7-6499002aca63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:06.457033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440a45f-584a-4fc2-82c7-6499002aca63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:06.467033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-5440a45f-584a-4fc2-82c7-6499002aca63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:06.467033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:06.467033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:06.467033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:06.467033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:06.467033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:06.467033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:06.467033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:06.467033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:06.467033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:06.467033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:06.467033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:06.467033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:06.467033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:06.467033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:06.467033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:06.468209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:06.468209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:06.468209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:06.468209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:06.468209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:06.468209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:06.468209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:06.468209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:06.468209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:06.468209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:06.468209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:06.468209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:06.468209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:06.468209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:06.468209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:06.468209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:06.469162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:06.469162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:06.469162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:06.469162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:06.469162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:06.469162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:06.469162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:06.469162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:06.469162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:06.469162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:06.469162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:06.469162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:06.472359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 50/104] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:47:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:06.473806 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55316798-3379-422f-87a7-2a4a8640bccc None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:06.474214 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55316798-3379-422f-87a7-2a4a8640bccc None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:06.474634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55316798-3379-422f-87a7-2a4a8640bccc None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:06.476792 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 51/105] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:06.490161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc451b2-336f-44ef-bdd4-816bfdbf5487 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:06.491224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc451b2-336f-44ef-bdd4-816bfdbf5487 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:06.491698 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc451b2-336f-44ef-bdd4-816bfdbf5487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:06.516721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-6bc451b2-336f-44ef-bdd4-816bfdbf5487 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:06.518857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6bc451b2-336f-44ef-bdd4-816bfdbf5487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:06.600804 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:06.602629 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 52/106] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:47:06.608282 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc451b2-336f-44ef-bdd4-816bfdbf5487 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:06.631303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4179d-25ff-42e0-a9de-4cc7b7065adc None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:06.675058 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061aa334-f685-436e-ba02-d3e7ac2c5e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:06.676995 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aa334-f685-436e-ba02-d3e7ac2c5e2a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:06.677690 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aa334-f685-436e-ba02-d3e7ac2c5e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:06.678126 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aa334-f685-436e-ba02-d3e7ac2c5e2a None admin] PATH_INFO: `/v3/users/8a51931824f547bfb99216954193546d` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:06.695937 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061aa334-f685-436e-ba02-d3e7ac2c5e2a None admin] RBAC: Authorizing `identity:get_user(user_id=8a51931824f547bfb99216954193546d)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:06.698407 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061aa334-f685-436e-ba02-d3e7ac2c5e2a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:06.700583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 55/107] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:06 2022] GET /identity/v3/users/8a51931824f547bfb99216954193546d => generated 289 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:06.707697 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d9d28-9094-4521-b931-44720c752fab None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:06.708778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d9d28-9094-4521-b931-44720c752fab None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:06.709191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d9d28-9094-4521-b931-44720c752fab None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:06.710844 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 56/108] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:06.712447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d9d28-9094-4521-b931-44720c752fab None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:06.753962 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc451b2-336f-44ef-bdd4-816bfdbf5487 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:06.787390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:06.794312 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677407c5-dd9b-48ae-bfa6-796ef6cdbe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:06.795107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677407c5-dd9b-48ae-bfa6-796ef6cdbe27 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:06.795381 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677407c5-dd9b-48ae-bfa6-796ef6cdbe27 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:06.795691 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677407c5-dd9b-48ae-bfa6-796ef6cdbe27 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:06.796404 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677407c5-dd9b-48ae-bfa6-796ef6cdbe27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:06.796706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677407c5-dd9b-48ae-bfa6-796ef6cdbe27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:06.798652 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677407c5-dd9b-48ae-bfa6-796ef6cdbe27 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:06.810199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 53/109] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:47:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:06.810199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677407c5-dd9b-48ae-bfa6-796ef6cdbe27 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:06.834152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d9d28-9094-4521-b931-44720c752fab None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:06.867442 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94370d-768a-4465-a7b3-519928a8fd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:06.868260 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94370d-768a-4465-a7b3-519928a8fd50 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:06.868539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94370d-768a-4465-a7b3-519928a8fd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:06.868809 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94370d-768a-4465-a7b3-519928a8fd50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:06.869994 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94370d-768a-4465-a7b3-519928a8fd50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:06.871441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94370d-768a-4465-a7b3-519928a8fd50 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:06.873092 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 57/110] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:47:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:06.874317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539caa90-d212-4a85-a13c-77ecacec6f88 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:06.874601 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539caa90-d212-4a85-a13c-77ecacec6f88 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:06.874857 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539caa90-d212-4a85-a13c-77ecacec6f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:06.879516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:06.894898 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-539caa90-d212-4a85-a13c-77ecacec6f88 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:06.896010 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-539caa90-d212-4a85-a13c-77ecacec6f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:06.924465 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677407c5-dd9b-48ae-bfa6-796ef6cdbe27 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:06.959626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499edf0-2601-44eb-93fc-05be7090f38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:06.960539 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499edf0-2601-44eb-93fc-05be7090f38b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:06.960985 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499edf0-2601-44eb-93fc-05be7090f38b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:06.961262 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499edf0-2601-44eb-93fc-05be7090f38b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:06.964981 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 58/111] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:06.966560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7342f-7194-438c-b598-57db04114c38 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:06.967082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7342f-7194-438c-b598-57db04114c38 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:06.967393 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7342f-7194-438c-b598-57db04114c38 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:06.968870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 59/112] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:06.969536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7342f-7194-438c-b598-57db04114c38 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:07.042607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:07.047205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499edf0-2601-44eb-93fc-05be7090f38b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:07.048805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499edf0-2601-44eb-93fc-05be7090f38b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:07.090581 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7342f-7194-438c-b598-57db04114c38 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:07.114624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:07.127869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c973ac0-5fd0-4bc2-bacf-06ff62e93342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:07.128758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c973ac0-5fd0-4bc2-bacf-06ff62e93342 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:07.129035 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c973ac0-5fd0-4bc2-bacf-06ff62e93342 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:07.129301 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c973ac0-5fd0-4bc2-bacf-06ff62e93342 None admin] PATH_INFO: `/v3/users/3356491ab76f4af58ad2cc7077ba8a43` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:07.130499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c973ac0-5fd0-4bc2-bacf-06ff62e93342 None admin] RBAC: Authorizing `identity:get_user(user_id=3356491ab76f4af58ad2cc7077ba8a43)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:07.131957 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c973ac0-5fd0-4bc2-bacf-06ff62e93342 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:07.133599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 60/113] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:06 2022] GET /identity/v3/users/3356491ab76f4af58ad2cc7077ba8a43 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:07.138034 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c973ac0-5fd0-4bc2-bacf-06ff62e93342 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:07.168031 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 54/114] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:07.169749 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bb220-7373-477d-8918-a08a81baeb7f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:07.170064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bb220-7373-477d-8918-a08a81baeb7f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:07.170334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bb220-7373-477d-8918-a08a81baeb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:07.187372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e94bb220-7373-477d-8918-a08a81baeb7f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:07.188821 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e94bb220-7373-477d-8918-a08a81baeb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:07.242468 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c973ac0-5fd0-4bc2-bacf-06ff62e93342 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:07.258428 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 55/115] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:07.266962 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bb220-7373-477d-8918-a08a81baeb7f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:07.271381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:07.280280 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368121a1-275b-4cb6-996b-1fd073561bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:07.280994 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368121a1-275b-4cb6-996b-1fd073561bea None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:07.281280 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368121a1-275b-4cb6-996b-1fd073561bea None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:07.281555 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368121a1-275b-4cb6-996b-1fd073561bea None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:07.282321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368121a1-275b-4cb6-996b-1fd073561bea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:07.283993 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368121a1-275b-4cb6-996b-1fd073561bea None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:07.311883 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 61/116] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 2 18:47:07 2022] POST /identity/v3/projects => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:47:07.313170 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368121a1-275b-4cb6-996b-1fd073561bea None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:07.390702 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:07.401195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bb220-7373-477d-8918-a08a81baeb7f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:07.442298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43961b90-5cdc-4a3d-97e9-4657c835dd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:07.442498 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368121a1-275b-4cb6-996b-1fd073561bea None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:07.443027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43961b90-5cdc-4a3d-97e9-4657c835dd7c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:07.443308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43961b90-5cdc-4a3d-97e9-4657c835dd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:07.443598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43961b90-5cdc-4a3d-97e9-4657c835dd7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:07.455793 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43961b90-5cdc-4a3d-97e9-4657c835dd7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:07.464030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-43961b90-5cdc-4a3d-97e9-4657c835dd7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:47:07.464030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:07.464030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:07.464030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:07.464030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:07.464030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:07.464030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:07.464030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:07.464030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:07.464030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:07.464030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:07.464030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:07.464030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:07.464030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:07.464030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:07.464030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:07.464967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:07.464967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:07.464967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:07.464967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:07.464967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:07.464967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:07.464967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:07.464967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:07.464967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:07.464967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:07.464967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:07.464967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:07.464967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:07.464967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:07.464967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:07.464967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:07.471182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:07.471182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:07.471182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:07.471182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:07.471182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:07.471182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:07.471182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:07.471182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:07.471182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:07.471182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:07.471182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:47:07.471182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:07.471182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 56/117] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:47:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:07.471182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43961b90-5cdc-4a3d-97e9-4657c835dd7c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:07.487848 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe83614-6753-4616-ac5d-25363de004bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:07.488724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe83614-6753-4616-ac5d-25363de004bb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:07.489007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe83614-6753-4616-ac5d-25363de004bb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:07.489283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe83614-6753-4616-ac5d-25363de004bb None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:07.490539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe83614-6753-4616-ac5d-25363de004bb None admin] RBAC: Authorizing `identity:get_project(project_id=cb94aac4115444f781367f00674d4de8)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:07.492145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe83614-6753-4616-ac5d-25363de004bb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:07.498937 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 62/118] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:07 2022] GET /identity/v3/projects/cb94aac4115444f781367f00674d4de8 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:07.498937 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe83614-6753-4616-ac5d-25363de004bb None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:07.560174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:07.596550 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43961b90-5cdc-4a3d-97e9-4657c835dd7c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:07.618775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe83614-6753-4616-ac5d-25363de004bb None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:07.632460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d841a44-2870-4ec6-a2a1-ce04233d2459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:07.633575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d841a44-2870-4ec6-a2a1-ce04233d2459 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:07.634034 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d841a44-2870-4ec6-a2a1-ce04233d2459 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:07.634352 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d841a44-2870-4ec6-a2a1-ce04233d2459 None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:07.635578 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d841a44-2870-4ec6-a2a1-ce04233d2459 None admin] RBAC: Authorizing `identity:get_project(project_id=cb94aac4115444f781367f00674d4de8)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:07.637028 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d841a44-2870-4ec6-a2a1-ce04233d2459 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:07.644376 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 57/119] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:07 2022] GET /identity/v3/projects/cb94aac4115444f781367f00674d4de8 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:07.645538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e1ef0-fb93-4c57-8feb-1eed68289225 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:07.645828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e1ef0-fb93-4c57-8feb-1eed68289225 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:07.646126 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e1ef0-fb93-4c57-8feb-1eed68289225 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:07.651495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 58/120] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:07.651495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e1ef0-fb93-4c57-8feb-1eed68289225 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:07.657176 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c47c83-4e09-47ed-b0de-171cc326ba24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:07.658023 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c47c83-4e09-47ed-b0de-171cc326ba24 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:07.658304 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c47c83-4e09-47ed-b0de-171cc326ba24 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:07.658578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c47c83-4e09-47ed-b0de-171cc326ba24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:07.669669 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c47c83-4e09-47ed-b0de-171cc326ba24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:07.670616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:07.678267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-73c47c83-4e09-47ed-b0de-171cc326ba24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:07.678267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:07.678267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:07.678267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:07.678267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:07.678267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:07.678267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:07.678267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:07.678267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:07.678267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:07.678267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:07.678267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:07.678267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:07.678267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:07.678267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:07.678267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:07.679466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:07.679466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:07.679466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:07.679466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:07.679466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:07.679466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:07.679466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:07.679466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:07.679466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:07.679466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:07.679466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:07.679466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:07.679466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:07.679466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:07.679466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:07.679466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:07.680221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:07.680221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:07.680221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:07.680221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:07.680221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:07.680221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:07.680221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:07.680221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:07.680221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:07.680221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:07.680221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:07.680221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:07.680221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 63/121] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:07.680221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c47c83-4e09-47ed-b0de-171cc326ba24 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:07.763176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e1ef0-fb93-4c57-8feb-1eed68289225 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:07.786766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c47c83-4e09-47ed-b0de-171cc326ba24 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:07.795910 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:07.803990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1b430-d3a9-4007-92c3-8b85570d19c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:07.804952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1b430-d3a9-4007-92c3-8b85570d19c2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:07.805397 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1b430-d3a9-4007-92c3-8b85570d19c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:07.805830 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1b430-d3a9-4007-92c3-8b85570d19c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:07.806712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1b430-d3a9-4007-92c3-8b85570d19c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:07.807163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1b430-d3a9-4007-92c3-8b85570d19c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:07.808742 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1b430-d3a9-4007-92c3-8b85570d19c2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:07.818119 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 59/122] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:07.819127 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1b430-d3a9-4007-92c3-8b85570d19c2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:07.828380 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f1785-ea7a-414b-958e-9bcd03bb777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:07.829335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1785-ea7a-414b-958e-9bcd03bb777a None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:07.829618 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1785-ea7a-414b-958e-9bcd03bb777a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:07.829924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1785-ea7a-414b-958e-9bcd03bb777a None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8/users/3356491ab76f4af58ad2cc7077ba8a43/roles/1ecbde8dcaa44047899f618334033d43` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:07.832124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f1785-ea7a-414b-958e-9bcd03bb777a None admin] RBAC: Authorizing `identity:create_grant(project_id=cb94aac4115444f781367f00674d4de8, user_id=3356491ab76f4af58ad2cc7077ba8a43, role_id=1ecbde8dcaa44047899f618334033d43)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:07.833988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f1785-ea7a-414b-958e-9bcd03bb777a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:07.851381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 64/123] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:47:07 2022] PUT /identity/v3/projects/cb94aac4115444f781367f00674d4de8/users/3356491ab76f4af58ad2cc7077ba8a43/roles/1ecbde8dcaa44047899f618334033d43 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:47:07.852436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1878fdc-4a68-4155-8847-4078ad0668bd None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:07.852768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1878fdc-4a68-4155-8847-4078ad0668bd None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:07.853053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1878fdc-4a68-4155-8847-4078ad0668bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:07.874340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b1878fdc-4a68-4155-8847-4078ad0668bd None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:07.875587 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b1878fdc-4a68-4155-8847-4078ad0668bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:07.922341 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:07.949257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1b430-d3a9-4007-92c3-8b85570d19c2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:07.969020 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 65/124] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:07.970873 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1878fdc-4a68-4155-8847-4078ad0668bd None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:08.017547 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddf11c-f7f7-400b-bde4-fdff57d88bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:08.018293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddf11c-f7f7-400b-bde4-fdff57d88bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:08.018651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddf11c-f7f7-400b-bde4-fdff57d88bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:08.019000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddf11c-f7f7-400b-bde4-fdff57d88bd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:08.019923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddf11c-f7f7-400b-bde4-fdff57d88bd8 None admin] RBAC: Adding query filter params (role.id=83b821ffac7d4dbdb849c13f1dbd4ead, scope.project.id=cb94aac4115444f781367f00674d4de8, user.id=8a51931824f547bfb99216954193546d) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:08.020308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddf11c-f7f7-400b-bde4-fdff57d88bd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:08.021903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddf11c-f7f7-400b-bde4-fdff57d88bd8 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:08.028687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 60/125] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:47:07 2022] GET /identity/v3/role_assignments?user.id=8a51931824f547bfb99216954193546d&scope.project.id=cb94aac4115444f781367f00674d4de8&role.id=83b821ffac7d4dbdb849c13f1dbd4ead => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:08.029851 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddf11c-f7f7-400b-bde4-fdff57d88bd8 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:08.110578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1878fdc-4a68-4155-8847-4078ad0668bd None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:08.114222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:08.149458 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddf11c-f7f7-400b-bde4-fdff57d88bd8 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:08.152284 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcba20d-e5bb-4a1f-a56f-33b7ef8c3b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:08.153472 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcba20d-e5bb-4a1f-a56f-33b7ef8c3b03 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:08.153472 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcba20d-e5bb-4a1f-a56f-33b7ef8c3b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:08.153632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcba20d-e5bb-4a1f-a56f-33b7ef8c3b03 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:08.154473 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcba20d-e5bb-4a1f-a56f-33b7ef8c3b03 None admin] RBAC: Adding query filter params (name=member) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:08.154935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcba20d-e5bb-4a1f-a56f-33b7ef8c3b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:08.156560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcba20d-e5bb-4a1f-a56f-33b7ef8c3b03 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:08.167239 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 66/126] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:08.168144 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcba20d-e5bb-4a1f-a56f-33b7ef8c3b03 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:08.190356 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b1b64-b441-4317-8cad-f894fdff37d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:08.191391 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b1b64-b441-4317-8cad-f894fdff37d6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:08.191678 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b1b64-b441-4317-8cad-f894fdff37d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:08.192001 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b1b64-b441-4317-8cad-f894fdff37d6 None admin] PATH_INFO: `/v3/users/f2f2aaa398bb4bba874340ea4e3288dd` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:08.193326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b1b64-b441-4317-8cad-f894fdff37d6 None admin] RBAC: Authorizing `identity:get_user(user_id=f2f2aaa398bb4bba874340ea4e3288dd)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:08.194863 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b1b64-b441-4317-8cad-f894fdff37d6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:08.196647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 61/127] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:08 2022] GET /identity/v3/users/f2f2aaa398bb4bba874340ea4e3288dd => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:08.197538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b1b64-b441-4317-8cad-f894fdff37d6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:08.214494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:08.287374 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcba20d-e5bb-4a1f-a56f-33b7ef8c3b03 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:08.315093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b1b64-b441-4317-8cad-f894fdff37d6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:08.322591 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cb07a-8dbb-401b-8b89-567fe6598077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:08.323409 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cb07a-8dbb-401b-8b89-567fe6598077 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:08.323691 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cb07a-8dbb-401b-8b89-567fe6598077 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:08.323960 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cb07a-8dbb-401b-8b89-567fe6598077 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:08.343330 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cb07a-8dbb-401b-8b89-567fe6598077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:08.354194 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b816e76-d4e3-4160-a496-79bf04b4b8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:08.355091 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b816e76-d4e3-4160-a496-79bf04b4b8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:08.355384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b816e76-d4e3-4160-a496-79bf04b4b8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:08.355669 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b816e76-d4e3-4160-a496-79bf04b4b8c3 None admin] PATH_INFO: `/v3/users/3356491ab76f4af58ad2cc7077ba8a43` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:08.356981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b816e76-d4e3-4160-a496-79bf04b4b8c3 None admin] RBAC: Authorizing `identity:get_user(user_id=3356491ab76f4af58ad2cc7077ba8a43)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:08.358697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b816e76-d4e3-4160-a496-79bf04b4b8c3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:08.360116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-269cb07a-8dbb-401b-8b89-567fe6598077 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:08.360116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:08.360116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:08.360116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:08.360116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:08.360116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:08.360116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:08.360116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:08.360116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:08.360116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:08.360116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:08.360116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:08.360116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:08.360116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:08.360116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:08.360116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:08.361047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:08.361047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:08.361047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:08.361047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:08.361047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:08.361047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:08.361047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:08.361047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:08.361047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:08.361047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:08.361047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:08.361047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:08.361047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:08.361047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:08.361047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:08.361047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:08.361858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:08.361858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:08.361858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:08.361858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:08.361858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:08.361858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:08.361858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:08.361858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:08.361858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:08.361858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:08.361858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:08.361858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:08.362451 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 62/128] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:08 2022] GET /identity/v3/users/3356491ab76f4af58ad2cc7077ba8a43 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:08.362516 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 67/129] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:08.362584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b816e76-d4e3-4160-a496-79bf04b4b8c3 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:08.367154 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cb07a-8dbb-401b-8b89-567fe6598077 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:08.402392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:08.449503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:08.471221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b816e76-d4e3-4160-a496-79bf04b4b8c3 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:08.500266 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cb07a-8dbb-401b-8b89-567fe6598077 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:08.511234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f47b2-2fa0-4c53-b671-17451c73daae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:08.512502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f47b2-2fa0-4c53-b671-17451c73daae None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:08.513209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f47b2-2fa0-4c53-b671-17451c73daae None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:08.514032 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f47b2-2fa0-4c53-b671-17451c73daae None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:08.516423 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f47b2-2fa0-4c53-b671-17451c73daae None admin] RBAC: Authorizing `identity:get_project(project_id=cb94aac4115444f781367f00674d4de8)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:08.519540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f47b2-2fa0-4c53-b671-17451c73daae None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:08.521925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 63/130] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:08 2022] GET /identity/v3/projects/cb94aac4115444f781367f00674d4de8 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:08.523058 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f47b2-2fa0-4c53-b671-17451c73daae None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:08.614636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62a278-fcb3-4b74-96b8-ee4f4e4e32ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:08.615245 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62a278-fcb3-4b74-96b8-ee4f4e4e32ac None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:08.615525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62a278-fcb3-4b74-96b8-ee4f4e4e32ac None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:08.615798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62a278-fcb3-4b74-96b8-ee4f4e4e32ac None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:08.616562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62a278-fcb3-4b74-96b8-ee4f4e4e32ac None admin] RBAC: Adding query filter params (name=member) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:08.616869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62a278-fcb3-4b74-96b8-ee4f4e4e32ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:08.618297 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62a278-fcb3-4b74-96b8-ee4f4e4e32ac None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:08.636549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f47b2-2fa0-4c53-b671-17451c73daae None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:08.637926 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 68/131] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:08.638813 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62a278-fcb3-4b74-96b8-ee4f4e4e32ac None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:08.675812 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0339c-399a-40b9-926e-48a00583e24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:08.677346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0339c-399a-40b9-926e-48a00583e24a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:08.677861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0339c-399a-40b9-926e-48a00583e24a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:08.678351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0339c-399a-40b9-926e-48a00583e24a None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:08.679952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0339c-399a-40b9-926e-48a00583e24a None admin] RBAC: Authorizing `identity:get_project(project_id=cb94aac4115444f781367f00674d4de8)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:08.681685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0339c-399a-40b9-926e-48a00583e24a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:08.683741 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 64/132] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:08 2022] GET /identity/v3/projects/cb94aac4115444f781367f00674d4de8 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:08.684931 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0339c-399a-40b9-926e-48a00583e24a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:08.705268 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:08.734924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:08.753698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62a278-fcb3-4b74-96b8-ee4f4e4e32ac None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:08.788391 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43843734-57ac-4183-b76a-974e4fd7aa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:08.789455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43843734-57ac-4183-b76a-974e4fd7aa38 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:08.789582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43843734-57ac-4183-b76a-974e4fd7aa38 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:08.789842 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43843734-57ac-4183-b76a-974e4fd7aa38 None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8/users/f2f2aaa398bb4bba874340ea4e3288dd/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:08.791869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43843734-57ac-4183-b76a-974e4fd7aa38 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb94aac4115444f781367f00674d4de8, user_id=f2f2aaa398bb4bba874340ea4e3288dd, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:08.793400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43843734-57ac-4183-b76a-974e4fd7aa38 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:08.800894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0339c-399a-40b9-926e-48a00583e24a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:08.822757 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 69/133] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:47:08 2022] PUT /identity/v3/projects/cb94aac4115444f781367f00674d4de8/users/f2f2aaa398bb4bba874340ea4e3288dd/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:47:08.823379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43843734-57ac-4183-b76a-974e4fd7aa38 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:08.844455 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f17e22-c514-4da5-ac7e-f86b339eb432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:08.845771 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f17e22-c514-4da5-ac7e-f86b339eb432 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:08.846439 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f17e22-c514-4da5-ac7e-f86b339eb432 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:08.846948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f17e22-c514-4da5-ac7e-f86b339eb432 None admin] PATH_INFO: `/v3/users/3356491ab76f4af58ad2cc7077ba8a43` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:08.848468 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f17e22-c514-4da5-ac7e-f86b339eb432 None admin] RBAC: Authorizing `identity:get_user(user_id=3356491ab76f4af58ad2cc7077ba8a43)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:08.850637 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f17e22-c514-4da5-ac7e-f86b339eb432 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:08.852636 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 65/134] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:08 2022] GET /identity/v3/users/3356491ab76f4af58ad2cc7077ba8a43 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:08.858643 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f17e22-c514-4da5-ac7e-f86b339eb432 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:08.958495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:08.982815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f17e22-c514-4da5-ac7e-f86b339eb432 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:09.034569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e9870-acdc-43ac-a08e-3c5988f274e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:09.035831 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e9870-acdc-43ac-a08e-3c5988f274e5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:09.036310 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e9870-acdc-43ac-a08e-3c5988f274e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:09.036806 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e9870-acdc-43ac-a08e-3c5988f274e5 None admin] PATH_INFO: `/v3/projects/ab299c26666049b2b09419a176ca48a6` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:09.038425 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e9870-acdc-43ac-a08e-3c5988f274e5 None admin] RBAC: Authorizing `identity:get_project(project_id=ab299c26666049b2b09419a176ca48a6)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:09.040620 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e9870-acdc-43ac-a08e-3c5988f274e5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:09.043301 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 66/135] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:08 2022] GET /identity/v3/projects/ab299c26666049b2b09419a176ca48a6 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:09.051915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e9870-acdc-43ac-a08e-3c5988f274e5 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:09.167413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43843734-57ac-4183-b76a-974e4fd7aa38 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:09.187605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e9870-acdc-43ac-a08e-3c5988f274e5 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:09.221847 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00478a-68c8-4a3b-a770-96681cf2c2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:09.225434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00478a-68c8-4a3b-a770-96681cf2c2a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:09.225958 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00478a-68c8-4a3b-a770-96681cf2c2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:09.227496 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00478a-68c8-4a3b-a770-96681cf2c2a4 None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8/users/3356491ab76f4af58ad2cc7077ba8a43/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:09.231835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00478a-68c8-4a3b-a770-96681cf2c2a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb94aac4115444f781367f00674d4de8, user_id=3356491ab76f4af58ad2cc7077ba8a43, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:09.234653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00478a-68c8-4a3b-a770-96681cf2c2a4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:09.242691 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4768c2-abb3-428c-9c10-8bc2a233631f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:09.244084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4768c2-abb3-428c-9c10-8bc2a233631f None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:09.245028 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4768c2-abb3-428c-9c10-8bc2a233631f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:09.245504 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4768c2-abb3-428c-9c10-8bc2a233631f None admin] PATH_INFO: `/v3/projects/ab299c26666049b2b09419a176ca48a6/users/3356491ab76f4af58ad2cc7077ba8a43/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:09.248188 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4768c2-abb3-428c-9c10-8bc2a233631f None admin] RBAC: Authorizing `identity:create_grant(project_id=ab299c26666049b2b09419a176ca48a6, user_id=3356491ab76f4af58ad2cc7077ba8a43, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:09.250073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4768c2-abb3-428c-9c10-8bc2a233631f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:09.263891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 70/136] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:47:08 2022] PUT /identity/v3/projects/cb94aac4115444f781367f00674d4de8/users/3356491ab76f4af58ad2cc7077ba8a43/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:47:09.272538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 67/137] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:47:09 2022] PUT /identity/v3/projects/ab299c26666049b2b09419a176ca48a6/users/3356491ab76f4af58ad2cc7077ba8a43/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:47:10.195560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84827bbd-745e-4a95-9697-eb53f4e2a3e4 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:10.196107 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84827bbd-745e-4a95-9697-eb53f4e2a3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:10.196107 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84827bbd-745e-4a95-9697-eb53f4e2a3e4 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:10.197506 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 71/138] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:10.203124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff7857-1469-4934-aef5-d5e0150ace00 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:10.203550 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff7857-1469-4934-aef5-d5e0150ace00 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:10.203722 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff7857-1469-4934-aef5-d5e0150ace00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:10.226444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-86ff7857-1469-4934-aef5-d5e0150ace00 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:10.227707 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-86ff7857-1469-4934-aef5-d5e0150ace00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:10.236202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:10.319231 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 68/139] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:10.357234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84827bbd-745e-4a95-9697-eb53f4e2a3e4 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:10.360421 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:10.487214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84827bbd-745e-4a95-9697-eb53f4e2a3e4 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:10.556183 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14982a43-ae6b-475d-8748-e5f21ff54389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:10.557370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14982a43-ae6b-475d-8748-e5f21ff54389 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:10.557872 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14982a43-ae6b-475d-8748-e5f21ff54389 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:10.558368 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14982a43-ae6b-475d-8748-e5f21ff54389 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:10.559790 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14982a43-ae6b-475d-8748-e5f21ff54389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:10.561842 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14982a43-ae6b-475d-8748-e5f21ff54389 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:10.564044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 72/140] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:47:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:10.575014 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff7857-1469-4934-aef5-d5e0150ace00 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:10.708642 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff7857-1469-4934-aef5-d5e0150ace00 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:10.757201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9991715-c404-468d-a9c6-59dd11277467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:10.757840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9991715-c404-468d-a9c6-59dd11277467 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:10.758133 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9991715-c404-468d-a9c6-59dd11277467 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:10.758409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9991715-c404-468d-a9c6-59dd11277467 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:10.759138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9991715-c404-468d-a9c6-59dd11277467 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:10.760621 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9991715-c404-468d-a9c6-59dd11277467 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:10.794112 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:10.800163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 69/141] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 2 18:47:10 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:47:10.911798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199752f-68f9-4380-8a57-d3edeba9dab4 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:10.912149 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199752f-68f9-4380-8a57-d3edeba9dab4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:10.912347 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199752f-68f9-4380-8a57-d3edeba9dab4 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:10.913993 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 73/142] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:10.919370 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d0d9d-178d-4b0b-ba2a-b12da96c0f1f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:10.919666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d0d9d-178d-4b0b-ba2a-b12da96c0f1f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:10.919666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d0d9d-178d-4b0b-ba2a-b12da96c0f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:10.943051 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-359d0d9d-178d-4b0b-ba2a-b12da96c0f1f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:10.944310 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-359d0d9d-178d-4b0b-ba2a-b12da96c0f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:10.971241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44157aae-ac6d-4e5f-86c2-03ffcdcf93a8 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:10.971550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44157aae-ac6d-4e5f-86c2-03ffcdcf93a8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:10.971800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44157aae-ac6d-4e5f-86c2-03ffcdcf93a8 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:10.973406 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 74/143] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:10.981729 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055082d-f47f-4f7a-bbd7-070b3c1f9b91 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:10.982056 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055082d-f47f-4f7a-bbd7-070b3c1f9b91 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:10.982381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055082d-f47f-4f7a-bbd7-070b3c1f9b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:11.015293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f055082d-f47f-4f7a-bbd7-070b3c1f9b91 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:11.016438 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f055082d-f47f-4f7a-bbd7-070b3c1f9b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:11.053134 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 70/144] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:11.085440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d0d9d-178d-4b0b-ba2a-b12da96c0f1f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:11.154230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:11.163564 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 75/145] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:11.199095 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055082d-f47f-4f7a-bbd7-070b3c1f9b91 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:11.218165 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d0d9d-178d-4b0b-ba2a-b12da96c0f1f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:11.250205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:11.258077 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e64958-9786-41a7-b70f-eff8bd8fb220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:11.258919 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e64958-9786-41a7-b70f-eff8bd8fb220 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:11.259204 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e64958-9786-41a7-b70f-eff8bd8fb220 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:11.259483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e64958-9786-41a7-b70f-eff8bd8fb220 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:11.271677 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e64958-9786-41a7-b70f-eff8bd8fb220 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:11.280420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-d6e64958-9786-41a7-b70f-eff8bd8fb220 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:11.280420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:11.280420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:11.280420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:11.280420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:11.280420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:11.280420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:11.280420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:11.280420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:11.280420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:11.280420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:11.280420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:11.280420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:11.280420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:11.280420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:11.280420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:11.281292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:11.281292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:11.281292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:11.281292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:11.281292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:11.281292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:11.281292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:11.281292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:11.281292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:11.281292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:11.281292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:11.281292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:11.281292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:11.281292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:11.281292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:11.281292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:11.282080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:11.282080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:11.282080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:11.282080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:11.282080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:11.282080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:11.282080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:11.282080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:11.282080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:11.282080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:11.282080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:11.282080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:11.282080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 71/146] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:47:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:47:11.287759 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e64958-9786-41a7-b70f-eff8bd8fb220 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:11.404843 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e64958-9786-41a7-b70f-eff8bd8fb220 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:11.456125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055082d-f47f-4f7a-bbd7-070b3c1f9b91 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:11.459129 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458411a-2952-4d04-a8fb-5a336c7b0d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:11.459824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458411a-2952-4d04-a8fb-5a336c7b0d47 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:11.460102 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458411a-2952-4d04-a8fb-5a336c7b0d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:11.460374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458411a-2952-4d04-a8fb-5a336c7b0d47 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:11.461134 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458411a-2952-4d04-a8fb-5a336c7b0d47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:11.461437 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458411a-2952-4d04-a8fb-5a336c7b0d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:11.462862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458411a-2952-4d04-a8fb-5a336c7b0d47 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:11.482312 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 72/147] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:47:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:11.489260 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458411a-2952-4d04-a8fb-5a336c7b0d47 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:11.532805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0443956-1c87-4302-a308-91c1d1b3059f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:11.533417 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0443956-1c87-4302-a308-91c1d1b3059f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:11.533707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0443956-1c87-4302-a308-91c1d1b3059f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:11.534001 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0443956-1c87-4302-a308-91c1d1b3059f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:11.558239 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0443956-1c87-4302-a308-91c1d1b3059f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:11.568258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-a0443956-1c87-4302-a308-91c1d1b3059f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 18:47:11.568258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:11.568258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:11.568258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:11.568258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:11.568258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:11.568258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:11.568258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:11.568258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:11.568258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:11.568258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:11.568258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:11.568258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:11.568258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:11.568258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:11.568258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:11.569139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:11.569139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:11.569139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:11.569139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:11.569139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:11.569139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:11.569139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:11.569139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:11.569139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:11.569139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:11.569139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:11.569139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:11.569139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:11.569139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:11.569139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:11.569139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:11.569953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:11.569953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:11.569953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:11.569953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:11.569953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:11.569953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:11.569953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:11.569953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:11.569953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:11.569953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:11.569953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 18:47:11.569953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:11.572018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 76/148] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:11.577123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0443956-1c87-4302-a308-91c1d1b3059f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:11.584936 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:11.673662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:11.674767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458411a-2952-4d04-a8fb-5a336c7b0d47 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:11.723797 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0443956-1c87-4302-a308-91c1d1b3059f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:11.737206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec009b53-3322-4309-8946-b99159991fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:11.738144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec009b53-3322-4309-8946-b99159991fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:11.738424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec009b53-3322-4309-8946-b99159991fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:11.738696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec009b53-3322-4309-8946-b99159991fe4 None admin] PATH_INFO: `/v3/users/3356491ab76f4af58ad2cc7077ba8a43` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:11.739901 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec009b53-3322-4309-8946-b99159991fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=3356491ab76f4af58ad2cc7077ba8a43)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:11.741368 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec009b53-3322-4309-8946-b99159991fe4 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:11.743052 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 73/149] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:11 2022] GET /identity/v3/users/3356491ab76f4af58ad2cc7077ba8a43 => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:11.749037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec009b53-3322-4309-8946-b99159991fe4 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:11.766649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc1d66-8b2c-45b7-a5dd-084e2bf0aa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:11.767677 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc1d66-8b2c-45b7-a5dd-084e2bf0aa41 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:11.768198 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc1d66-8b2c-45b7-a5dd-084e2bf0aa41 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:11.768659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc1d66-8b2c-45b7-a5dd-084e2bf0aa41 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:11.769656 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc1d66-8b2c-45b7-a5dd-084e2bf0aa41 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:11.772328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc1d66-8b2c-45b7-a5dd-084e2bf0aa41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:11.774189 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc1d66-8b2c-45b7-a5dd-084e2bf0aa41 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:11.784136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 77/150] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:11.802498 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc1d66-8b2c-45b7-a5dd-084e2bf0aa41 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:11.934217 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec009b53-3322-4309-8946-b99159991fe4 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:11.966081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:11.984567 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc1d66-8b2c-45b7-a5dd-084e2bf0aa41 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:11.999407 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25817a8d-d4f6-4f34-b3cd-3bd72888b565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:12.000986 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25817a8d-d4f6-4f34-b3cd-3bd72888b565 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:12.001493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25817a8d-d4f6-4f34-b3cd-3bd72888b565 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:12.002059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25817a8d-d4f6-4f34-b3cd-3bd72888b565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:12.037225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:12.060954 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2181a-385b-474e-8b3e-971584f6058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:12.062250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2181a-385b-474e-8b3e-971584f6058e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:12.062978 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2181a-385b-474e-8b3e-971584f6058e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:12.064292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2181a-385b-474e-8b3e-971584f6058e None admin] PATH_INFO: `/v3/users/8a51931824f547bfb99216954193546d` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:12.069710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2181a-385b-474e-8b3e-971584f6058e None admin] RBAC: Authorizing `identity:get_user(user_id=8a51931824f547bfb99216954193546d)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:12.071478 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2181a-385b-474e-8b3e-971584f6058e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:12.073417 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 78/151] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:11 2022] GET /identity/v3/users/8a51931824f547bfb99216954193546d => generated 289 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:12.080165 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2181a-385b-474e-8b3e-971584f6058e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:12.136294 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25817a8d-d4f6-4f34-b3cd-3bd72888b565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:12.140434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25817a8d-d4f6-4f34-b3cd-3bd72888b565 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:12.281166 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2181a-385b-474e-8b3e-971584f6058e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:12.347172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 74/152] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:12.351876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e87239-14b7-478d-a2e0-073ede3e4d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:12.352998 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87239-14b7-478d-a2e0-073ede3e4d89 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:12.353483 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87239-14b7-478d-a2e0-073ede3e4d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:12.353992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87239-14b7-478d-a2e0-073ede3e4d89 None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:12.355359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25817a8d-d4f6-4f34-b3cd-3bd72888b565 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:12.359682 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e87239-14b7-478d-a2e0-073ede3e4d89 None admin] RBAC: Authorizing `identity:get_project(project_id=cb94aac4115444f781367f00674d4de8)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:12.361862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e87239-14b7-478d-a2e0-073ede3e4d89 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:12.368550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 79/153] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:12 2022] GET /identity/v3/projects/cb94aac4115444f781367f00674d4de8 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:12.376228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e87239-14b7-478d-a2e0-073ede3e4d89 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:12.397813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:12.473854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:12.507097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25817a8d-d4f6-4f34-b3cd-3bd72888b565 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:12.539835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e87239-14b7-478d-a2e0-073ede3e4d89 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:12.574548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38af85e-ea0f-4b4c-978d-8625422860ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:12.575850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38af85e-ea0f-4b4c-978d-8625422860ab None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:12.576439 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38af85e-ea0f-4b4c-978d-8625422860ab None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:12.576911 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38af85e-ea0f-4b4c-978d-8625422860ab None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:12.578508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38af85e-ea0f-4b4c-978d-8625422860ab None admin] RBAC: Authorizing `identity:get_project(project_id=cb94aac4115444f781367f00674d4de8)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:12.580274 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38af85e-ea0f-4b4c-978d-8625422860ab None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:12.582113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0407a-3ee2-4379-ad2d-a04708994a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:12.582710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 75/154] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:12 2022] GET /identity/v3/projects/cb94aac4115444f781367f00674d4de8 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:12.583489 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0407a-3ee2-4379-ad2d-a04708994a46 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:12.583765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0407a-3ee2-4379-ad2d-a04708994a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:12.584035 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0407a-3ee2-4379-ad2d-a04708994a46 None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8/users/8a51931824f547bfb99216954193546d/roles/83b821ffac7d4dbdb849c13f1dbd4ead` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:12.586257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0407a-3ee2-4379-ad2d-a04708994a46 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb94aac4115444f781367f00674d4de8, user_id=8a51931824f547bfb99216954193546d, role_id=83b821ffac7d4dbdb849c13f1dbd4ead)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:12.587722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0407a-3ee2-4379-ad2d-a04708994a46 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:12.588988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38af85e-ea0f-4b4c-978d-8625422860ab None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:12.617436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 80/155] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:47:12 2022] PUT /identity/v3/projects/cb94aac4115444f781367f00674d4de8/users/8a51931824f547bfb99216954193546d/roles/83b821ffac7d4dbdb849c13f1dbd4ead => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 18:47:12.711887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:12.736307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38af85e-ea0f-4b4c-978d-8625422860ab None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:12.774968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bd582-0828-4b4f-97d0-f2e15b0e360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:12.776015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bd582-0828-4b4f-97d0-f2e15b0e360c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:12.776489 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bd582-0828-4b4f-97d0-f2e15b0e360c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:12.776954 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bd582-0828-4b4f-97d0-f2e15b0e360c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:12.778041 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bd582-0828-4b4f-97d0-f2e15b0e360c None admin] RBAC: Adding query filter params (role.id=1ecbde8dcaa44047899f618334033d43, scope.project.id=cb94aac4115444f781367f00674d4de8, user.id=3356491ab76f4af58ad2cc7077ba8a43) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:12.778748 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bd582-0828-4b4f-97d0-f2e15b0e360c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:12.780678 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bd582-0828-4b4f-97d0-f2e15b0e360c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:12.787925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 76/156] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:47:12 2022] GET /identity/v3/role_assignments?user.id=3356491ab76f4af58ad2cc7077ba8a43&scope.project.id=cb94aac4115444f781367f00674d4de8&role.id=1ecbde8dcaa44047899f618334033d43 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:13.043818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abaa03-108f-42ca-957f-d2695e6a605f None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:13.044196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abaa03-108f-42ca-957f-d2695e6a605f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:13.044365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abaa03-108f-42ca-957f-d2695e6a605f None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:13.046291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 81/157] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:13.051780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10756d-96c5-4783-bd81-a53c5651dc7e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:13.052358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10756d-96c5-4783-bd81-a53c5651dc7e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:13.052828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10756d-96c5-4783-bd81-a53c5651dc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:13.078345 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2b10756d-96c5-4783-bd81-a53c5651dc7e None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:13.079906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2b10756d-96c5-4783-bd81-a53c5651dc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:13.166799 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a0c7f-92ee-489b-99f9-125de33cf496 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:13.167148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a0c7f-92ee-489b-99f9-125de33cf496 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:13.167350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a0c7f-92ee-489b-99f9-125de33cf496 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:13.168985 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 82/158] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:13.177231 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 77/159] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:13.180486 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33940aa5-cd38-44ec-bd45-846e811bedd3 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:13.180773 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33940aa5-cd38-44ec-bd45-846e811bedd3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:13.181045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33940aa5-cd38-44ec-bd45-846e811bedd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:13.207167 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10756d-96c5-4783-bd81-a53c5651dc7e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:13.211078 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-33940aa5-cd38-44ec-bd45-846e811bedd3 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:13.212535 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-33940aa5-cd38-44ec-bd45-846e811bedd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:13.337901 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:13.362574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10756d-96c5-4783-bd81-a53c5651dc7e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:13.373826 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 83/160] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:47:13.413549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f01d6-f0be-42de-81d9-724354606353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:13.414707 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f01d6-f0be-42de-81d9-724354606353 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:13.415176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f01d6-f0be-42de-81d9-724354606353 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:13.415651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f01d6-f0be-42de-81d9-724354606353 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:13.417709 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33940aa5-cd38-44ec-bd45-846e811bedd3 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:13.431810 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f01d6-f0be-42de-81d9-724354606353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:13.440021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-a00f01d6-f0be-42de-81d9-724354606353 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:13.440021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:13.440021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:13.440021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:13.440021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:13.440021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:13.440021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:13.440021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:13.440021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:13.440021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:13.440021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:13.440021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:13.440021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:13.440021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:13.440021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:13.440021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:13.440951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:13.440951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:13.440951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:13.440951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:13.440951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:13.440951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:13.440951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:13.440951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:13.440951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:13.440951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:13.440951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:13.440951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:13.440951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:13.440951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:13.440951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:13.440951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:13.441710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:13.441710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:13.441710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:13.441710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:13.441710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:13.441710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:13.441710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:13.441710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:13.441710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:13.441710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:13.441710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:13.441710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:13.443791 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 78/161] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:13.451142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f01d6-f0be-42de-81d9-724354606353 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:13.527900 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:13.592413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f01d6-f0be-42de-81d9-724354606353 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:13.623199 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33940aa5-cd38-44ec-bd45-846e811bedd3 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:13.629659 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d154d86-381d-4aac-926c-63317a154ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:13.630390 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d154d86-381d-4aac-926c-63317a154ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:13.630673 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d154d86-381d-4aac-926c-63317a154ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:13.630947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d154d86-381d-4aac-926c-63317a154ae0 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:13.631711 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d154d86-381d-4aac-926c-63317a154ae0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:13.632031 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d154d86-381d-4aac-926c-63317a154ae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:13.633432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d154d86-381d-4aac-926c-63317a154ae0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:13.642768 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 79/162] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:13.648111 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d154d86-381d-4aac-926c-63317a154ae0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:13.651032 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:13.690463 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788afd63-4f7f-49b1-bbd6-55380f318d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:13.691296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788afd63-4f7f-49b1-bbd6-55380f318d3d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:13.691577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788afd63-4f7f-49b1-bbd6-55380f318d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:13.691848 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788afd63-4f7f-49b1-bbd6-55380f318d3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:13.712703 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788afd63-4f7f-49b1-bbd6-55380f318d3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:13.721835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-788afd63-4f7f-49b1-bbd6-55380f318d3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:47:13.721835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:13.721835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:13.721835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:13.721835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:13.721835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:13.721835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:13.721835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:13.721835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:13.721835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:13.721835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:13.721835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:13.721835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:13.721835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:13.721835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:13.721835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:13.722761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:13.722761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:13.722761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:13.722761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:13.722761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:13.722761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:13.722761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:13.722761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:13.722761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:13.722761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:13.722761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:13.722761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:13.722761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:13.722761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:13.722761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:13.722761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:13.723520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:13.723520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:13.723520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:13.723520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:13.723520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:13.723520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:13.723520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:13.723520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:13.723520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:13.723520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:13.723520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:47:13.723520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:13.723520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 84/163] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:47:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:47:13.730766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788afd63-4f7f-49b1-bbd6-55380f318d3d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:13.759026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d154d86-381d-4aac-926c-63317a154ae0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:13.793270 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc5418-5e4a-4d10-90fc-232939b5cb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:13.794198 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc5418-5e4a-4d10-90fc-232939b5cb36 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:13.794482 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc5418-5e4a-4d10-90fc-232939b5cb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:13.794803 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc5418-5e4a-4d10-90fc-232939b5cb36 None admin] PATH_INFO: `/v3/users/3356491ab76f4af58ad2cc7077ba8a43` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:13.796159 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc5418-5e4a-4d10-90fc-232939b5cb36 None admin] RBAC: Authorizing `identity:get_user(user_id=3356491ab76f4af58ad2cc7077ba8a43)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:13.797631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc5418-5e4a-4d10-90fc-232939b5cb36 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:13.799487 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 80/164] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:13 2022] GET /identity/v3/users/3356491ab76f4af58ad2cc7077ba8a43 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:13.804786 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc5418-5e4a-4d10-90fc-232939b5cb36 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:13.876223 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:13.907958 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc5418-5e4a-4d10-90fc-232939b5cb36 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:13.942522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353431b7-bc29-43f9-b7a9-023a469472d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:13.943299 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353431b7-bc29-43f9-b7a9-023a469472d3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:13.943587 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353431b7-bc29-43f9-b7a9-023a469472d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:13.943860 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353431b7-bc29-43f9-b7a9-023a469472d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:14.014131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353431b7-bc29-43f9-b7a9-023a469472d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:14.015786 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353431b7-bc29-43f9-b7a9-023a469472d3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:14.023673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788afd63-4f7f-49b1-bbd6-55380f318d3d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:14.037915 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:14.083403 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa9d14-124f-489b-b8f9-5230dc6a8256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:14.084085 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa9d14-124f-489b-b8f9-5230dc6a8256 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:14.084451 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa9d14-124f-489b-b8f9-5230dc6a8256 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:14.084632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa9d14-124f-489b-b8f9-5230dc6a8256 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:14.085378 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa9d14-124f-489b-b8f9-5230dc6a8256 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:14.085678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa9d14-124f-489b-b8f9-5230dc6a8256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:14.087125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa9d14-124f-489b-b8f9-5230dc6a8256 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:14.096258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 85/165] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:14.101323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa9d14-124f-489b-b8f9-5230dc6a8256 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:14.118171 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:14.122607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 81/166] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 18:47:14.131491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353431b7-bc29-43f9-b7a9-023a469472d3 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:14.299050 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa9d14-124f-489b-b8f9-5230dc6a8256 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:14.353345 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c082200-965c-418d-8a0e-0aec1d822ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:14.354268 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c082200-965c-418d-8a0e-0aec1d822ffb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:14.354547 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c082200-965c-418d-8a0e-0aec1d822ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:14.354820 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c082200-965c-418d-8a0e-0aec1d822ffb None admin] PATH_INFO: `/v3/users/f2f2aaa398bb4bba874340ea4e3288dd` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:14.356012 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c082200-965c-418d-8a0e-0aec1d822ffb None admin] RBAC: Authorizing `identity:get_user(user_id=f2f2aaa398bb4bba874340ea4e3288dd)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:14.357599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c082200-965c-418d-8a0e-0aec1d822ffb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:14.359639 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 86/167] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:14 2022] GET /identity/v3/users/f2f2aaa398bb4bba874340ea4e3288dd => generated 247 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:14.360851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a90508-a42e-49e2-af0f-a3a8e010ff83 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:14.361130 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a90508-a42e-49e2-af0f-a3a8e010ff83 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:14.361400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a90508-a42e-49e2-af0f-a3a8e010ff83 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:14.370860 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 87/168] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:14 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:14.371675 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a90508-a42e-49e2-af0f-a3a8e010ff83 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:14.377928 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353431b7-bc29-43f9-b7a9-023a469472d3 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:14.429888 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:14.487049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accba06-4011-41a8-a3de-52556d3b70ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:14.487941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accba06-4011-41a8-a3de-52556d3b70ed None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:14.488221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accba06-4011-41a8-a3de-52556d3b70ed None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:14.488492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accba06-4011-41a8-a3de-52556d3b70ed None admin] PATH_INFO: `/v3/projects/ab299c26666049b2b09419a176ca48a6` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:14.489677 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accba06-4011-41a8-a3de-52556d3b70ed None admin] RBAC: Authorizing `identity:get_project(project_id=ab299c26666049b2b09419a176ca48a6)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:14.491168 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accba06-4011-41a8-a3de-52556d3b70ed None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:14.492872 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 82/169] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:14 2022] GET /identity/v3/projects/ab299c26666049b2b09419a176ca48a6 => generated 312 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:14.494041 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0c07b-b1c2-42c7-976c-df531b5c64d8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:14.494336 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0c07b-b1c2-42c7-976c-df531b5c64d8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:14.494589 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0c07b-b1c2-42c7-976c-df531b5c64d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:14.521000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a90508-a42e-49e2-af0f-a3a8e010ff83 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:14.521187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-76f0c07b-b1c2-42c7-976c-df531b5c64d8 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:14.521187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-76f0c07b-b1c2-42c7-976c-df531b5c64d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:14.581163 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d3cbe-c814-4b20-8f27-81047280ebd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:14.581850 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d3cbe-c814-4b20-8f27-81047280ebd7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:14.582131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d3cbe-c814-4b20-8f27-81047280ebd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:14.582406 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d3cbe-c814-4b20-8f27-81047280ebd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:14.614191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:14.672822 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 83/170] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:14.673691 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0c07b-b1c2-42c7-976c-df531b5c64d8 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:14.719783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d3cbe-c814-4b20-8f27-81047280ebd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:14.721243 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d3cbe-c814-4b20-8f27-81047280ebd7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:14.807842 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:14.815593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0c07b-b1c2-42c7-976c-df531b5c64d8 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:14.883669 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4c6f4-0ac9-419e-94cb-96e0e35a577d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:14.884342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4c6f4-0ac9-419e-94cb-96e0e35a577d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:14.884616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4c6f4-0ac9-419e-94cb-96e0e35a577d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:14.884879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4c6f4-0ac9-419e-94cb-96e0e35a577d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:14.885716 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4c6f4-0ac9-419e-94cb-96e0e35a577d None admin] RBAC: Adding query filter params (role.id=3e320079a5ce471e863ad87a36be46b1, scope.project.id=ab299c26666049b2b09419a176ca48a6, user.id=3356491ab76f4af58ad2cc7077ba8a43) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:14.886044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4c6f4-0ac9-419e-94cb-96e0e35a577d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:14.887496 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4c6f4-0ac9-419e-94cb-96e0e35a577d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:14.902109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 84/171] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:47:14 2022] GET /identity/v3/role_assignments?user.id=3356491ab76f4af58ad2cc7077ba8a43&scope.project.id=ab299c26666049b2b09419a176ca48a6&role.id=3e320079a5ce471e863ad87a36be46b1 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:14.902953 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4c6f4-0ac9-419e-94cb-96e0e35a577d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:14.949121 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 88/172] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:14.963470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:14.965124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d3cbe-c814-4b20-8f27-81047280ebd7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:15.109417 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4c6f4-0ac9-419e-94cb-96e0e35a577d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:15.158902 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d3cbe-c814-4b20-8f27-81047280ebd7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:15.163868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b661b-078f-45a7-a94e-8d53be3d8fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:15.164710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b661b-078f-45a7-a94e-8d53be3d8fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:15.164979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b661b-078f-45a7-a94e-8d53be3d8fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:15.165250 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b661b-078f-45a7-a94e-8d53be3d8fb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:15.181841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b661b-078f-45a7-a94e-8d53be3d8fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:15.193874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-370b661b-078f-45a7-a94e-8d53be3d8fb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:15.193874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:15.193874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:15.193874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:15.193874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:15.193874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:15.193874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:15.193874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:15.193874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:15.193874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:15.193874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:15.193874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:15.193874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:15.193874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:15.193874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:15.193874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:15.194905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:15.194905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:15.194905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:15.194905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:15.194905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:15.194905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:15.194905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:15.194905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:15.194905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:15.194905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:15.194905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:15.194905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:15.194905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:15.194905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:15.194905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:15.194905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:15.196107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:15.196107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:15.196107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:15.196107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:15.196107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:15.196107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:15.196107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:15.196107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:15.196107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:15.196107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:15.196107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:15.196107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:15.196107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 85/173] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:15.201450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b661b-078f-45a7-a94e-8d53be3d8fb3 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:15.214714 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34804b-5317-46e8-a96c-b545212fb755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:15.215627 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34804b-5317-46e8-a96c-b545212fb755 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:15.215897 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34804b-5317-46e8-a96c-b545212fb755 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:15.217503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34804b-5317-46e8-a96c-b545212fb755 None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:15.222895 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34804b-5317-46e8-a96c-b545212fb755 None admin] RBAC: Authorizing `identity:get_project(project_id=cb94aac4115444f781367f00674d4de8)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:15.224406 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34804b-5317-46e8-a96c-b545212fb755 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:15.226654 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 89/174] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:14 2022] GET /identity/v3/projects/cb94aac4115444f781367f00674d4de8 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:15.248187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34804b-5317-46e8-a96c-b545212fb755 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:15.266199 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:15.398818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:15.414068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34804b-5317-46e8-a96c-b545212fb755 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:15.419961 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b661b-078f-45a7-a94e-8d53be3d8fb3 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:15.471448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1008b9-4c71-41c7-aa58-945c39ed5b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:15.472118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1008b9-4c71-41c7-aa58-945c39ed5b64 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:15.472390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1008b9-4c71-41c7-aa58-945c39ed5b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:15.472658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1008b9-4c71-41c7-aa58-945c39ed5b64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:15.473502 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1008b9-4c71-41c7-aa58-945c39ed5b64 None admin] RBAC: Adding query filter params (role.id=8560bac1acf74dce81ea6a76f751b641, scope.project.id=cb94aac4115444f781367f00674d4de8, user.id=f2f2aaa398bb4bba874340ea4e3288dd) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:15.473821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1008b9-4c71-41c7-aa58-945c39ed5b64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:15.475283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1008b9-4c71-41c7-aa58-945c39ed5b64 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:15.481713 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 90/175] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:47:15 2022] GET /identity/v3/role_assignments?user.id=f2f2aaa398bb4bba874340ea4e3288dd&scope.project.id=cb94aac4115444f781367f00674d4de8&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:15.491041 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e43666-64af-46e2-acc4-c852a2661825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:15.491769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e43666-64af-46e2-acc4-c852a2661825 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:15.492050 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e43666-64af-46e2-acc4-c852a2661825 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:15.492328 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e43666-64af-46e2-acc4-c852a2661825 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:15.493082 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e43666-64af-46e2-acc4-c852a2661825 None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:15.493384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e43666-64af-46e2-acc4-c852a2661825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:15.499082 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e43666-64af-46e2-acc4-c852a2661825 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:15.516294 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 86/176] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:15.522010 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1008b9-4c71-41c7-aa58-945c39ed5b64 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:15.624908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:15.674629 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87146510-cf65-40b2-b5c2-50c452db7983 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:15.674801 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87146510-cf65-40b2-b5c2-50c452db7983 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:15.675078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87146510-cf65-40b2-b5c2-50c452db7983 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:15.676726 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 87/177] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:47:15.677102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1008b9-4c71-41c7-aa58-945c39ed5b64 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:15.683083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19499f48-f245-4499-9dc6-73911144fcb8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:15.683384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19499f48-f245-4499-9dc6-73911144fcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:15.683624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19499f48-f245-4499-9dc6-73911144fcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:15.711962 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-19499f48-f245-4499-9dc6-73911144fcb8 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:15.713265 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-19499f48-f245-4499-9dc6-73911144fcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:15.749951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9abda7-80ad-4dd1-b86f-be9763f09729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:15.751111 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9abda7-80ad-4dd1-b86f-be9763f09729 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:15.751388 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9abda7-80ad-4dd1-b86f-be9763f09729 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:15.751656 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9abda7-80ad-4dd1-b86f-be9763f09729 None admin] PATH_INFO: `/v3/users/3356491ab76f4af58ad2cc7077ba8a43` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:15.754595 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9abda7-80ad-4dd1-b86f-be9763f09729 None admin] RBAC: Authorizing `identity:get_user(user_id=3356491ab76f4af58ad2cc7077ba8a43)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:15.756015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9abda7-80ad-4dd1-b86f-be9763f09729 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:15.758899 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 91/178] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:15 2022] GET /identity/v3/users/3356491ab76f4af58ad2cc7077ba8a43 => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:15.776877 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9abda7-80ad-4dd1-b86f-be9763f09729 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:15.865273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 88/179] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:15.866776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bfd80-72ef-4f22-a21a-20324f3983f7 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:15.867062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bfd80-72ef-4f22-a21a-20324f3983f7 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:15.867335 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bfd80-72ef-4f22-a21a-20324f3983f7 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:15.868845 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 89/180] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:15.875188 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca26d6-6409-41ac-b0a1-d9c74184fcfb None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:15.875516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca26d6-6409-41ac-b0a1-d9c74184fcfb None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:15.875735 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca26d6-6409-41ac-b0a1-d9c74184fcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:15.893715 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-87ca26d6-6409-41ac-b0a1-d9c74184fcfb None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:15.894938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-87ca26d6-6409-41ac-b0a1-d9c74184fcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:15.916873 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9abda7-80ad-4dd1-b86f-be9763f09729 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:15.955857 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959c17d-e388-4088-8849-cd33f259fd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:15.956468 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959c17d-e388-4088-8849-cd33f259fd51 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:15.956755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959c17d-e388-4088-8849-cd33f259fd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:15.957134 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959c17d-e388-4088-8849-cd33f259fd51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:15.968127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:15.978529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 90/181] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:47:15.979581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca26d6-6409-41ac-b0a1-d9c74184fcfb None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:15.995066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:16.063924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959c17d-e388-4088-8849-cd33f259fd51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:16.066421 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959c17d-e388-4088-8849-cd33f259fd51 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:16.087096 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca26d6-6409-41ac-b0a1-d9c74184fcfb None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:16.121775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff969b6f-14f5-4a16-babb-728341a3c440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:16.122633 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff969b6f-14f5-4a16-babb-728341a3c440 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:16.122972 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff969b6f-14f5-4a16-babb-728341a3c440 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:16.123248 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff969b6f-14f5-4a16-babb-728341a3c440 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:16.134186 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff969b6f-14f5-4a16-babb-728341a3c440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:16.142499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-ff969b6f-14f5-4a16-babb-728341a3c440 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:47:16.142499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:16.142499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:16.142499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:16.142499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:16.142499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:16.142499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:16.142499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:16.142499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:16.142499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:16.142499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:16.142499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:16.142499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:16.142499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:16.142499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:16.142499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:16.143392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:16.143392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:16.143392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:16.143392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:16.143392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:16.143392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:16.143392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:16.143392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:16.143392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:16.143392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:16.143392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:16.143392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:16.143392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:16.143392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:16.143392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:16.143392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:16.144174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:16.144174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:16.144174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:16.144174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:16.144174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:16.144174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:16.144174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:16.144174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:16.144174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:16.144174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:16.144174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:47:16.144174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:16.144174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 91/182] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:47:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:16.144811 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff969b6f-14f5-4a16-babb-728341a3c440 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:16.195344 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 92/183] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:16.196223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959c17d-e388-4088-8849-cd33f259fd51 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:16.242154 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:16.258197 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:16.277521 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff969b6f-14f5-4a16-babb-728341a3c440 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:16.305857 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959c17d-e388-4088-8849-cd33f259fd51 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:16.312345 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24242e-bee2-44bb-b8a2-f373b3c39d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:16.313423 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24242e-bee2-44bb-b8a2-f373b3c39d9f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:16.313703 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24242e-bee2-44bb-b8a2-f373b3c39d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:16.313999 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24242e-bee2-44bb-b8a2-f373b3c39d9f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:16.324371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24242e-bee2-44bb-b8a2-f373b3c39d9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:16.333384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-7f24242e-bee2-44bb-b8a2-f373b3c39d9f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:16.333384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:16.333384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:16.333384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:16.333384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:16.333384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:16.333384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:16.333384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:16.333384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:16.333384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:16.333384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:16.333384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:16.333384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:16.333384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:16.333384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:16.333384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:16.334450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:16.334450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:16.334450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:16.334450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:16.334450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:16.334450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:16.334450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:16.334450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:16.334450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:16.334450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:16.334450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:16.334450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:16.334450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:16.334450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:16.334450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:16.334450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:16.335280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:16.335280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:16.335280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:16.335280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:16.335280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:16.335280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:16.335280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:16.335280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:16.335280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:16.335280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:16.335280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:16.335280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:16.335280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 92/184] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:47:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:16.335935 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24242e-bee2-44bb-b8a2-f373b3c39d9f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:16.348311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fe165-5d29-4bca-b66c-a07401bbbb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:16.349270 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fe165-5d29-4bca-b66c-a07401bbbb70 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:16.349554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fe165-5d29-4bca-b66c-a07401bbbb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:16.349866 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fe165-5d29-4bca-b66c-a07401bbbb70 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:16.350634 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fe165-5d29-4bca-b66c-a07401bbbb70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:16.350920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fe165-5d29-4bca-b66c-a07401bbbb70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:16.352326 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fe165-5d29-4bca-b66c-a07401bbbb70 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:16.361318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 93/185] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:16.362502 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ec0e4-f61c-4a9e-b494-4a95723d81eb None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:16.362789 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ec0e4-f61c-4a9e-b494-4a95723d81eb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:16.363064 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ec0e4-f61c-4a9e-b494-4a95723d81eb None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:16.365848 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 94/186] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:16.365848 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ec0e4-f61c-4a9e-b494-4a95723d81eb None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:16.450699 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24242e-bee2-44bb-b8a2-f373b3c39d9f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:16.485216 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452c63a-aaed-445e-8109-e7a2c88c45c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:16.486159 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452c63a-aaed-445e-8109-e7a2c88c45c4 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:16.486448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452c63a-aaed-445e-8109-e7a2c88c45c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:16.486725 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452c63a-aaed-445e-8109-e7a2c88c45c4 None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:16.487941 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:16.488374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452c63a-aaed-445e-8109-e7a2c88c45c4 None admin] RBAC: Authorizing `identity:get_project(project_id=cb94aac4115444f781367f00674d4de8)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:16.489418 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452c63a-aaed-445e-8109-e7a2c88c45c4 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:16.491558 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 93/187] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:16 2022] GET /identity/v3/projects/cb94aac4115444f781367f00674d4de8 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:16.492399 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452c63a-aaed-445e-8109-e7a2c88c45c4 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:16.494981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:16.498289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ec0e4-f61c-4a9e-b494-4a95723d81eb None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:16.539449 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007512cb-e049-4b93-be5a-48961e699a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:16.540136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007512cb-e049-4b93-be5a-48961e699a33 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:16.540417 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007512cb-e049-4b93-be5a-48961e699a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:16.540699 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007512cb-e049-4b93-be5a-48961e699a33 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:16.541460 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007512cb-e049-4b93-be5a-48961e699a33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:16.541768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007512cb-e049-4b93-be5a-48961e699a33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:16.543188 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007512cb-e049-4b93-be5a-48961e699a33 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:16.551577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 95/188] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:47:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:16.552769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96a571-e721-4a19-8aaf-98994c778061 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:16.553055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96a571-e721-4a19-8aaf-98994c778061 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:16.553332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96a571-e721-4a19-8aaf-98994c778061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:16.569060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-1d96a571-e721-4a19-8aaf-98994c778061 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:16.570283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1d96a571-e721-4a19-8aaf-98994c778061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:16.607176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452c63a-aaed-445e-8109-e7a2c88c45c4 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:16.641615 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67876ffb-2c43-4eed-8355-2956231ff8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:16.642531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67876ffb-2c43-4eed-8355-2956231ff8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:16.642815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67876ffb-2c43-4eed-8355-2956231ff8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:16.643089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67876ffb-2c43-4eed-8355-2956231ff8b9 None admin] PATH_INFO: `/v3/users/f5d201d3eaad49eead830d1b078bcfb4` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:16.644048 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 96/189] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:16.658027 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96a571-e721-4a19-8aaf-98994c778061 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:16.658151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67876ffb-2c43-4eed-8355-2956231ff8b9 None admin] RBAC: Authorizing `identity:get_user(user_id=f5d201d3eaad49eead830d1b078bcfb4)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:16.658151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67876ffb-2c43-4eed-8355-2956231ff8b9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:16.664084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 94/190] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:16 2022] GET /identity/v3/users/f5d201d3eaad49eead830d1b078bcfb4 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:16.664084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceb56b-8cc3-4723-afa7-8790d52e1e76 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:16.664084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceb56b-8cc3-4723-afa7-8790d52e1e76 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:16.664084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceb56b-8cc3-4723-afa7-8790d52e1e76 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:16.664084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 95/191] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:16.664084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceb56b-8cc3-4723-afa7-8790d52e1e76 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:16.722901 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:16.757268 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:16.766689 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96a571-e721-4a19-8aaf-98994c778061 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:16.766829 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceb56b-8cc3-4723-afa7-8790d52e1e76 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:16.799609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752e922-4f80-4a9e-82f6-423d8f94b79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:16.800495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752e922-4f80-4a9e-82f6-423d8f94b79e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:16.800776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752e922-4f80-4a9e-82f6-423d8f94b79e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:16.801051 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752e922-4f80-4a9e-82f6-423d8f94b79e None admin] PATH_INFO: `/v3/users/f5d201d3eaad49eead830d1b078bcfb4` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:16.802073 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664f698-cd94-496f-946a-3b88f15f4b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:16.802247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752e922-4f80-4a9e-82f6-423d8f94b79e None admin] RBAC: Authorizing `identity:get_user(user_id=f5d201d3eaad49eead830d1b078bcfb4)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:16.802729 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664f698-cd94-496f-946a-3b88f15f4b12 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:16.803005 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664f698-cd94-496f-946a-3b88f15f4b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:16.803275 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664f698-cd94-496f-946a-3b88f15f4b12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:16.803702 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752e922-4f80-4a9e-82f6-423d8f94b79e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:16.804097 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664f698-cd94-496f-946a-3b88f15f4b12 None admin] RBAC: Adding query filter params (role.id=3e320079a5ce471e863ad87a36be46b1, scope.project.id=cb94aac4115444f781367f00674d4de8, user.id=3356491ab76f4af58ad2cc7077ba8a43) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:16.804406 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664f698-cd94-496f-946a-3b88f15f4b12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:16.805351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 96/192] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:16 2022] GET /identity/v3/users/f5d201d3eaad49eead830d1b078bcfb4 => generated 283 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:16.805848 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664f698-cd94-496f-946a-3b88f15f4b12 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:16.806138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752e922-4f80-4a9e-82f6-423d8f94b79e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:16.814884 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 97/193] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:47:16 2022] GET /identity/v3/role_assignments?user.id=3356491ab76f4af58ad2cc7077ba8a43&scope.project.id=cb94aac4115444f781367f00674d4de8&role.id=3e320079a5ce471e863ad87a36be46b1 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:16.815862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664f698-cd94-496f-946a-3b88f15f4b12 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:16.918516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752e922-4f80-4a9e-82f6-423d8f94b79e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:16.930253 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664f698-cd94-496f-946a-3b88f15f4b12 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:16.948423 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:16.958872 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db7a98-6448-43ba-b3b5-1f582f4d38cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:16.959537 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db7a98-6448-43ba-b3b5-1f582f4d38cd None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:16.959821 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db7a98-6448-43ba-b3b5-1f582f4d38cd None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:16.960099 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db7a98-6448-43ba-b3b5-1f582f4d38cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:16.971458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66747f18-0d72-44fc-a46e-edf18c772e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:16.972669 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66747f18-0d72-44fc-a46e-edf18c772e67 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:16.973126 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66747f18-0d72-44fc-a46e-edf18c772e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:16.973582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66747f18-0d72-44fc-a46e-edf18c772e67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:16.974894 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66747f18-0d72-44fc-a46e-edf18c772e67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:16.976375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66747f18-0d72-44fc-a46e-edf18c772e67 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:16.978292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 98/194] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:47:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:16.979323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f61b0-1579-4916-a229-fd64950b1283 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:16.979607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f61b0-1579-4916-a229-fd64950b1283 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:16.979880 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f61b0-1579-4916-a229-fd64950b1283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:16.997188 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a73f61b0-1579-4916-a229-fd64950b1283 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:16.998649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a73f61b0-1579-4916-a229-fd64950b1283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:17.019025 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:17.044271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db7a98-6448-43ba-b3b5-1f582f4d38cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:17.046927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db7a98-6448-43ba-b3b5-1f582f4d38cd None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:17.082135 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 99/195] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:17.083414 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f61b0-1579-4916-a229-fd64950b1283 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:17.163291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 97/196] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:17.164188 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db7a98-6448-43ba-b3b5-1f582f4d38cd None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:17.189439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f61b0-1579-4916-a229-fd64950b1283 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:17.190644 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:17.223800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d3ce5-7ce6-49c9-8d0b-cf14f6b2d69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:17.224564 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3ce5-7ce6-49c9-8d0b-cf14f6b2d69e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:17.224842 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3ce5-7ce6-49c9-8d0b-cf14f6b2d69e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:17.225115 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3ce5-7ce6-49c9-8d0b-cf14f6b2d69e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:17.248629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:17.261289 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db7a98-6448-43ba-b3b5-1f582f4d38cd None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:17.292514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d3ce5-7ce6-49c9-8d0b-cf14f6b2d69e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:17.293977 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d3ce5-7ce6-49c9-8d0b-cf14f6b2d69e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:17.296476 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914688d-025e-42d1-a44e-4273904a61cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:17.297155 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914688d-025e-42d1-a44e-4273904a61cb None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:17.297428 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914688d-025e-42d1-a44e-4273904a61cb None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:17.297694 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914688d-025e-42d1-a44e-4273904a61cb None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:17.298435 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914688d-025e-42d1-a44e-4273904a61cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:17.299866 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914688d-025e-42d1-a44e-4273904a61cb None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:17.320725 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 98/197] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 2 18:47:17 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:47:17.321789 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914688d-025e-42d1-a44e-4273904a61cb None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:17.406115 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 100/198] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:17.406879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d3ce5-7ce6-49c9-8d0b-cf14f6b2d69e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:17.428338 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:17.448385 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914688d-025e-42d1-a44e-4273904a61cb None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:17.473734 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:17.487385 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a62d5-67f6-438b-a5d3-db47beb295e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:17.488215 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a62d5-67f6-438b-a5d3-db47beb295e0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:17.488491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a62d5-67f6-438b-a5d3-db47beb295e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:17.488761 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a62d5-67f6-438b-a5d3-db47beb295e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:17.500410 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a62d5-67f6-438b-a5d3-db47beb295e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:17.508291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-8e8a62d5-67f6-438b-a5d3-db47beb295e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 18:47:17.508291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:17.508291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:17.508291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:17.508291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:17.508291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:17.508291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:17.508291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:17.508291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:17.508291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:17.508291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:17.508291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:17.508291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:17.508291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:17.508291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:17.508291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:17.509272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:17.509272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:17.509272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:17.509272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:17.509272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:17.509272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:17.509272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:17.509272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:17.509272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:17.509272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:17.509272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:17.509272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:17.509272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:17.509272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:17.509272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:17.509272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:17.510100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:17.510100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:17.510100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:17.510100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:17.510100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:17.510100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:17.510100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:17.510100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:17.510100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:17.510100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:17.510100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 18:47:17.510100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:17.510100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 99/199] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:17.511030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a62d5-67f6-438b-a5d3-db47beb295e0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:17.533576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d3ce5-7ce6-49c9-8d0b-cf14f6b2d69e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:17.570507 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d2a7d-71e9-4d18-8168-b2eb94ecd80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:17.571374 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d2a7d-71e9-4d18-8168-b2eb94ecd80b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:17.571571 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d2a7d-71e9-4d18-8168-b2eb94ecd80b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:17.571843 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d2a7d-71e9-4d18-8168-b2eb94ecd80b None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:17.573017 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d2a7d-71e9-4d18-8168-b2eb94ecd80b None admin] RBAC: Authorizing `identity:get_project(project_id=32a6d4fba36a446bb95799ce1b96d071)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:17.574530 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d2a7d-71e9-4d18-8168-b2eb94ecd80b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:17.581992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 101/200] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:17 2022] GET /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:17.581992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d2a7d-71e9-4d18-8168-b2eb94ecd80b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:17.640902 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a62d5-67f6-438b-a5d3-db47beb295e0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:17.681743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb49b7d-38c9-4721-929b-a19c0589abb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:17.682646 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb49b7d-38c9-4721-929b-a19c0589abb2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:17.682927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb49b7d-38c9-4721-929b-a19c0589abb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:17.683200 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb49b7d-38c9-4721-929b-a19c0589abb2 None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:17.684483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb49b7d-38c9-4721-929b-a19c0589abb2 None admin] RBAC: Authorizing `identity:get_project(project_id=32a6d4fba36a446bb95799ce1b96d071)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:17.686083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb49b7d-38c9-4721-929b-a19c0589abb2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:17.688265 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 100/201] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:17 2022] GET /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:17.688879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb49b7d-38c9-4721-929b-a19c0589abb2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:17.698413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d2a7d-71e9-4d18-8168-b2eb94ecd80b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:17.708460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:17.726224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:17.741361 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b9e92-1bac-4e58-a78d-7aea3f7525e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:17.742355 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b9e92-1bac-4e58-a78d-7aea3f7525e8 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:17.742778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b9e92-1bac-4e58-a78d-7aea3f7525e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:17.743342 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b9e92-1bac-4e58-a78d-7aea3f7525e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:17.744324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b9e92-1bac-4e58-a78d-7aea3f7525e8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:17.744828 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b9e92-1bac-4e58-a78d-7aea3f7525e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:17.746562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b9e92-1bac-4e58-a78d-7aea3f7525e8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:17.756621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 102/202] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:17.757750 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b9e92-1bac-4e58-a78d-7aea3f7525e8 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:17.801682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb49b7d-38c9-4721-929b-a19c0589abb2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:17.835734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abee865-5c10-4cfa-8390-b27a08bb75a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:17.836323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abee865-5c10-4cfa-8390-b27a08bb75a7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:17.836599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abee865-5c10-4cfa-8390-b27a08bb75a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:17.836872 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abee865-5c10-4cfa-8390-b27a08bb75a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:17.838111 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abee865-5c10-4cfa-8390-b27a08bb75a7 None admin] RBAC: Adding query filter params (role.id=8560bac1acf74dce81ea6a76f751b641, scope.project.id=32a6d4fba36a446bb95799ce1b96d071, user.id=f5d201d3eaad49eead830d1b078bcfb4) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:17.838111 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abee865-5c10-4cfa-8390-b27a08bb75a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:17.839476 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abee865-5c10-4cfa-8390-b27a08bb75a7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:17.845524 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 101/203] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:47:17 2022] GET /identity/v3/role_assignments?user.id=f5d201d3eaad49eead830d1b078bcfb4&scope.project.id=32a6d4fba36a446bb95799ce1b96d071&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:17.853193 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abee865-5c10-4cfa-8390-b27a08bb75a7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:17.896332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b9e92-1bac-4e58-a78d-7aea3f7525e8 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:17.928146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:17.953612 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abee865-5c10-4cfa-8390-b27a08bb75a7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:17.995706 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f984b9-7f0d-4142-9888-d84a4391613c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:17.996396 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f984b9-7f0d-4142-9888-d84a4391613c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:17.996674 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f984b9-7f0d-4142-9888-d84a4391613c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:17.996943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f984b9-7f0d-4142-9888-d84a4391613c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:17.997899 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f984b9-7f0d-4142-9888-d84a4391613c None admin] RBAC: Adding query filter params (role.id=1ecbde8dcaa44047899f618334033d43, scope.project.id=32a6d4fba36a446bb95799ce1b96d071, user.id=f5d201d3eaad49eead830d1b078bcfb4) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:17.998231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f984b9-7f0d-4142-9888-d84a4391613c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:18.000044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f984b9-7f0d-4142-9888-d84a4391613c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:18.007171 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 103/204] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:47:17 2022] GET /identity/v3/role_assignments?user.id=f5d201d3eaad49eead830d1b078bcfb4&scope.project.id=32a6d4fba36a446bb95799ce1b96d071&role.id=1ecbde8dcaa44047899f618334033d43 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:18.032209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda405bb-98fb-4a7f-afb9-6fad35cb800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:18.033141 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda405bb-98fb-4a7f-afb9-6fad35cb800d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:18.033416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda405bb-98fb-4a7f-afb9-6fad35cb800d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:18.033687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda405bb-98fb-4a7f-afb9-6fad35cb800d None admin] PATH_INFO: `/v3/users/8a51931824f547bfb99216954193546d` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:18.038911 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda405bb-98fb-4a7f-afb9-6fad35cb800d None admin] RBAC: Authorizing `identity:get_user(user_id=8a51931824f547bfb99216954193546d)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:18.040506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda405bb-98fb-4a7f-afb9-6fad35cb800d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:18.042759 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 102/205] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:17 2022] GET /identity/v3/users/8a51931824f547bfb99216954193546d => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:18.048680 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f984b9-7f0d-4142-9888-d84a4391613c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:18.133962 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:18.196782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f984b9-7f0d-4142-9888-d84a4391613c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:18.246250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe0c34-9c27-4445-a5cc-153653bb9a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:18.246971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe0c34-9c27-4445-a5cc-153653bb9a19 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:18.247255 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe0c34-9c27-4445-a5cc-153653bb9a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:18.247531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe0c34-9c27-4445-a5cc-153653bb9a19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:18.319110 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe0c34-9c27-4445-a5cc-153653bb9a19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:18.320589 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe0c34-9c27-4445-a5cc-153653bb9a19 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:18.369540 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:18.423815 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 104/206] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:18.429444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda405bb-98fb-4a7f-afb9-6fad35cb800d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:18.572328 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda405bb-98fb-4a7f-afb9-6fad35cb800d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:18.613681 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6147b7-92c8-4b1e-92ac-b327613e4739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:18.614589 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6147b7-92c8-4b1e-92ac-b327613e4739 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:18.614865 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6147b7-92c8-4b1e-92ac-b327613e4739 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:18.615134 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6147b7-92c8-4b1e-92ac-b327613e4739 None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:18.616319 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6147b7-92c8-4b1e-92ac-b327613e4739 None admin] RBAC: Authorizing `identity:get_project(project_id=cb94aac4115444f781367f00674d4de8)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:18.617808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6147b7-92c8-4b1e-92ac-b327613e4739 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:18.619504 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 103/207] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:18 2022] GET /identity/v3/projects/cb94aac4115444f781367f00674d4de8 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:18.625720 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe0c34-9c27-4445-a5cc-153653bb9a19 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:18.771683 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe0c34-9c27-4445-a5cc-153653bb9a19 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:18.823404 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea7941-9bc8-4d8b-b16d-439e74c4f02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:18.824552 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea7941-9bc8-4d8b-b16d-439e74c4f02f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:18.825007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea7941-9bc8-4d8b-b16d-439e74c4f02f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:18.825451 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea7941-9bc8-4d8b-b16d-439e74c4f02f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:18.826576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea7941-9bc8-4d8b-b16d-439e74c4f02f None admin] RBAC: Adding query filter params (role.id=83b821ffac7d4dbdb849c13f1dbd4ead, scope.project.id=cb94aac4115444f781367f00674d4de8, user.id=8a51931824f547bfb99216954193546d) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:18.827081 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea7941-9bc8-4d8b-b16d-439e74c4f02f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:18.828802 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea7941-9bc8-4d8b-b16d-439e74c4f02f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:18.838848 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 105/208] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:47:18 2022] GET /identity/v3/role_assignments?user.id=8a51931824f547bfb99216954193546d&scope.project.id=cb94aac4115444f781367f00674d4de8&role.id=83b821ffac7d4dbdb849c13f1dbd4ead => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:20.058756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987adad-24bb-4f04-a1c2-12cac908914c None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:20.059283 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987adad-24bb-4f04-a1c2-12cac908914c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:20.059283 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987adad-24bb-4f04-a1c2-12cac908914c None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:20.060973 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 104/209] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:20.066347 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277ebb5-ea8b-47e1-82a6-0ba9e424e337 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:20.066789 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277ebb5-ea8b-47e1-82a6-0ba9e424e337 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:20.066965 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277ebb5-ea8b-47e1-82a6-0ba9e424e337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:20.085586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f277ebb5-ea8b-47e1-82a6-0ba9e424e337 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:20.086818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f277ebb5-ea8b-47e1-82a6-0ba9e424e337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:20.095093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:20.116861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80ae06-3c0b-47ae-8ebf-3228ac86dd76 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:20.117182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80ae06-3c0b-47ae-8ebf-3228ac86dd76 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:20.117427 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80ae06-3c0b-47ae-8ebf-3228ac86dd76 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:20.122902 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 105/210] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:20.125346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65ade0-e051-4c18-94e7-4f0d0693c6f6 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:20.125637 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65ade0-e051-4c18-94e7-4f0d0693c6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:20.126401 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65ade0-e051-4c18-94e7-4f0d0693c6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:20.153042 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-9a65ade0-e051-4c18-94e7-4f0d0693c6f6 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:20.154866 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9a65ade0-e051-4c18-94e7-4f0d0693c6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:20.165869 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:20.168576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 106/211] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:20.192310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277ebb5-ea8b-47e1-82a6-0ba9e424e337 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:20.242852 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 106/212] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:47:20.267190 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65ade0-e051-4c18-94e7-4f0d0693c6f6 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:20.306216 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277ebb5-ea8b-47e1-82a6-0ba9e424e337 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:20.343777 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208c4c0-5bdd-4158-ae1a-5415b8db96b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:20.344508 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208c4c0-5bdd-4158-ae1a-5415b8db96b7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:20.344788 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208c4c0-5bdd-4158-ae1a-5415b8db96b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:20.345063 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208c4c0-5bdd-4158-ae1a-5415b8db96b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:20.346389 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4208c4c0-5bdd-4158-ae1a-5415b8db96b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:20.347965 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4208c4c0-5bdd-4158-ae1a-5415b8db96b7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:20.349904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 107/213] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:47:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:20.355181 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208c4c0-5bdd-4158-ae1a-5415b8db96b7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:20.368984 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:20.389198 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65ade0-e051-4c18-94e7-4f0d0693c6f6 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:20.433066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c6fad-5392-44c1-b224-1accde3cd58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:20.433942 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c6fad-5392-44c1-b224-1accde3cd58b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:20.434262 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c6fad-5392-44c1-b224-1accde3cd58b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:20.434547 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c6fad-5392-44c1-b224-1accde3cd58b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:20.448170 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c6fad-5392-44c1-b224-1accde3cd58b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:20.459512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-db6c6fad-5392-44c1-b224-1accde3cd58b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:20.459512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:20.459512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:20.459512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:20.459512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:20.459512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:20.459512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:20.459512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:20.459512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:20.459512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:20.459512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:20.459512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:20.459512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:20.459512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:20.459512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:20.459512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:20.460430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:20.460430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:20.460430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:20.460430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:20.460430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:20.460430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:20.460430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:20.460430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:20.460430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:20.460430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:20.460430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:20.460430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:20.460430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:20.460430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:20.460430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:20.460430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:20.461348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:20.461348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:20.461348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:20.461348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:20.461348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:20.461348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:20.461348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:20.461348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:20.461348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:20.461348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:20.461348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:20.461348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:20.461348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 107/214] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:47:20.463107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c6b6f-7bd3-407b-9dcf-d2bebbc4dbe9 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:20.463391 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c6b6f-7bd3-407b-9dcf-d2bebbc4dbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:20.463662 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c6b6f-7bd3-407b-9dcf-d2bebbc4dbe9 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:20.465111 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 108/215] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:20.469618 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208c4c0-5bdd-4158-ae1a-5415b8db96b7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:20.469852 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c6b6f-7bd3-407b-9dcf-d2bebbc4dbe9 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:20.472629 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:20.505653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70679988-b7b4-4a88-97a3-cec34c801950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:20.506381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70679988-b7b4-4a88-97a3-cec34c801950 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:20.506659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70679988-b7b4-4a88-97a3-cec34c801950 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:20.506930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70679988-b7b4-4a88-97a3-cec34c801950 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:20.507645 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70679988-b7b4-4a88-97a3-cec34c801950 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:20.509208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70679988-b7b4-4a88-97a3-cec34c801950 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:20.554039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 108/216] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 2 18:47:20 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:47:20.555753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7cd99-6447-4222-a808-a72cc4c58bb8 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:20.556109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7cd99-6447-4222-a808-a72cc4c58bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:20.556456 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7cd99-6447-4222-a808-a72cc4c58bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:20.584743 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5db7cd99-6447-4222-a808-a72cc4c58bb8 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:20.586332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5db7cd99-6447-4222-a808-a72cc4c58bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:20.595538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c6b6f-7bd3-407b-9dcf-d2bebbc4dbe9 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:20.637382 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd65c31-6cac-424e-ad2f-a254726c20fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:20.638116 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd65c31-6cac-424e-ad2f-a254726c20fc None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:20.638617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd65c31-6cac-424e-ad2f-a254726c20fc None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:20.638791 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd65c31-6cac-424e-ad2f-a254726c20fc None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:20.639717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd65c31-6cac-424e-ad2f-a254726c20fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:20.640021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd65c31-6cac-424e-ad2f-a254726c20fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:20.641443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd65c31-6cac-424e-ad2f-a254726c20fc None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:20.651338 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 109/217] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:20.652773 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16364e-33a8-4d02-b4cb-152be48e3250 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:20.653108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16364e-33a8-4d02-b4cb-152be48e3250 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:20.653385 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16364e-33a8-4d02-b4cb-152be48e3250 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:20.655109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 110/218] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:20.660088 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16364e-33a8-4d02-b4cb-152be48e3250 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:20.675047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:20.685654 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 109/219] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:20.686920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57e0e1-21fa-4543-9035-f6f097d1257b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:20.687205 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57e0e1-21fa-4543-9035-f6f097d1257b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:20.687476 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57e0e1-21fa-4543-9035-f6f097d1257b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:20.705097 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-cb57e0e1-21fa-4543-9035-f6f097d1257b None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:20.706375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-cb57e0e1-21fa-4543-9035-f6f097d1257b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:20.738410 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:20.782005 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16364e-33a8-4d02-b4cb-152be48e3250 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:20.786620 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 110/220] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:20.787653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57e0e1-21fa-4543-9035-f6f097d1257b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:20.846281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93036797-6778-4175-a7f8-111d839ccaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:20.847180 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93036797-6778-4175-a7f8-111d839ccaee None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:20.847537 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93036797-6778-4175-a7f8-111d839ccaee None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:20.847810 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93036797-6778-4175-a7f8-111d839ccaee None admin] PATH_INFO: `/v3/users/07542faff74b4588ad45238761277f07` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:20.865918 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93036797-6778-4175-a7f8-111d839ccaee None admin] RBAC: Authorizing `identity:get_user(user_id=07542faff74b4588ad45238761277f07)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:20.867398 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93036797-6778-4175-a7f8-111d839ccaee None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:20.869151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 111/221] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:20 2022] GET /identity/v3/users/07542faff74b4588ad45238761277f07 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:20.873915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93036797-6778-4175-a7f8-111d839ccaee None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:20.912984 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57e0e1-21fa-4543-9035-f6f097d1257b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:20.944947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:20.960239 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ac1ff-f471-4da5-80f7-4674bdbd8da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:20.961467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ac1ff-f471-4da5-80f7-4674bdbd8da0 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:20.961781 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ac1ff-f471-4da5-80f7-4674bdbd8da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:20.962961 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ac1ff-f471-4da5-80f7-4674bdbd8da0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:20.976723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ac1ff-f471-4da5-80f7-4674bdbd8da0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:20.987525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-485ac1ff-f471-4da5-80f7-4674bdbd8da0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:47:20.987525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:20.987525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:20.987525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:20.987525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:20.987525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:20.987525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:20.987525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:20.987525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:20.987525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:20.987525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:20.987525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:20.987525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:20.987525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:20.987525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:20.987525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:20.988448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:20.988448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:20.988448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:20.988448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:20.988448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:20.988448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:20.988448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:20.988448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:20.988448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:20.988448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:20.988448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:20.988448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:20.988448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:20.988448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:20.988448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:20.988448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:20.989229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:20.989229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:20.989229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:20.989229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:20.989229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:20.989229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:20.989229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:20.989229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:20.989229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:20.989229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:20.989229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:47:20.989229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:20.989850 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 111/222] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:47:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:20.995488 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ac1ff-f471-4da5-80f7-4674bdbd8da0 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:20.999211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93036797-6778-4175-a7f8-111d839ccaee None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:21.024869 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:21.038643 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8cf4a-c99c-4284-a85d-6eacdc84b600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:21.039561 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8cf4a-c99c-4284-a85d-6eacdc84b600 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:21.039980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8cf4a-c99c-4284-a85d-6eacdc84b600 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:21.040324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8cf4a-c99c-4284-a85d-6eacdc84b600 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:21.052047 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8cf4a-c99c-4284-a85d-6eacdc84b600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:21.062503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-90b8cf4a-c99c-4284-a85d-6eacdc84b600 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:21.062503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:21.062503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:21.062503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:21.062503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:21.062503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:21.062503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:21.062503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:21.062503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:21.062503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:21.062503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:21.062503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:21.062503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:21.062503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:21.062503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:21.062503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:21.064040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:21.064040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:21.064040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:21.064040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:21.064040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:21.064040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:21.064040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:21.064040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:21.064040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:21.064040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:21.064040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:21.064040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:21.064040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:21.064040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:21.064040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:21.064040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:21.064980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:21.064980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:21.064980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:21.064980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:21.064980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:21.064980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:21.064980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:21.064980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:21.064980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:21.064980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:21.064980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:21.064980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:21.065597 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 112/223] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:47:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:21.066104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8cf4a-c99c-4284-a85d-6eacdc84b600 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:21.123827 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ac1ff-f471-4da5-80f7-4674bdbd8da0 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:21.162034 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b753e9-3de6-4e18-906a-831afb2737e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:21.162815 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b753e9-3de6-4e18-906a-831afb2737e4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:21.163464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b753e9-3de6-4e18-906a-831afb2737e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:21.163799 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b753e9-3de6-4e18-906a-831afb2737e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:21.209073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8cf4a-c99c-4284-a85d-6eacdc84b600 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:21.234895 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:21.249692 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1956a-836e-42d4-a58d-23f7da703b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:21.250498 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1956a-836e-42d4-a58d-23f7da703b87 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:21.250881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1956a-836e-42d4-a58d-23f7da703b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:21.251281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1956a-836e-42d4-a58d-23f7da703b87 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:21.251390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b753e9-3de6-4e18-906a-831afb2737e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:21.252443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1956a-836e-42d4-a58d-23f7da703b87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:21.252808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1956a-836e-42d4-a58d-23f7da703b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:21.253062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b753e9-3de6-4e18-906a-831afb2737e4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:21.254365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1956a-836e-42d4-a58d-23f7da703b87 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:21.264322 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 113/224] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:21.265282 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1956a-836e-42d4-a58d-23f7da703b87 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:21.315316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:21.385024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 112/225] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:21.386193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b753e9-3de6-4e18-906a-831afb2737e4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:21.387553 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1956a-836e-42d4-a58d-23f7da703b87 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:21.435730 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07f57e-dc10-4255-977e-068240c5df1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:21.436686 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07f57e-dc10-4255-977e-068240c5df1e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:21.436970 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07f57e-dc10-4255-977e-068240c5df1e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:21.437244 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07f57e-dc10-4255-977e-068240c5df1e None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:21.438290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07f57e-dc10-4255-977e-068240c5df1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:21.438994 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07f57e-dc10-4255-977e-068240c5df1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:21.440410 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07f57e-dc10-4255-977e-068240c5df1e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:21.453398 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 114/226] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:47:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:21.454287 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07f57e-dc10-4255-977e-068240c5df1e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:21.490314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:21.511106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b753e9-3de6-4e18-906a-831afb2737e4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:21.556680 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb2a3f-c8ea-4637-9485-2c3864dab64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:21.557680 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb2a3f-c8ea-4637-9485-2c3864dab64d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:21.557879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb2a3f-c8ea-4637-9485-2c3864dab64d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:21.558142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb2a3f-c8ea-4637-9485-2c3864dab64d None admin] PATH_INFO: `/v3/users/f5d201d3eaad49eead830d1b078bcfb4` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:21.559332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb2a3f-c8ea-4637-9485-2c3864dab64d None admin] RBAC: Authorizing `identity:get_user(user_id=f5d201d3eaad49eead830d1b078bcfb4)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:21.560947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb2a3f-c8ea-4637-9485-2c3864dab64d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:21.567513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 113/227] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:21 2022] GET /identity/v3/users/f5d201d3eaad49eead830d1b078bcfb4 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:21.567513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb2a3f-c8ea-4637-9485-2c3864dab64d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:21.590016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07f57e-dc10-4255-977e-068240c5df1e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:21.597504 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:21.629521 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c036ddb-a759-4a38-9c6a-2ba868bb3ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:21.630529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c036ddb-a759-4a38-9c6a-2ba868bb3ffd None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:21.631056 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c036ddb-a759-4a38-9c6a-2ba868bb3ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:21.631333 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c036ddb-a759-4a38-9c6a-2ba868bb3ffd None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:21.632520 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c036ddb-a759-4a38-9c6a-2ba868bb3ffd None admin] RBAC: Authorizing `identity:get_project(project_id=32a6d4fba36a446bb95799ce1b96d071)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:21.633995 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c036ddb-a759-4a38-9c6a-2ba868bb3ffd None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:21.636097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 115/228] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:21 2022] GET /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:21.636921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c036ddb-a759-4a38-9c6a-2ba868bb3ffd None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:21.708402 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb2a3f-c8ea-4637-9485-2c3864dab64d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:21.737506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c036ddb-a759-4a38-9c6a-2ba868bb3ffd None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:21.755062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722f5c3-a17c-438b-acb7-917e0ca2c084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:21.756601 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722f5c3-a17c-438b-acb7-917e0ca2c084 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:21.757107 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722f5c3-a17c-438b-acb7-917e0ca2c084 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:21.757585 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722f5c3-a17c-438b-acb7-917e0ca2c084 None admin] PATH_INFO: `/v3/users/f5d201d3eaad49eead830d1b078bcfb4` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:21.759523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722f5c3-a17c-438b-acb7-917e0ca2c084 None admin] RBAC: Authorizing `identity:get_user(user_id=f5d201d3eaad49eead830d1b078bcfb4)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:21.762211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722f5c3-a17c-438b-acb7-917e0ca2c084 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:21.770114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 114/229] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:21 2022] GET /identity/v3/users/f5d201d3eaad49eead830d1b078bcfb4 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:21.771379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722f5c3-a17c-438b-acb7-917e0ca2c084 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:21.776906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a2745-0b34-463e-b68c-3acf6ab1510e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:21.777518 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a2745-0b34-463e-b68c-3acf6ab1510e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:21.777813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a2745-0b34-463e-b68c-3acf6ab1510e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:21.778089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a2745-0b34-463e-b68c-3acf6ab1510e None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:21.779457 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a2745-0b34-463e-b68c-3acf6ab1510e None admin] RBAC: Authorizing `identity:get_project(project_id=32a6d4fba36a446bb95799ce1b96d071)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:21.780908 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a2745-0b34-463e-b68c-3acf6ab1510e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:21.782716 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 116/230] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:21 2022] GET /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:21.783588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a2745-0b34-463e-b68c-3acf6ab1510e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:21.803856 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:21.829370 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:21.903310 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a2745-0b34-463e-b68c-3acf6ab1510e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:21.912447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722f5c3-a17c-438b-acb7-917e0ca2c084 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:21.939243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d28ed4-b8e0-41f1-966d-b894bb560cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:21.940117 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d28ed4-b8e0-41f1-966d-b894bb560cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:21.940395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d28ed4-b8e0-41f1-966d-b894bb560cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:21.940659 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d28ed4-b8e0-41f1-966d-b894bb560cd4 None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:21.941852 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d28ed4-b8e0-41f1-966d-b894bb560cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=32a6d4fba36a446bb95799ce1b96d071)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:21.943328 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d28ed4-b8e0-41f1-966d-b894bb560cd4 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:21.945040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 117/231] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:21 2022] GET /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:21.945924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d28ed4-b8e0-41f1-966d-b894bb560cd4 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:21.958641 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bac8e-6396-47d9-89d6-eac3eb7e2ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:21.959787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bac8e-6396-47d9-89d6-eac3eb7e2ece None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:21.960306 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bac8e-6396-47d9-89d6-eac3eb7e2ece None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:21.960798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bac8e-6396-47d9-89d6-eac3eb7e2ece None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:21.961904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bac8e-6396-47d9-89d6-eac3eb7e2ece None admin] RBAC: Adding query filter params (role.id=3e320079a5ce471e863ad87a36be46b1, scope.project.id=32a6d4fba36a446bb95799ce1b96d071, user.id=07542faff74b4588ad45238761277f07) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:21.962550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bac8e-6396-47d9-89d6-eac3eb7e2ece None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:21.964673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bac8e-6396-47d9-89d6-eac3eb7e2ece None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:21.971400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 115/232] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:47:21 2022] GET /identity/v3/role_assignments?user.id=07542faff74b4588ad45238761277f07&scope.project.id=32a6d4fba36a446bb95799ce1b96d071&role.id=3e320079a5ce471e863ad87a36be46b1 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:21.972659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bac8e-6396-47d9-89d6-eac3eb7e2ece None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:22.053964 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d28ed4-b8e0-41f1-966d-b894bb560cd4 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:22.066516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:22.101025 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb14c32-93a6-44d4-a748-24736dffd3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:22.101781 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb14c32-93a6-44d4-a748-24736dffd3b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:22.102103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb14c32-93a6-44d4-a748-24736dffd3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:22.104495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb14c32-93a6-44d4-a748-24736dffd3b8 None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071/users/f5d201d3eaad49eead830d1b078bcfb4/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:22.106704 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb14c32-93a6-44d4-a748-24736dffd3b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=32a6d4fba36a446bb95799ce1b96d071, user_id=f5d201d3eaad49eead830d1b078bcfb4, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:22.108661 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb14c32-93a6-44d4-a748-24736dffd3b8 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:22.118958 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:22.135264 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 118/233] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:47:21 2022] PUT /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071/users/f5d201d3eaad49eead830d1b078bcfb4/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:47:22.163186 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bac8e-6396-47d9-89d6-eac3eb7e2ece None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:22.222147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc61a3d-feda-467d-8ecb-b684e3b88eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:22.223474 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc61a3d-feda-467d-8ecb-b684e3b88eca None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:22.223953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc61a3d-feda-467d-8ecb-b684e3b88eca None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:22.224576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc61a3d-feda-467d-8ecb-b684e3b88eca None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071/users/f5d201d3eaad49eead830d1b078bcfb4/roles/1ecbde8dcaa44047899f618334033d43` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:22.227329 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc61a3d-feda-467d-8ecb-b684e3b88eca None admin] RBAC: Authorizing `identity:create_grant(project_id=32a6d4fba36a446bb95799ce1b96d071, user_id=f5d201d3eaad49eead830d1b078bcfb4, role_id=1ecbde8dcaa44047899f618334033d43)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:22.229142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc61a3d-feda-467d-8ecb-b684e3b88eca None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:22.246795 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 116/234] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:47:21 2022] PUT /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071/users/f5d201d3eaad49eead830d1b078bcfb4/roles/1ecbde8dcaa44047899f618334033d43 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:47:23.190169 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c80ae-7e7e-44b1-82ed-86ead3b16d15 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:23.190732 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c80ae-7e7e-44b1-82ed-86ead3b16d15 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:23.190732 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c80ae-7e7e-44b1-82ed-86ead3b16d15 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:23.192607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 119/235] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:23.200978 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbacea-ab53-490b-a1e3-da1969db165a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:23.200978 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbacea-ab53-490b-a1e3-da1969db165a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:23.200978 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbacea-ab53-490b-a1e3-da1969db165a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:23.218805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-64fbacea-ab53-490b-a1e3-da1969db165a None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:23.220233 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-64fbacea-ab53-490b-a1e3-da1969db165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:23.307216 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 117/236] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:23.367331 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c80ae-7e7e-44b1-82ed-86ead3b16d15 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:23.466852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d808b32-4447-4685-94a2-9c0219fe6d7d None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:23.467392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d808b32-4447-4685-94a2-9c0219fe6d7d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:23.467809 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d808b32-4447-4685-94a2-9c0219fe6d7d None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:23.469747 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 118/237] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:23.477305 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4993c8-1683-4e53-bf25-2f13e0c9b587 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:23.477305 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4993c8-1683-4e53-bf25-2f13e0c9b587 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:23.477305 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4993c8-1683-4e53-bf25-2f13e0c9b587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:23.502613 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5b4993c8-1683-4e53-bf25-2f13e0c9b587 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:23.503832 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5b4993c8-1683-4e53-bf25-2f13e0c9b587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:23.602538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c80ae-7e7e-44b1-82ed-86ead3b16d15 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:23.665282 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 119/238] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:23.689329 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4993c8-1683-4e53-bf25-2f13e0c9b587 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:23.698286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:23.746620 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f67f9-e381-40e0-82b3-84584e73567b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:23.747900 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f67f9-e381-40e0-82b3-84584e73567b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:23.747900 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f67f9-e381-40e0-82b3-84584e73567b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:23.748153 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f67f9-e381-40e0-82b3-84584e73567b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:23.754591 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f67f9-e381-40e0-82b3-84584e73567b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:23.756191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f67f9-e381-40e0-82b3-84584e73567b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:23.757972 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 120/239] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:47:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:23.766856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f67f9-e381-40e0-82b3-84584e73567b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:23.817469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4993c8-1683-4e53-bf25-2f13e0c9b587 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:23.859086 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:23.865366 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a60cd6-993d-4ef5-bacd-c51afba3e2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:23.866529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a60cd6-993d-4ef5-bacd-c51afba3e2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:23.868413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a60cd6-993d-4ef5-bacd-c51afba3e2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:23.869581 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a60cd6-993d-4ef5-bacd-c51afba3e2c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:23.893029 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a60cd6-993d-4ef5-bacd-c51afba3e2c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:23.906323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-47a60cd6-993d-4ef5-bacd-c51afba3e2c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 18:47:23.906323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:23.906323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:23.906323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:23.906323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:23.906323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:23.906323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:23.906323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:23.906323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:23.906323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:23.906323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:23.906323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:23.906323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:23.906323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:23.906323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:23.906323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:23.907235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:23.907235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:23.907235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:23.907235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:23.907235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:23.907235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:23.907235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:23.907235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:23.907235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:23.907235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:23.907235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:23.907235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:23.907235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:23.907235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:23.907235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:23.907235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:23.908032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:23.908032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:23.908032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:23.908032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:23.908032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:23.908032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:23.908032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:23.908032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:23.908032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:23.908032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:23.908032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 18:47:23.908032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:23.915105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 120/240] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:47:23.924118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a60cd6-993d-4ef5-bacd-c51afba3e2c9 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:23.969503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f67f9-e381-40e0-82b3-84584e73567b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:24.005621 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8d4cc-3db2-404b-83d5-1c0bf2c9d668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:24.006255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8d4cc-3db2-404b-83d5-1c0bf2c9d668 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:24.006539 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8d4cc-3db2-404b-83d5-1c0bf2c9d668 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:24.006815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8d4cc-3db2-404b-83d5-1c0bf2c9d668 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:24.007531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8d4cc-3db2-404b-83d5-1c0bf2c9d668 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:24.008991 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8d4cc-3db2-404b-83d5-1c0bf2c9d668 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:24.031223 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 121/241] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 2 18:47:23 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:47:24.048047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:24.090366 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a60cd6-993d-4ef5-bacd-c51afba3e2c9 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:24.130248 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da2074-a3bc-4fb6-bcfe-bea86ac5e744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:24.130940 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da2074-a3bc-4fb6-bcfe-bea86ac5e744 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:24.131223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da2074-a3bc-4fb6-bcfe-bea86ac5e744 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:24.131499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da2074-a3bc-4fb6-bcfe-bea86ac5e744 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:24.132261 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da2074-a3bc-4fb6-bcfe-bea86ac5e744 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:24.132569 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da2074-a3bc-4fb6-bcfe-bea86ac5e744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:24.134002 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da2074-a3bc-4fb6-bcfe-bea86ac5e744 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:24.144394 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 121/242] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:24.151221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8d4cc-3db2-404b-83d5-1c0bf2c9d668 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:24.265316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8d4cc-3db2-404b-83d5-1c0bf2c9d668 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:24.267136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:24.302874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2237bf-384b-4c35-9e76-db0701e083de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:24.303959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2237bf-384b-4c35-9e76-db0701e083de None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:24.304302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2237bf-384b-4c35-9e76-db0701e083de None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:24.304904 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2237bf-384b-4c35-9e76-db0701e083de None admin] PATH_INFO: `/v3/users/ff2b12c279d4494ab425b81cf61bb13c` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:24.320015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2237bf-384b-4c35-9e76-db0701e083de None admin] RBAC: Authorizing `identity:get_user(user_id=ff2b12c279d4494ab425b81cf61bb13c)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:24.321515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2237bf-384b-4c35-9e76-db0701e083de None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:24.323384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 122/243] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:24 2022] GET /identity/v3/users/ff2b12c279d4494ab425b81cf61bb13c => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:24.329335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da2074-a3bc-4fb6-bcfe-bea86ac5e744 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:24.435357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da2074-a3bc-4fb6-bcfe-bea86ac5e744 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:24.462930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:24.471582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f26af-10a8-4db9-b74a-ff53b9c89f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:24.472274 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f26af-10a8-4db9-b74a-ff53b9c89f4d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:24.472556 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f26af-10a8-4db9-b74a-ff53b9c89f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:24.472831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f26af-10a8-4db9-b74a-ff53b9c89f4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:24.551688 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f26af-10a8-4db9-b74a-ff53b9c89f4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:24.553210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f26af-10a8-4db9-b74a-ff53b9c89f4d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:24.687349 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 122/244] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:24.692780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2237bf-384b-4c35-9e76-db0701e083de None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:24.824804 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2237bf-384b-4c35-9e76-db0701e083de None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:24.849323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1e17b-e5a5-4483-b47e-27793ca760e7 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:24.849629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1e17b-e5a5-4483-b47e-27793ca760e7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:24.849887 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1e17b-e5a5-4483-b47e-27793ca760e7 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:24.851289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 123/245] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:47:24.856731 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a697c-93c3-4d2b-b422-5cf37b2c49db None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:24.857076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a697c-93c3-4d2b-b422-5cf37b2c49db None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:24.857357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a697c-93c3-4d2b-b422-5cf37b2c49db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:24.875733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5cf39-3461-4c8a-be42-8d24165e956d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:24.876631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5cf39-3461-4c8a-be42-8d24165e956d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:24.876906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5cf39-3461-4c8a-be42-8d24165e956d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:24.877181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5cf39-3461-4c8a-be42-8d24165e956d None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:24.878596 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5cf39-3461-4c8a-be42-8d24165e956d None admin] RBAC: Authorizing `identity:get_project(project_id=32a6d4fba36a446bb95799ce1b96d071)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:24.880082 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5cf39-3461-4c8a-be42-8d24165e956d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:24.881825 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 123/246] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:24 2022] GET /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:24.886769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-3a6a697c-93c3-4d2b-b422-5cf37b2c49db None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:24.888049 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3a6a697c-93c3-4d2b-b422-5cf37b2c49db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:24.895954 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5cf39-3461-4c8a-be42-8d24165e956d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:24.917970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:24.931820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:24.991574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 124/247] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:25.037819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef86d0-d2f8-4c8f-9393-97d03b16fa68 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:25.037819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef86d0-d2f8-4c8f-9393-97d03b16fa68 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:25.037819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef86d0-d2f8-4c8f-9393-97d03b16fa68 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:25.038159 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5cf39-3461-4c8a-be42-8d24165e956d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:25.038511 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 125/248] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:47:25.039215 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef86d0-d2f8-4c8f-9393-97d03b16fa68 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:25.076784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe2b14-9237-4248-896a-6b69e70da3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:25.077372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe2b14-9237-4248-896a-6b69e70da3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:25.077647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe2b14-9237-4248-896a-6b69e70da3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:25.077949 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe2b14-9237-4248-896a-6b69e70da3e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:25.078788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe2b14-9237-4248-896a-6b69e70da3e6 None admin] RBAC: Adding query filter params (role.id=83b821ffac7d4dbdb849c13f1dbd4ead, scope.project.id=32a6d4fba36a446bb95799ce1b96d071, user.id=ff2b12c279d4494ab425b81cf61bb13c) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:25.079093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe2b14-9237-4248-896a-6b69e70da3e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:25.080558 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe2b14-9237-4248-896a-6b69e70da3e6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:25.086923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 124/249] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:47:24 2022] GET /identity/v3/role_assignments?user.id=ff2b12c279d4494ab425b81cf61bb13c&scope.project.id=32a6d4fba36a446bb95799ce1b96d071&role.id=83b821ffac7d4dbdb849c13f1dbd4ead => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:25.088164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb0b50-f50d-4c50-b295-ca8784719d5b None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:25.088447 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb0b50-f50d-4c50-b295-ca8784719d5b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:25.088714 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb0b50-f50d-4c50-b295-ca8784719d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:25.106964 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-3afb0b50-f50d-4c50-b295-ca8784719d5b None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:25.108677 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3afb0b50-f50d-4c50-b295-ca8784719d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:25.183629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef86d0-d2f8-4c8f-9393-97d03b16fa68 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:25.208647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 125/250] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:25.213848 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42311a73-4bf2-4acf-a555-797b6f0a995b None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:25.213848 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42311a73-4bf2-4acf-a555-797b6f0a995b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:25.213848 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42311a73-4bf2-4acf-a555-797b6f0a995b None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:25.213848 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 126/251] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:25.220895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b522f7-e612-4243-bfc9-c3aef38b3902 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:25.221467 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b522f7-e612-4243-bfc9-c3aef38b3902 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:25.222104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b522f7-e612-4243-bfc9-c3aef38b3902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:25.251926 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbd612-7523-4a6c-b50a-347a91b1a0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:25.253092 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbd612-7523-4a6c-b50a-347a91b1a0fc None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:25.253529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbd612-7523-4a6c-b50a-347a91b1a0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:25.254000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbd612-7523-4a6c-b50a-347a91b1a0fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:25.255832 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a5b522f7-e612-4243-bfc9-c3aef38b3902 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:25.260260 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a5b522f7-e612-4243-bfc9-c3aef38b3902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:25.280143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbd612-7523-4a6c-b50a-347a91b1a0fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:25.286183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:25.292672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-9edbd612-7523-4a6c-b50a-347a91b1a0fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:25.292672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:25.292672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:25.292672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:25.292672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:25.292672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:25.292672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:25.292672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:25.292672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:25.292672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:25.292672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:25.292672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:25.292672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:25.292672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:25.292672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:25.292672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:25.294069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:25.294069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:25.294069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:25.294069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:25.294069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:25.294069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:25.294069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:25.294069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:25.294069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:25.294069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:25.294069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:25.294069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:25.294069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:25.294069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:25.294069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:25.294069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:25.295184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:25.295184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:25.295184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:25.295184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:25.295184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:25.295184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:25.295184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:25.295184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:25.295184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:25.295184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:25.295184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:25.295184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:25.296164 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 126/252] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:25.296164 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbd612-7523-4a6c-b50a-347a91b1a0fc None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:25.347150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:25.379990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 127/253] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:25.379990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b522f7-e612-4243-bfc9-c3aef38b3902 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:25.489659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbd612-7523-4a6c-b50a-347a91b1a0fc None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:25.490771 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b522f7-e612-4243-bfc9-c3aef38b3902 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:25.551213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc25e1-3c0e-4529-a5ae-6c00702dbba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:25.552027 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc25e1-3c0e-4529-a5ae-6c00702dbba3 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:25.552298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc25e1-3c0e-4529-a5ae-6c00702dbba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:25.552564 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc25e1-3c0e-4529-a5ae-6c00702dbba3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:25.553626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af474f6e-8cf7-4fb6-bf74-082ee381f362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:25.554320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af474f6e-8cf7-4fb6-bf74-082ee381f362 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:25.554590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af474f6e-8cf7-4fb6-bf74-082ee381f362 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:25.554851 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af474f6e-8cf7-4fb6-bf74-082ee381f362 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:25.555604 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af474f6e-8cf7-4fb6-bf74-082ee381f362 None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:25.555896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af474f6e-8cf7-4fb6-bf74-082ee381f362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:25.557300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af474f6e-8cf7-4fb6-bf74-082ee381f362 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:25.571952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 128/254] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:25.572576 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af474f6e-8cf7-4fb6-bf74-082ee381f362 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:25.584066 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc25e1-3c0e-4529-a5ae-6c00702dbba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:25.591808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-14bc25e1-3c0e-4529-a5ae-6c00702dbba3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:47:25.591808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:25.591808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:25.591808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:25.591808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:25.591808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:25.591808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:25.591808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:25.591808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:25.591808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:25.591808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:25.591808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:25.591808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:25.591808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:25.591808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:25.591808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:25.593018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:25.593018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:25.593018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:25.593018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:25.593018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:25.593018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:25.593018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:25.593018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:25.593018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:25.593018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:25.593018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:25.593018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:25.593018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:25.593018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:25.593018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:25.593018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:25.593996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:25.593996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:25.593996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:25.593996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:25.593996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:25.593996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:25.593996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:25.593996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:25.593996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:25.593996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:25.593996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:47:25.593996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:25.593996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 127/255] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:47:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:25.594981 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc25e1-3c0e-4529-a5ae-6c00702dbba3 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:25.610238 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:25.733889 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af474f6e-8cf7-4fb6-bf74-082ee381f362 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:25.774311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:25.792761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc25e1-3c0e-4529-a5ae-6c00702dbba3 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:25.822517 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ded45-0517-49ad-b0be-8d665eba98d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:25.823356 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ded45-0517-49ad-b0be-8d665eba98d3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:25.823636 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ded45-0517-49ad-b0be-8d665eba98d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:25.823911 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ded45-0517-49ad-b0be-8d665eba98d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:25.840346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ded45-0517-49ad-b0be-8d665eba98d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:25.848651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-4f8ded45-0517-49ad-b0be-8d665eba98d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:25.848651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:25.848651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:25.848651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:25.848651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:25.848651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:25.848651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:25.848651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:25.848651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:25.848651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:25.848651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:25.848651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:25.848651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:25.848651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:25.848651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:25.848651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:25.849493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:25.849493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:25.849493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:25.849493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:25.849493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:25.849493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:25.849493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:25.849493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:25.849493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:25.849493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:25.849493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:25.849493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:25.849493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:25.849493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:25.849493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:25.849493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:25.850295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:25.850295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:25.850295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:25.850295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:25.850295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:25.850295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:25.850295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:25.850295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:25.850295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:25.850295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:25.850295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:25.850295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:25.850884 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c78e4-6c33-4aad-931f-cdea5192ec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:25.851499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c78e4-6c33-4aad-931f-cdea5192ec0f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:25.851667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c78e4-6c33-4aad-931f-cdea5192ec0f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:25.852532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c78e4-6c33-4aad-931f-cdea5192ec0f None admin] PATH_INFO: `/v3/users/07542faff74b4588ad45238761277f07` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:25.853238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c78e4-6c33-4aad-931f-cdea5192ec0f None admin] RBAC: Authorizing `identity:get_user(user_id=07542faff74b4588ad45238761277f07)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:25.854728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c78e4-6c33-4aad-931f-cdea5192ec0f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:25.856732 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 128/256] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:25 2022] GET /identity/v3/users/07542faff74b4588ad45238761277f07 => generated 297 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:25.857532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c78e4-6c33-4aad-931f-cdea5192ec0f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:25.858403 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 129/257] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:47:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:25.862863 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ded45-0517-49ad-b0be-8d665eba98d3 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:25.962886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c78e4-6c33-4aad-931f-cdea5192ec0f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:25.994126 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:26.028678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34add2-68dc-4e1d-bdab-c12efcf4dcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:26.029390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34add2-68dc-4e1d-bdab-c12efcf4dcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:26.029673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34add2-68dc-4e1d-bdab-c12efcf4dcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:26.029971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34add2-68dc-4e1d-bdab-c12efcf4dcf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:26.030725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34add2-68dc-4e1d-bdab-c12efcf4dcf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:26.031034 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34add2-68dc-4e1d-bdab-c12efcf4dcf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:26.032428 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34add2-68dc-4e1d-bdab-c12efcf4dcf3 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:26.045372 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 129/258] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:26.046226 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34add2-68dc-4e1d-bdab-c12efcf4dcf3 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:26.053235 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ded45-0517-49ad-b0be-8d665eba98d3 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:26.068443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:26.112405 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af6d33-f7d4-46aa-bdea-5e219692d57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:26.113154 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af6d33-f7d4-46aa-bdea-5e219692d57b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:26.113375 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af6d33-f7d4-46aa-bdea-5e219692d57b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:26.113648 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af6d33-f7d4-46aa-bdea-5e219692d57b None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:26.114432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af6d33-f7d4-46aa-bdea-5e219692d57b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:26.114734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af6d33-f7d4-46aa-bdea-5e219692d57b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:26.116139 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af6d33-f7d4-46aa-bdea-5e219692d57b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:26.131805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 130/259] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:47:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:26.132658 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af6d33-f7d4-46aa-bdea-5e219692d57b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:26.231067 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34add2-68dc-4e1d-bdab-c12efcf4dcf3 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:26.266092 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a551d-8394-4f04-8d3c-a19417a36c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:26.266977 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a551d-8394-4f04-8d3c-a19417a36c61 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:26.267253 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a551d-8394-4f04-8d3c-a19417a36c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:26.267523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a551d-8394-4f04-8d3c-a19417a36c61 None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:26.268699 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a551d-8394-4f04-8d3c-a19417a36c61 None admin] RBAC: Authorizing `identity:get_project(project_id=32a6d4fba36a446bb95799ce1b96d071)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:26.270189 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a551d-8394-4f04-8d3c-a19417a36c61 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:26.272194 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 130/260] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:26 2022] GET /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:26.272954 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a551d-8394-4f04-8d3c-a19417a36c61 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:26.285072 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af6d33-f7d4-46aa-bdea-5e219692d57b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:26.318151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:26.331957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c6f8b-a255-46f1-a1bc-e3c632df4965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:26.333233 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c6f8b-a255-46f1-a1bc-e3c632df4965 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:26.333520 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c6f8b-a255-46f1-a1bc-e3c632df4965 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:26.333790 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c6f8b-a255-46f1-a1bc-e3c632df4965 None admin] PATH_INFO: `/v3/users/f5d201d3eaad49eead830d1b078bcfb4` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:26.337499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c6f8b-a255-46f1-a1bc-e3c632df4965 None admin] RBAC: Authorizing `identity:get_user(user_id=f5d201d3eaad49eead830d1b078bcfb4)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:26.339008 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c6f8b-a255-46f1-a1bc-e3c632df4965 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:26.340879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 131/261] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:26 2022] GET /identity/v3/users/f5d201d3eaad49eead830d1b078bcfb4 => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:26.341462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c6f8b-a255-46f1-a1bc-e3c632df4965 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:26.388258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:26.456466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a551d-8394-4f04-8d3c-a19417a36c61 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:26.475205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c6f8b-a255-46f1-a1bc-e3c632df4965 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:26.522056 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdab8a-faa7-43a8-84b6-5ae4cadd2a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:26.525233 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdab8a-faa7-43a8-84b6-5ae4cadd2a08 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:26.525233 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdab8a-faa7-43a8-84b6-5ae4cadd2a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:26.525233 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdab8a-faa7-43a8-84b6-5ae4cadd2a08 None admin] PATH_INFO: `/v3/users/f5d201d3eaad49eead830d1b078bcfb4` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:26.526489 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdab8a-faa7-43a8-84b6-5ae4cadd2a08 None admin] RBAC: Authorizing `identity:get_user(user_id=f5d201d3eaad49eead830d1b078bcfb4)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:26.529685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdab8a-faa7-43a8-84b6-5ae4cadd2a08 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:26.531094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 131/262] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:26 2022] GET /identity/v3/users/f5d201d3eaad49eead830d1b078bcfb4 => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:26.534228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdab8a-faa7-43a8-84b6-5ae4cadd2a08 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:26.541345 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407c37c-2c7a-4082-a61a-8c282fb3e745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:26.542051 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407c37c-2c7a-4082-a61a-8c282fb3e745 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:26.542328 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407c37c-2c7a-4082-a61a-8c282fb3e745 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:26.543259 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407c37c-2c7a-4082-a61a-8c282fb3e745 None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071/users/07542faff74b4588ad45238761277f07/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:26.550334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407c37c-2c7a-4082-a61a-8c282fb3e745 None admin] RBAC: Authorizing `identity:create_grant(project_id=32a6d4fba36a446bb95799ce1b96d071, user_id=07542faff74b4588ad45238761277f07, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:26.551818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407c37c-2c7a-4082-a61a-8c282fb3e745 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:26.579975 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 132/263] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:47:26 2022] PUT /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071/users/07542faff74b4588ad45238761277f07/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:47:26.580549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407c37c-2c7a-4082-a61a-8c282fb3e745 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:26.704350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:26.719099 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdab8a-faa7-43a8-84b6-5ae4cadd2a08 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:26.758227 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4d796-ab73-463e-8e2d-298765ea5e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:26.759020 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4d796-ab73-463e-8e2d-298765ea5e41 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:26.759303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4d796-ab73-463e-8e2d-298765ea5e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:26.759577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4d796-ab73-463e-8e2d-298765ea5e41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:26.776163 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:26.813010 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407c37c-2c7a-4082-a61a-8c282fb3e745 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:26.865925 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4d796-ab73-463e-8e2d-298765ea5e41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:26.867503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4d796-ab73-463e-8e2d-298765ea5e41 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:26.915153 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f0f61-4076-46c1-badd-f9f051229648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:26.915838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f0f61-4076-46c1-badd-f9f051229648 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:26.916128 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f0f61-4076-46c1-badd-f9f051229648 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:26.916402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f0f61-4076-46c1-badd-f9f051229648 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:27.072270 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 132/264] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:27.077699 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f0f61-4076-46c1-badd-f9f051229648 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:27.079250 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f0f61-4076-46c1-badd-f9f051229648 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:27.080237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4d796-ab73-463e-8e2d-298765ea5e41 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:27.158089 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:27.205981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:27.228320 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4d796-ab73-463e-8e2d-298765ea5e41 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:27.267276 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636361e-314e-4bb9-a825-8cf0630af768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:27.268162 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636361e-314e-4bb9-a825-8cf0630af768 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:27.268439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636361e-314e-4bb9-a825-8cf0630af768 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:27.268712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636361e-314e-4bb9-a825-8cf0630af768 None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:27.269937 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636361e-314e-4bb9-a825-8cf0630af768 None admin] RBAC: Authorizing `identity:get_project(project_id=32a6d4fba36a446bb95799ce1b96d071)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:27.271420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636361e-314e-4bb9-a825-8cf0630af768 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:27.277908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 133/265] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:27 2022] GET /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:27.279912 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636361e-314e-4bb9-a825-8cf0630af768 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:27.313062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 133/266] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 733 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:27.334973 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f0f61-4076-46c1-badd-f9f051229648 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:27.396348 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636361e-314e-4bb9-a825-8cf0630af768 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:27.411054 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:27.434651 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9d10d-bb15-4a17-84ab-547fc4880763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:27.436003 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9d10d-bb15-4a17-84ab-547fc4880763 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:27.436292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9d10d-bb15-4a17-84ab-547fc4880763 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:27.436570 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9d10d-bb15-4a17-84ab-547fc4880763 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:27.437421 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9d10d-bb15-4a17-84ab-547fc4880763 None admin] RBAC: Adding query filter params (role.id=8560bac1acf74dce81ea6a76f751b641, scope.project.id=32a6d4fba36a446bb95799ce1b96d071, user.id=f5d201d3eaad49eead830d1b078bcfb4) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:27.437731 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9d10d-bb15-4a17-84ab-547fc4880763 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:27.440443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9d10d-bb15-4a17-84ab-547fc4880763 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:27.454492 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 134/267] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:47:27 2022] GET /identity/v3/role_assignments?user.id=f5d201d3eaad49eead830d1b078bcfb4&scope.project.id=32a6d4fba36a446bb95799ce1b96d071&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:27.502618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f0f61-4076-46c1-badd-f9f051229648 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:27.530587 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4be62-01f9-45dd-9e1f-29bf90ed498d None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:27.531223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4be62-01f9-45dd-9e1f-29bf90ed498d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:27.531725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4be62-01f9-45dd-9e1f-29bf90ed498d None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:27.533324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 135/268] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:47:27.539434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e4369-4d6a-482b-a77d-511668fe2f3f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:27.540002 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e4369-4d6a-482b-a77d-511668fe2f3f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:27.540474 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e4369-4d6a-482b-a77d-511668fe2f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:27.559251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5c0e4369-4d6a-482b-a77d-511668fe2f3f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:27.560898 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5c0e4369-4d6a-482b-a77d-511668fe2f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:27.580259 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9886f-2544-44f5-8946-11503fea4bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:27.581293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9886f-2544-44f5-8946-11503fea4bda None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:27.581560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9886f-2544-44f5-8946-11503fea4bda None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:27.581853 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9886f-2544-44f5-8946-11503fea4bda None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:27.583435 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9886f-2544-44f5-8946-11503fea4bda None admin] RBAC: Authorizing `identity:get_project(project_id=32a6d4fba36a446bb95799ce1b96d071)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:27.585894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9886f-2544-44f5-8946-11503fea4bda None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:27.589819 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 134/269] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:27 2022] GET /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:27.594257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9886f-2544-44f5-8946-11503fea4bda None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:27.642211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:27.737014 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 136/270] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:27.770042 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9886f-2544-44f5-8946-11503fea4bda None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:27.775058 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e4369-4d6a-482b-a77d-511668fe2f3f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:27.811778 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47918229-5ccf-4694-991c-2dabbc4c53c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:27.812345 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47918229-5ccf-4694-991c-2dabbc4c53c2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:27.812692 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47918229-5ccf-4694-991c-2dabbc4c53c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:27.813034 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47918229-5ccf-4694-991c-2dabbc4c53c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:27.813983 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47918229-5ccf-4694-991c-2dabbc4c53c2 None admin] RBAC: Adding query filter params (role.id=1ecbde8dcaa44047899f618334033d43, scope.project.id=32a6d4fba36a446bb95799ce1b96d071, user.id=f5d201d3eaad49eead830d1b078bcfb4) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:27.814384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47918229-5ccf-4694-991c-2dabbc4c53c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:27.816227 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47918229-5ccf-4694-991c-2dabbc4c53c2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:27.830118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 135/271] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:47:27 2022] GET /identity/v3/role_assignments?user.id=f5d201d3eaad49eead830d1b078bcfb4&scope.project.id=32a6d4fba36a446bb95799ce1b96d071&role.id=1ecbde8dcaa44047899f618334033d43 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:27.896291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe8cff-89e8-4f5d-b877-81a6003c7ae6 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:27.896971 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe8cff-89e8-4f5d-b877-81a6003c7ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:27.897445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe8cff-89e8-4f5d-b877-81a6003c7ae6 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:27.899396 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 136/272] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:27.905646 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebda02c-4645-447b-90ce-51c7d305e1df None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:27.906407 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebda02c-4645-447b-90ce-51c7d305e1df None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:27.906971 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebda02c-4645-447b-90ce-51c7d305e1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:27.921503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e4369-4d6a-482b-a77d-511668fe2f3f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:27.930178 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:27.931581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-9ebda02c-4645-447b-90ce-51c7d305e1df None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:27.934304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9ebda02c-4645-447b-90ce-51c7d305e1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:27.963909 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567e0d7-7f76-4477-afa5-ea9dc4169036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:27.965177 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567e0d7-7f76-4477-afa5-ea9dc4169036 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:27.965462 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567e0d7-7f76-4477-afa5-ea9dc4169036 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:27.965741 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567e0d7-7f76-4477-afa5-ea9dc4169036 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:27.967470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567e0d7-7f76-4477-afa5-ea9dc4169036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:27.969447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567e0d7-7f76-4477-afa5-ea9dc4169036 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:27.973826 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 137/273] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:47:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:27.978845 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567e0d7-7f76-4477-afa5-ea9dc4169036 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:28.037635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 137/274] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 02 18:47:28.076218 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebda02c-4645-447b-90ce-51c7d305e1df None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:28.118188 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:28.127350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567e0d7-7f76-4477-afa5-ea9dc4169036 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:28.204346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b8b43-068a-4427-b081-7b7b5c9705da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:28.205456 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b8b43-068a-4427-b081-7b7b5c9705da None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:28.205965 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b8b43-068a-4427-b081-7b7b5c9705da None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:28.206438 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b8b43-068a-4427-b081-7b7b5c9705da None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:28.207553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b8b43-068a-4427-b081-7b7b5c9705da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:28.209856 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b8b43-068a-4427-b081-7b7b5c9705da None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:28.236707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 138/275] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 2 18:47:27 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:47:28.239297 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187791b-3e2f-49a8-8431-de535a933d58 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:28.239795 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187791b-3e2f-49a8-8431-de535a933d58 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:28.240263 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187791b-3e2f-49a8-8431-de535a933d58 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:28.242149 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 139/276] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:28.247913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9d9a4-10e1-474f-b7cb-c9a4c366127a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:28.248248 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9d9a4-10e1-474f-b7cb-c9a4c366127a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:28.248579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9d9a4-10e1-474f-b7cb-c9a4c366127a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:28.270928 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebda02c-4645-447b-90ce-51c7d305e1df None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:28.272329 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-dff9d9a4-10e1-474f-b7cb-c9a4c366127a None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:28.273760 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-dff9d9a4-10e1-474f-b7cb-c9a4c366127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:28.305774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:28.326177 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d219b5-16d0-455d-a62a-04e7a95cd492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:28.327053 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d219b5-16d0-455d-a62a-04e7a95cd492 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:28.327336 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d219b5-16d0-455d-a62a-04e7a95cd492 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:28.327611 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d219b5-16d0-455d-a62a-04e7a95cd492 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:28.342476 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d219b5-16d0-455d-a62a-04e7a95cd492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:28.354228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-34d219b5-16d0-455d-a62a-04e7a95cd492 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:28.354228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:28.354228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:28.354228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:28.354228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:28.354228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:28.354228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:28.354228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:28.354228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:28.354228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:28.354228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:28.354228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:28.354228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:28.354228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:28.354228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:28.354228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:28.355466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:28.355466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:28.355466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:28.355466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:28.355466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:28.355466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:28.355466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:28.355466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:28.355466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:28.355466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:28.355466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:28.355466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:28.355466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:28.355466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:28.355466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:28.355466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:28.356442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:28.356442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:28.356442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:28.356442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:28.356442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:28.356442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:28.356442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:28.356442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:28.356442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:28.356442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:28.356442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:28.356442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:28.359779 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 138/277] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:28.366438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d219b5-16d0-455d-a62a-04e7a95cd492 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:28.379245 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 140/278] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:47:28.409715 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9d9a4-10e1-474f-b7cb-c9a4c366127a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:28.483319 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:28.516573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d219b5-16d0-455d-a62a-04e7a95cd492 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:28.559337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9d9a4-10e1-474f-b7cb-c9a4c366127a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:28.564367 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9ded8-b659-4256-b53d-699e6bd31262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:28.565055 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9ded8-b659-4256-b53d-699e6bd31262 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:28.565346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9ded8-b659-4256-b53d-699e6bd31262 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:28.565623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9ded8-b659-4256-b53d-699e6bd31262 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:28.569298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9ded8-b659-4256-b53d-699e6bd31262 None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:28.569298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9ded8-b659-4256-b53d-699e6bd31262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:28.569298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9ded8-b659-4256-b53d-699e6bd31262 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:28.579286 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 139/279] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:28.585820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9ded8-b659-4256-b53d-699e6bd31262 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:28.610650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6af074-f08a-49ee-b24b-de73f69ae9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:28.611472 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6af074-f08a-49ee-b24b-de73f69ae9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:28.611758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6af074-f08a-49ee-b24b-de73f69ae9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:28.612032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6af074-f08a-49ee-b24b-de73f69ae9c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:28.631527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6af074-f08a-49ee-b24b-de73f69ae9c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:28.638970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-6a6af074-f08a-49ee-b24b-de73f69ae9c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 18:47:28.638970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:28.638970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:28.638970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:28.638970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:28.638970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:28.638970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:28.638970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:28.638970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:28.638970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:28.638970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:28.638970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:28.638970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:28.638970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:28.638970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:28.638970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:28.639876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:28.639876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:28.639876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:28.639876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:28.639876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:28.639876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:28.639876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:28.639876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:28.639876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:28.639876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:28.639876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:28.639876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:28.639876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:28.639876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:28.639876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:28.639876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:28.640666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:28.640666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:28.640666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:28.640666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:28.640666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:28.640666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:28.640666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:28.640666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:28.640666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:28.640666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:28.640666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 18:47:28.640666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:28.640666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 141/280] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:47:28.646639 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6af074-f08a-49ee-b24b-de73f69ae9c5 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:28.675622 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:28.707587 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9ded8-b659-4256-b53d-699e6bd31262 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:28.748024 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e71fe0-f389-4992-bbfb-06e5ecdb1507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:28.748432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e71fe0-f389-4992-bbfb-06e5ecdb1507 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:28.748714 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e71fe0-f389-4992-bbfb-06e5ecdb1507 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:28.748989 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e71fe0-f389-4992-bbfb-06e5ecdb1507 None admin] PATH_INFO: `/v3/users/cdc87d7a4fd94fe2b7593e9145fcbfc9` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:28.761034 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:28.764417 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e71fe0-f389-4992-bbfb-06e5ecdb1507 None admin] RBAC: Authorizing `identity:get_user(user_id=cdc87d7a4fd94fe2b7593e9145fcbfc9)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:28.766395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e71fe0-f389-4992-bbfb-06e5ecdb1507 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:28.768413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 140/281] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:28 2022] GET /identity/v3/users/cdc87d7a4fd94fe2b7593e9145fcbfc9 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:28.774879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e71fe0-f389-4992-bbfb-06e5ecdb1507 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:28.781419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6af074-f08a-49ee-b24b-de73f69ae9c5 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:28.823357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04154e8-0b9d-4274-9a3f-258a1d4da689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:28.824298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04154e8-0b9d-4274-9a3f-258a1d4da689 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:28.824298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04154e8-0b9d-4274-9a3f-258a1d4da689 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:28.824588 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04154e8-0b9d-4274-9a3f-258a1d4da689 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:28.825638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04154e8-0b9d-4274-9a3f-258a1d4da689 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:28.827955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04154e8-0b9d-4274-9a3f-258a1d4da689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:28.829391 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04154e8-0b9d-4274-9a3f-258a1d4da689 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:28.843775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 142/282] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:28.845054 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04154e8-0b9d-4274-9a3f-258a1d4da689 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:28.887588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e71fe0-f389-4992-bbfb-06e5ecdb1507 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:28.924112 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130deee0-551a-49dc-8959-a1a3a190225c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:28.925200 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130deee0-551a-49dc-8959-a1a3a190225c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:28.925679 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130deee0-551a-49dc-8959-a1a3a190225c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:28.926211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130deee0-551a-49dc-8959-a1a3a190225c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:28.927290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130deee0-551a-49dc-8959-a1a3a190225c None admin] RBAC: Adding query filter params (role.id=3e320079a5ce471e863ad87a36be46b1, user.id=cdc87d7a4fd94fe2b7593e9145fcbfc9, scope.system=all) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:28.927844 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130deee0-551a-49dc-8959-a1a3a190225c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:28.929499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130deee0-551a-49dc-8959-a1a3a190225c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:28.935456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 141/283] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Jun 2 18:47:28 2022] GET /identity/v3/role_assignments?user.id=cdc87d7a4fd94fe2b7593e9145fcbfc9&scope.system=all&role.id=3e320079a5ce471e863ad87a36be46b1 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:29.019121 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:29.044234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04154e8-0b9d-4274-9a3f-258a1d4da689 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:29.101235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e81623-53e9-421d-83c5-64487a1ab684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:29.102199 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e81623-53e9-421d-83c5-64487a1ab684 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:29.102481 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e81623-53e9-421d-83c5-64487a1ab684 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:29.102757 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e81623-53e9-421d-83c5-64487a1ab684 None admin] PATH_INFO: `/v3/users/ff2b12c279d4494ab425b81cf61bb13c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:29.104051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e81623-53e9-421d-83c5-64487a1ab684 None admin] RBAC: Authorizing `identity:get_user(user_id=ff2b12c279d4494ab425b81cf61bb13c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:29.105538 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e81623-53e9-421d-83c5-64487a1ab684 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:29.107356 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 143/284] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:28 2022] GET /identity/v3/users/ff2b12c279d4494ab425b81cf61bb13c => generated 297 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:29.113252 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130deee0-551a-49dc-8959-a1a3a190225c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:29.198861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:29.242069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130deee0-551a-49dc-8959-a1a3a190225c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:29.288983 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1ca7b-ea46-4f7b-b5a6-7d82dfe2ae85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:29.289781 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1ca7b-ea46-4f7b-b5a6-7d82dfe2ae85 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:29.290087 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1ca7b-ea46-4f7b-b5a6-7d82dfe2ae85 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:29.290446 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1ca7b-ea46-4f7b-b5a6-7d82dfe2ae85 None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:29.294597 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1ca7b-ea46-4f7b-b5a6-7d82dfe2ae85 None admin] RBAC: Authorizing `identity:get_project(project_id=32a6d4fba36a446bb95799ce1b96d071)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:29.296085 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1ca7b-ea46-4f7b-b5a6-7d82dfe2ae85 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:29.298181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 142/285] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:29 2022] GET /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:29.303685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e81623-53e9-421d-83c5-64487a1ab684 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:29.469630 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e81623-53e9-421d-83c5-64487a1ab684 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:29.511734 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d03aa8-6a6d-44ef-b031-ec836a5bffdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:29.513071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d03aa8-6a6d-44ef-b031-ec836a5bffdf None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:29.513562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d03aa8-6a6d-44ef-b031-ec836a5bffdf None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:29.514052 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d03aa8-6a6d-44ef-b031-ec836a5bffdf None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071/users/ff2b12c279d4494ab425b81cf61bb13c/roles/83b821ffac7d4dbdb849c13f1dbd4ead` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:29.519571 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d03aa8-6a6d-44ef-b031-ec836a5bffdf None admin] RBAC: Authorizing `identity:create_grant(project_id=32a6d4fba36a446bb95799ce1b96d071, user_id=ff2b12c279d4494ab425b81cf61bb13c, role_id=83b821ffac7d4dbdb849c13f1dbd4ead)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:29.521321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d03aa8-6a6d-44ef-b031-ec836a5bffdf None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:29.552943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 144/286] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:47:29 2022] PUT /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071/users/ff2b12c279d4494ab425b81cf61bb13c/roles/83b821ffac7d4dbdb849c13f1dbd4ead => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:47:29.816560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ba67c-0abf-4dbc-8a1d-92d3800c283f None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:29.817064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ba67c-0abf-4dbc-8a1d-92d3800c283f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:29.817064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ba67c-0abf-4dbc-8a1d-92d3800c283f None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:29.818723 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 143/287] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:29.824731 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47101b-e1a6-4970-90cb-c1768267d3a5 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:29.825016 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47101b-e1a6-4970-90cb-c1768267d3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:29.825307 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47101b-e1a6-4970-90cb-c1768267d3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:29.846408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9e47101b-e1a6-4970-90cb-c1768267d3a5 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:29.847635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9e47101b-e1a6-4970-90cb-c1768267d3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:29.852716 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:29.928409 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 145/288] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:29.952571 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ba67c-0abf-4dbc-8a1d-92d3800c283f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:30.083595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ba67c-0abf-4dbc-8a1d-92d3800c283f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:30.118205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:30.124339 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d84050-079a-48a5-9e0a-caa899b3f495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:30.125413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d84050-079a-48a5-9e0a-caa899b3f495 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:30.130159 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d84050-079a-48a5-9e0a-caa899b3f495 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:30.130442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d84050-079a-48a5-9e0a-caa899b3f495 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:30.142940 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d84050-079a-48a5-9e0a-caa899b3f495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:30.150818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-23d84050-079a-48a5-9e0a-caa899b3f495 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:30.150818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:30.150818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:30.150818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:30.150818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:30.150818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:30.150818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:30.150818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:30.150818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:30.150818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:30.150818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:30.150818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:30.150818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:30.150818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:30.150818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:30.150818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:30.151857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:30.151857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:30.151857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:30.151857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:30.151857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:30.151857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:30.151857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:30.151857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:30.151857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:30.151857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:30.151857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:30.151857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:30.151857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:30.151857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:30.151857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:30.151857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:30.152898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:30.152898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:30.152898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:30.152898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:30.152898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:30.152898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:30.152898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:30.152898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:30.152898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:30.152898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:30.152898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:30.152898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:30.152898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 144/289] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:30.158195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47101b-e1a6-4970-90cb-c1768267d3a5 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:30.289433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47101b-e1a6-4970-90cb-c1768267d3a5 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:30.322925 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d979cbe-96de-4edb-97ad-3f5e9ceb9d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:30.323605 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d979cbe-96de-4edb-97ad-3f5e9ceb9d3c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:30.323883 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d979cbe-96de-4edb-97ad-3f5e9ceb9d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:30.324350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d979cbe-96de-4edb-97ad-3f5e9ceb9d3c None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:30.325106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d979cbe-96de-4edb-97ad-3f5e9ceb9d3c None admin] RBAC: Adding query filter params (name=member) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:30.325413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d979cbe-96de-4edb-97ad-3f5e9ceb9d3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:30.327115 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d979cbe-96de-4edb-97ad-3f5e9ceb9d3c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:30.336461 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 146/290] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:30.341686 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d84050-079a-48a5-9e0a-caa899b3f495 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:30.469560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d84050-079a-48a5-9e0a-caa899b3f495 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:30.505374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ad713-fc72-45de-8770-a68ae64bf813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:30.506292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ad713-fc72-45de-8770-a68ae64bf813 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:30.506575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ad713-fc72-45de-8770-a68ae64bf813 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:30.506846 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ad713-fc72-45de-8770-a68ae64bf813 None admin] PATH_INFO: `/v3/users/07542faff74b4588ad45238761277f07` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:30.508037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ad713-fc72-45de-8770-a68ae64bf813 None admin] RBAC: Authorizing `identity:get_user(user_id=07542faff74b4588ad45238761277f07)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:30.509484 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ad713-fc72-45de-8770-a68ae64bf813 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:30.511446 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 145/291] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:30 2022] GET /identity/v3/users/07542faff74b4588ad45238761277f07 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:30.516980 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d979cbe-96de-4edb-97ad-3f5e9ceb9d3c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:30.521077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:30.686609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d979cbe-96de-4edb-97ad-3f5e9ceb9d3c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:30.721962 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12325c0-7303-44c8-965e-c96fb92d47e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:30.722620 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12325c0-7303-44c8-965e-c96fb92d47e9 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:30.722895 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12325c0-7303-44c8-965e-c96fb92d47e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:30.723163 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12325c0-7303-44c8-965e-c96fb92d47e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:30.793267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12325c0-7303-44c8-965e-c96fb92d47e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:30.794862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12325c0-7303-44c8-965e-c96fb92d47e9 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:30.796718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:30.904848 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 147/292] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:30.915039 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ad713-fc72-45de-8770-a68ae64bf813 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:30.983479 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:31.026621 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ad713-fc72-45de-8770-a68ae64bf813 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:31.060749 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312f043-f4f2-4d95-bcb5-0ea2027e22f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:31.061653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312f043-f4f2-4d95-bcb5-0ea2027e22f3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:31.061653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312f043-f4f2-4d95-bcb5-0ea2027e22f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:31.061993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312f043-f4f2-4d95-bcb5-0ea2027e22f3 None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:31.063170 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312f043-f4f2-4d95-bcb5-0ea2027e22f3 None admin] RBAC: Authorizing `identity:get_project(project_id=32a6d4fba36a446bb95799ce1b96d071)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:31.064642 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312f043-f4f2-4d95-bcb5-0ea2027e22f3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:31.066378 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 146/293] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:30 2022] GET /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:31.072228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12325c0-7303-44c8-965e-c96fb92d47e9 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:31.247790 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12325c0-7303-44c8-965e-c96fb92d47e9 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:31.249876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:31.292919 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe75a5-e785-4c81-9f0c-28d80868bf58 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:31.293235 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe75a5-e785-4c81-9f0c-28d80868bf58 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:31.293467 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe75a5-e785-4c81-9f0c-28d80868bf58 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:31.295303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 147/294] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:31.300447 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5c4b5-73eb-41d0-97cb-144f8e037595 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:31.300765 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5c4b5-73eb-41d0-97cb-144f8e037595 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:31.301044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5c4b5-73eb-41d0-97cb-144f8e037595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:31.302711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143e74d-c4fe-4ff6-9b1b-0fb7c779187e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:31.303383 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143e74d-c4fe-4ff6-9b1b-0fb7c779187e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:31.303661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143e74d-c4fe-4ff6-9b1b-0fb7c779187e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:31.303933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143e74d-c4fe-4ff6-9b1b-0fb7c779187e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:31.304768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143e74d-c4fe-4ff6-9b1b-0fb7c779187e None admin] RBAC: Adding query filter params (role.id=3e320079a5ce471e863ad87a36be46b1, scope.project.id=32a6d4fba36a446bb95799ce1b96d071, user.id=07542faff74b4588ad45238761277f07) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:31.305077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143e74d-c4fe-4ff6-9b1b-0fb7c779187e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:31.306655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143e74d-c4fe-4ff6-9b1b-0fb7c779187e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:31.315805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 148/295] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:47:31 2022] GET /identity/v3/role_assignments?user.id=07542faff74b4588ad45238761277f07&scope.project.id=32a6d4fba36a446bb95799ce1b96d071&role.id=3e320079a5ce471e863ad87a36be46b1 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:31.336417 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-25e5c4b5-73eb-41d0-97cb-144f8e037595 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:31.337618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-25e5c4b5-73eb-41d0-97cb-144f8e037595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:31.351848 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2857b91-1ff6-4cca-a4d4-720bcbcdce02 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:31.352132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2857b91-1ff6-4cca-a4d4-720bcbcdce02 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:31.352558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2857b91-1ff6-4cca-a4d4-720bcbcdce02 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:31.354421 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 149/296] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:47:31.364875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ec007-6699-4d2b-b597-960209953c93 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:31.365187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ec007-6699-4d2b-b597-960209953c93 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:31.365414 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ec007-6699-4d2b-b597-960209953c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:31.399474 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b08ec007-6699-4d2b-b597-960209953c93 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:31.401637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b08ec007-6699-4d2b-b597-960209953c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:31.504182 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 150/297] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:47:31.516551 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 148/298] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:47:31.528432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ec007-6699-4d2b-b597-960209953c93 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:31.542500 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5c4b5-73eb-41d0-97cb-144f8e037595 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:31.644673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:31.651450 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ec007-6699-4d2b-b597-960209953c93 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:31.658780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:31.690456 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4af12-dd83-4004-a950-81d0f1a92c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:31.690976 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4af12-dd83-4004-a950-81d0f1a92c39 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:31.691257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4af12-dd83-4004-a950-81d0f1a92c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:31.691530 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4af12-dd83-4004-a950-81d0f1a92c39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:31.692719 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4af12-dd83-4004-a950-81d0f1a92c39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:31.694335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4af12-dd83-4004-a950-81d0f1a92c39 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:31.696335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 151/299] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:47:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:31.703003 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4af12-dd83-4004-a950-81d0f1a92c39 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:31.709776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5c4b5-73eb-41d0-97cb-144f8e037595 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:31.749566 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44269cdd-1e16-49d8-9647-b09d09a48dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:31.750413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44269cdd-1e16-49d8-9647-b09d09a48dde None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:31.750691 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44269cdd-1e16-49d8-9647-b09d09a48dde None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:31.750968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44269cdd-1e16-49d8-9647-b09d09a48dde None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:31.761606 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44269cdd-1e16-49d8-9647-b09d09a48dde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:31.770061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-44269cdd-1e16-49d8-9647-b09d09a48dde None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 18:47:31.770061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:31.770061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:31.770061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:31.770061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:31.770061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:31.770061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:31.770061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:31.770061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:31.770061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:31.770061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:31.770061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:31.770061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:31.770061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:31.770061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:31.770061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:31.771011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:31.771011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:31.771011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:31.771011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:31.771011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:31.771011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:31.771011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:31.771011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:31.771011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:31.771011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:31.771011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:31.771011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:31.771011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:31.771011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:31.771011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:31.771011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:31.771795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:31.771795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:31.771795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:31.771795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:31.771795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:31.771795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:31.771795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:31.771795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:31.771795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:31.771795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:31.771795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 18:47:31.771795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:31.771795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 149/300] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:31.780487 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44269cdd-1e16-49d8-9647-b09d09a48dde None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:31.844603 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4af12-dd83-4004-a950-81d0f1a92c39 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:31.886018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dcf55-c8c8-4e6c-9aea-9995c8b14717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:31.886710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dcf55-c8c8-4e6c-9aea-9995c8b14717 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:31.887052 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dcf55-c8c8-4e6c-9aea-9995c8b14717 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:31.887330 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dcf55-c8c8-4e6c-9aea-9995c8b14717 None admin] PATH_INFO: `/v3/groups` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:31.889123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dcf55-c8c8-4e6c-9aea-9995c8b14717 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:31.890608 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dcf55-c8c8-4e6c-9aea-9995c8b14717 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:31.901596 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44269cdd-1e16-49d8-9647-b09d09a48dde None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:31.913832 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 152/301] 10.222.0.15 () {60 vars in 1134 bytes} [Thu Jun 2 18:47:31 2022] POST /identity/v3/groups => generated 229 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:47:31.913832 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5046879-05c4-4ab8-be54-3476f68cba1d None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:31.913832 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5046879-05c4-4ab8-be54-3476f68cba1d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:31.913832 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5046879-05c4-4ab8-be54-3476f68cba1d None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:31.913832 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 153/302] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:31.917297 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ca071-f80d-4e01-8fc0-ec2251568e92 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:31.917931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ca071-f80d-4e01-8fc0-ec2251568e92 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:31.917931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ca071-f80d-4e01-8fc0-ec2251568e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:31.927069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:31.938085 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f47ca071-f80d-4e01-8fc0-ec2251568e92 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:31.939292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f47ca071-f80d-4e01-8fc0-ec2251568e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:31.958386 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bd9e7-7c6a-4bbf-b153-c1f36d649e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:31.959476 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bd9e7-7c6a-4bbf-b153-c1f36d649e74 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:31.959748 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bd9e7-7c6a-4bbf-b153-c1f36d649e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:31.960497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:31.961054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bd9e7-7c6a-4bbf-b153-c1f36d649e74 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:31.962098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bd9e7-7c6a-4bbf-b153-c1f36d649e74 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:31.962409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bd9e7-7c6a-4bbf-b153-c1f36d649e74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:31.963827 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bd9e7-7c6a-4bbf-b153-c1f36d649e74 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:31.979962 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 150/303] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:31.986878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bd9e7-7c6a-4bbf-b153-c1f36d649e74 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:32.033997 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 154/304] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:47:32.050763 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ca071-f80d-4e01-8fc0-ec2251568e92 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:32.119467 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bd9e7-7c6a-4bbf-b153-c1f36d649e74 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:32.162080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfffd6e-ace8-4ec6-a286-ef2b63c578d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:32.163131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfffd6e-ace8-4ec6-a286-ef2b63c578d2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:32.163410 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfffd6e-ace8-4ec6-a286-ef2b63c578d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:32.163682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfffd6e-ace8-4ec6-a286-ef2b63c578d2 None admin] PATH_INFO: `/v3/users/20334b34131842aeba3ef88718735440` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:32.182492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfffd6e-ace8-4ec6-a286-ef2b63c578d2 None admin] RBAC: Authorizing `identity:get_user(user_id=20334b34131842aeba3ef88718735440)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:32.184384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfffd6e-ace8-4ec6-a286-ef2b63c578d2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:32.187257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 151/305] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:31 2022] GET /identity/v3/users/20334b34131842aeba3ef88718735440 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:32.189778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ca071-f80d-4e01-8fc0-ec2251568e92 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:32.194302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfffd6e-ace8-4ec6-a286-ef2b63c578d2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:32.231460 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1debca-0b51-472c-8907-5e2b4f5ce7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:32.232354 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1debca-0b51-472c-8907-5e2b4f5ce7ce None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:32.232683 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1debca-0b51-472c-8907-5e2b4f5ce7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:32.232955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1debca-0b51-472c-8907-5e2b4f5ce7ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:32.235081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:32.244062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1debca-0b51-472c-8907-5e2b4f5ce7ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:32.252365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-ce1debca-0b51-472c-8907-5e2b4f5ce7ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:32.252365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:32.252365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:32.252365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:32.252365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:32.252365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:32.252365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:32.252365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:32.252365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:32.252365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:32.252365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:32.252365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:32.252365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:32.252365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:32.252365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:32.252365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:32.253335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:32.253335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:32.253335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:32.253335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:32.253335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:32.253335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:32.253335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:32.253335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:32.253335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:32.253335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:32.253335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:32.253335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:32.253335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:32.253335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:32.253335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:32.253335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:32.254454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:32.254454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:32.254454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:32.254454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:32.254454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:32.254454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:32.254454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:32.254454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:32.254454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:32.254454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:32.254454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:32.254454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:32.254454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 155/306] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:32.261511 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1debca-0b51-472c-8907-5e2b4f5ce7ce None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:32.286303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:32.310623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfffd6e-ace8-4ec6-a286-ef2b63c578d2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:32.353458 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a71610-e382-47db-8716-a69d80c49ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:32.354329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71610-e382-47db-8716-a69d80c49ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:32.354695 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71610-e382-47db-8716-a69d80c49ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:32.355062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71610-e382-47db-8716-a69d80c49ff9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:32.356419 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a71610-e382-47db-8716-a69d80c49ff9 None admin] RBAC: Adding query filter params (role.id=83b821ffac7d4dbdb849c13f1dbd4ead, user.id=20334b34131842aeba3ef88718735440, scope.system=all) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:32.356919 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a71610-e382-47db-8716-a69d80c49ff9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:32.358910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a71610-e382-47db-8716-a69d80c49ff9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:32.365546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 152/307] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Jun 2 18:47:32 2022] GET /identity/v3/role_assignments?user.id=20334b34131842aeba3ef88718735440&scope.system=all&role.id=83b821ffac7d4dbdb849c13f1dbd4ead => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:32.383133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1debca-0b51-472c-8907-5e2b4f5ce7ce None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:32.422386 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dae4ef-202c-4aa2-bdb9-033b6b7d5e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:32.423069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dae4ef-202c-4aa2-bdb9-033b6b7d5e85 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:32.423390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dae4ef-202c-4aa2-bdb9-033b6b7d5e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:32.423661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dae4ef-202c-4aa2-bdb9-033b6b7d5e85 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:32.424414 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dae4ef-202c-4aa2-bdb9-033b6b7d5e85 None admin] RBAC: Adding query filter params (name=member) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:32.424717 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dae4ef-202c-4aa2-bdb9-033b6b7d5e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:32.426268 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dae4ef-202c-4aa2-bdb9-033b6b7d5e85 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:32.436421 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 156/308] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:32.442717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a71610-e382-47db-8716-a69d80c49ff9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:32.530183 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983bba9-859a-4109-b7a0-613186da07df None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:32.531148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983bba9-859a-4109-b7a0-613186da07df None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:32.531647 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983bba9-859a-4109-b7a0-613186da07df None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:32.537854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 157/309] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:47:32.540414 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae8e9c-ee76-4941-bbc5-db7ee771997f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:32.540709 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae8e9c-ee76-4941-bbc5-db7ee771997f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:32.540984 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae8e9c-ee76-4941-bbc5-db7ee771997f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:32.555751 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:32.559133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4aae8e9c-ee76-4941-bbc5-db7ee771997f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:32.560224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a71610-e382-47db-8716-a69d80c49ff9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:32.560495 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4aae8e9c-ee76-4941-bbc5-db7ee771997f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:32.611514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4dad0-9c4d-475c-9fd3-46e3697a56b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:32.612548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4dad0-9c4d-475c-9fd3-46e3697a56b1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:32.612797 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4dad0-9c4d-475c-9fd3-46e3697a56b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:32.613078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4dad0-9c4d-475c-9fd3-46e3697a56b1 None admin] PATH_INFO: `/v3/users/cdc87d7a4fd94fe2b7593e9145fcbfc9` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:32.614638 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4dad0-9c4d-475c-9fd3-46e3697a56b1 None admin] RBAC: Authorizing `identity:get_user(user_id=cdc87d7a4fd94fe2b7593e9145fcbfc9)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:32.615895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4dad0-9c4d-475c-9fd3-46e3697a56b1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:32.617958 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 153/310] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:32 2022] GET /identity/v3/users/cdc87d7a4fd94fe2b7593e9145fcbfc9 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:32.624353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4dad0-9c4d-475c-9fd3-46e3697a56b1 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:32.657349 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 158/311] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:32.680067 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae8e9c-ee76-4941-bbc5-db7ee771997f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:32.690079 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:32.748495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4dad0-9c4d-475c-9fd3-46e3697a56b1 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:32.786023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2203a-94d8-48ac-808c-0727988f069e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:32.787346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2203a-94d8-48ac-808c-0727988f069e None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:32.787834 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2203a-94d8-48ac-808c-0727988f069e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:32.788351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2203a-94d8-48ac-808c-0727988f069e None admin] PATH_INFO: `/v3/system/users/cdc87d7a4fd94fe2b7593e9145fcbfc9/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:32.790051 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2203a-94d8-48ac-808c-0727988f069e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cdc87d7a4fd94fe2b7593e9145fcbfc9, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:32.791717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2203a-94d8-48ac-808c-0727988f069e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:32.803768 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 154/312] 10.222.0.15 () {58 vars in 1334 bytes} [Thu Jun 2 18:47:32 2022] PUT /identity/v3/system/users/cdc87d7a4fd94fe2b7593e9145fcbfc9/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:47:32.806222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae8e9c-ee76-4941-bbc5-db7ee771997f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:32.850981 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6be53-7785-4bbe-a9e3-c57356f819e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:32.852192 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6be53-7785-4bbe-a9e3-c57356f819e6 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:32.852670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6be53-7785-4bbe-a9e3-c57356f819e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:32.853137 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6be53-7785-4bbe-a9e3-c57356f819e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:32.866389 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6be53-7785-4bbe-a9e3-c57356f819e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:32.875042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-35b6be53-7785-4bbe-a9e3-c57356f819e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 18:47:32.875042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:32.875042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:32.875042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:32.875042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:32.875042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:32.875042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:32.875042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:32.875042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:32.875042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:32.875042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:32.875042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:32.875042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:32.875042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:32.875042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:32.875042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:32.876841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:32.876841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:32.876841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:32.876841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:32.876841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:32.876841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:32.876841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:32.876841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:32.876841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:32.876841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:32.876841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:32.876841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:32.876841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:32.876841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:32.876841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:32.876841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:32.877635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:32.877635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:32.877635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:32.877635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:32.877635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:32.877635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:32.877635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:32.877635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:32.877635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:32.877635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:32.877635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 18:47:32.877635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:32.880639 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 159/313] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:47:32.887035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2203a-94d8-48ac-808c-0727988f069e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:32.924791 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:33.002752 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2203a-94d8-48ac-808c-0727988f069e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:33.041172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b80d0-6a30-463b-a196-0c29bf6b18a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:33.042367 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b80d0-6a30-463b-a196-0c29bf6b18a7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:33.042968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b80d0-6a30-463b-a196-0c29bf6b18a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:33.043488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b80d0-6a30-463b-a196-0c29bf6b18a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:33.044489 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b80d0-6a30-463b-a196-0c29bf6b18a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:33.045166 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b80d0-6a30-463b-a196-0c29bf6b18a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:33.046824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b80d0-6a30-463b-a196-0c29bf6b18a7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:33.055791 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 155/314] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:33.061506 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6be53-7785-4bbe-a9e3-c57356f819e6 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:33.133642 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:33.171576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6be53-7785-4bbe-a9e3-c57356f819e6 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:33.206708 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27323aff-c23d-4e1f-9f92-ea9a02a68477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:33.207633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27323aff-c23d-4e1f-9f92-ea9a02a68477 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:33.208255 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27323aff-c23d-4e1f-9f92-ea9a02a68477 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:33.208533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27323aff-c23d-4e1f-9f92-ea9a02a68477 None admin] PATH_INFO: `/v3/users/ff2b12c279d4494ab425b81cf61bb13c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:33.209904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27323aff-c23d-4e1f-9f92-ea9a02a68477 None admin] RBAC: Authorizing `identity:get_user(user_id=ff2b12c279d4494ab425b81cf61bb13c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:33.211399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27323aff-c23d-4e1f-9f92-ea9a02a68477 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:33.213487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 160/315] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:33 2022] GET /identity/v3/users/ff2b12c279d4494ab425b81cf61bb13c => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:33.219483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b80d0-6a30-463b-a196-0c29bf6b18a7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:33.315612 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:33.330136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b80d0-6a30-463b-a196-0c29bf6b18a7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:33.365743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055ef7c-bda4-4c47-aca1-1f09541242ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:33.366463 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055ef7c-bda4-4c47-aca1-1f09541242ca None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:33.366747 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055ef7c-bda4-4c47-aca1-1f09541242ca None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:33.367024 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055ef7c-bda4-4c47-aca1-1f09541242ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:33.435780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055ef7c-bda4-4c47-aca1-1f09541242ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:33.437275 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055ef7c-bda4-4c47-aca1-1f09541242ca None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:33.537397 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:33.541732 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 156/316] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:33.542690 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27323aff-c23d-4e1f-9f92-ea9a02a68477 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:33.650831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27323aff-c23d-4e1f-9f92-ea9a02a68477 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:33.685560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9201b-a5a6-489e-829d-0ec248dc6e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:33.686761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9201b-a5a6-489e-829d-0ec248dc6e78 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:33.687229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9201b-a5a6-489e-829d-0ec248dc6e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:33.687686 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9201b-a5a6-489e-829d-0ec248dc6e78 None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:33.689044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9201b-a5a6-489e-829d-0ec248dc6e78 None admin] RBAC: Authorizing `identity:get_project(project_id=32a6d4fba36a446bb95799ce1b96d071)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:33.690701 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9201b-a5a6-489e-829d-0ec248dc6e78 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:33.692886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 161/317] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:33 2022] GET /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:33.698896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055ef7c-bda4-4c47-aca1-1f09541242ca None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:33.803709 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055ef7c-bda4-4c47-aca1-1f09541242ca None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:33.839299 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e0601-ee26-4f6d-9914-1129aec30f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:33.840298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e0601-ee26-4f6d-9914-1129aec30f66 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:33.840765 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e0601-ee26-4f6d-9914-1129aec30f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:33.841281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e0601-ee26-4f6d-9914-1129aec30f66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:33.842402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e0601-ee26-4f6d-9914-1129aec30f66 None admin] RBAC: Adding query filter params (role.id=83b821ffac7d4dbdb849c13f1dbd4ead, scope.project.id=32a6d4fba36a446bb95799ce1b96d071, user.id=ff2b12c279d4494ab425b81cf61bb13c) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:33.842894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e0601-ee26-4f6d-9914-1129aec30f66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:33.844507 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e0601-ee26-4f6d-9914-1129aec30f66 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:33.850753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 157/318] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:47:33 2022] GET /identity/v3/role_assignments?user.id=ff2b12c279d4494ab425b81cf61bb13c&scope.project.id=32a6d4fba36a446bb95799ce1b96d071&role.id=83b821ffac7d4dbdb849c13f1dbd4ead => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:34.428212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefa2b5-9e08-40c6-b703-974a013f5466 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:34.428464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefa2b5-9e08-40c6-b703-974a013f5466 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:34.428756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefa2b5-9e08-40c6-b703-974a013f5466 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:34.430328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 162/319] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:34.435868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e1d90-1ecb-44e8-9f3a-3b0e1474e8db None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:34.436368 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e1d90-1ecb-44e8-9f3a-3b0e1474e8db None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:34.436368 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e1d90-1ecb-44e8-9f3a-3b0e1474e8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:34.453836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4e5e1d90-1ecb-44e8-9f3a-3b0e1474e8db None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:34.455016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4e5e1d90-1ecb-44e8-9f3a-3b0e1474e8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:34.512232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:34.533968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 158/320] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:34.552243 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefa2b5-9e08-40c6-b703-974a013f5466 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:34.555788 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:34.661356 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefa2b5-9e08-40c6-b703-974a013f5466 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:34.697162 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499ee58-6d79-4c49-84c3-044639b181dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:34.697908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499ee58-6d79-4c49-84c3-044639b181dc None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:34.698185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499ee58-6d79-4c49-84c3-044639b181dc None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:34.698453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499ee58-6d79-4c49-84c3-044639b181dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:34.699612 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499ee58-6d79-4c49-84c3-044639b181dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:34.701297 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499ee58-6d79-4c49-84c3-044639b181dc None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:34.703132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 163/321] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:47:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:34.708995 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e1d90-1ecb-44e8-9f3a-3b0e1474e8db None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:34.740422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31a6d1-6971-4ba3-8687-b1a84af2bbd7 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:34.741281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31a6d1-6971-4ba3-8687-b1a84af2bbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:34.741729 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31a6d1-6971-4ba3-8687-b1a84af2bbd7 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:34.744188 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 164/322] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:34.749561 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0fde1-2ac6-4624-aa8e-101ec463081b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:34.750086 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0fde1-2ac6-4624-aa8e-101ec463081b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:34.750529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0fde1-2ac6-4624-aa8e-101ec463081b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:34.772097 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-40e0fde1-2ac6-4624-aa8e-101ec463081b None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:34.773312 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-40e0fde1-2ac6-4624-aa8e-101ec463081b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:34.819730 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e1d90-1ecb-44e8-9f3a-3b0e1474e8db None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:34.841854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:34.847597 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 165/323] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:34.862434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9d811-fc67-49f8-b8ef-4ca9816cdd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:34.863115 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9d811-fc67-49f8-b8ef-4ca9816cdd6d None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:34.863394 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9d811-fc67-49f8-b8ef-4ca9816cdd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:34.863668 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9d811-fc67-49f8-b8ef-4ca9816cdd6d None admin] PATH_INFO: `/v3/groups` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:34.864359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9d811-fc67-49f8-b8ef-4ca9816cdd6d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:34.865872 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9d811-fc67-49f8-b8ef-4ca9816cdd6d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:34.869533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0fde1-2ac6-4624-aa8e-101ec463081b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:34.893827 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 159/324] 10.222.0.15 () {60 vars in 1134 bytes} [Thu Jun 2 18:47:34 2022] POST /identity/v3/groups => generated 226 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:47:34.990251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0fde1-2ac6-4624-aa8e-101ec463081b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:35.026751 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f2343-44e8-47b9-8e34-682f0c28629e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:35.027569 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f2343-44e8-47b9-8e34-682f0c28629e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:35.027844 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f2343-44e8-47b9-8e34-682f0c28629e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:35.028109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f2343-44e8-47b9-8e34-682f0c28629e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:35.039882 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f2343-44e8-47b9-8e34-682f0c28629e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:35.048007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-284f2343-44e8-47b9-8e34-682f0c28629e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 18:47:35.048007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:35.048007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:35.048007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:35.048007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:35.048007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:35.048007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:35.048007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:35.048007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:35.048007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:35.048007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:35.048007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:35.048007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:35.048007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:35.048007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:35.048007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:35.049084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:35.049084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:35.049084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:35.049084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:35.049084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:35.049084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:35.049084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:35.049084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:35.049084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:35.049084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:35.049084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:35.049084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:35.049084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:35.049084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:35.049084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:35.049084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:35.049943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:35.049943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:35.049943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:35.049943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:35.049943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:35.049943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:35.049943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:35.049943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:35.049943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:35.049943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:35.049943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 18:47:35.049943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:35.055693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 166/325] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:47:35.055896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9d811-fc67-49f8-b8ef-4ca9816cdd6d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:35.111558 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:35.134372 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c456a-3841-46b9-97f6-06da22661eb0 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:35.134888 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c456a-3841-46b9-97f6-06da22661eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:35.135166 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c456a-3841-46b9-97f6-06da22661eb0 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:35.136695 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 167/326] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:35.142485 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e74d4-f43b-42fe-8f6c-396ff3b45313 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:35.142762 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e74d4-f43b-42fe-8f6c-396ff3b45313 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:35.143035 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e74d4-f43b-42fe-8f6c-396ff3b45313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:35.163198 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ac4e74d4-f43b-42fe-8f6c-396ff3b45313 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:35.164392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ac4e74d4-f43b-42fe-8f6c-396ff3b45313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:35.171939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9d811-fc67-49f8-b8ef-4ca9816cdd6d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:35.218338 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecdb3b-9cb9-40ee-8305-0413762e4c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:35.219042 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecdb3b-9cb9-40ee-8305-0413762e4c85 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:35.219320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecdb3b-9cb9-40ee-8305-0413762e4c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:35.219961 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecdb3b-9cb9-40ee-8305-0413762e4c85 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:35.220725 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecdb3b-9cb9-40ee-8305-0413762e4c85 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:35.221035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecdb3b-9cb9-40ee-8305-0413762e4c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:35.222539 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecdb3b-9cb9-40ee-8305-0413762e4c85 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:35.235248 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 160/327] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:35.238800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:35.241060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecdb3b-9cb9-40ee-8305-0413762e4c85 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:35.251839 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 168/328] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:35.275567 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e74d4-f43b-42fe-8f6c-396ff3b45313 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:35.370138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecdb3b-9cb9-40ee-8305-0413762e4c85 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:35.385153 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:35.401653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e74d4-f43b-42fe-8f6c-396ff3b45313 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:35.419585 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0864783-9a60-4a2a-a221-c3e4b24173fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:35.420755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0864783-9a60-4a2a-a221-c3e4b24173fc None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:35.421035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0864783-9a60-4a2a-a221-c3e4b24173fc None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:35.421482 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0864783-9a60-4a2a-a221-c3e4b24173fc None admin] PATH_INFO: `/v3/users/20334b34131842aeba3ef88718735440` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:35.423067 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0864783-9a60-4a2a-a221-c3e4b24173fc None admin] RBAC: Authorizing `identity:get_user(user_id=20334b34131842aeba3ef88718735440)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:35.424581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0864783-9a60-4a2a-a221-c3e4b24173fc None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:35.430585 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 161/329] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:35 2022] GET /identity/v3/users/20334b34131842aeba3ef88718735440 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:35.433311 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0864783-9a60-4a2a-a221-c3e4b24173fc None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:35.445500 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7be9f3-197b-4325-b7a3-85e8ce7d616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:35.446353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be9f3-197b-4325-b7a3-85e8ce7d616c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:35.446988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be9f3-197b-4325-b7a3-85e8ce7d616c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:35.447263 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be9f3-197b-4325-b7a3-85e8ce7d616c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:35.460292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7be9f3-197b-4325-b7a3-85e8ce7d616c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:35.469180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-5f7be9f3-197b-4325-b7a3-85e8ce7d616c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:35.469180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:35.469180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:35.469180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:35.469180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:35.469180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:35.469180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:35.469180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:35.469180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:35.469180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:35.469180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:35.469180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:35.469180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:35.469180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:35.469180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:35.469180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:35.470148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:35.470148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:35.470148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:35.470148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:35.470148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:35.470148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:35.470148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:35.470148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:35.470148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:35.470148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:35.470148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:35.470148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:35.470148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:35.470148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:35.470148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:35.470148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:35.470917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:35.470917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:35.470917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:35.470917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:35.470917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:35.470917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:35.470917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:35.470917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:35.470917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:35.470917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:35.470917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:35.470917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:35.475546 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 169/330] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:47:35.476781 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7be9f3-197b-4325-b7a3-85e8ce7d616c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:35.538581 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:35.568839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0864783-9a60-4a2a-a221-c3e4b24173fc None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:35.603674 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7be9f3-197b-4325-b7a3-85e8ce7d616c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:35.617673 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c16691-8774-48df-8f11-09f680045901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:35.619188 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c16691-8774-48df-8f11-09f680045901 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:35.620118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c16691-8774-48df-8f11-09f680045901 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:35.620598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c16691-8774-48df-8f11-09f680045901 None admin] PATH_INFO: `/v3/system/users/20334b34131842aeba3ef88718735440/roles/83b821ffac7d4dbdb849c13f1dbd4ead` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:35.622875 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c16691-8774-48df-8f11-09f680045901 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=20334b34131842aeba3ef88718735440, role_id=83b821ffac7d4dbdb849c13f1dbd4ead)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:35.624899 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c16691-8774-48df-8f11-09f680045901 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:35.639866 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 162/331] 10.222.0.15 () {58 vars in 1334 bytes} [Thu Jun 2 18:47:35 2022] PUT /identity/v3/system/users/20334b34131842aeba3ef88718735440/roles/83b821ffac7d4dbdb849c13f1dbd4ead => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:47:35.647682 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63382b2-daec-4ef2-b410-7f434991eb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:35.648442 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63382b2-daec-4ef2-b410-7f434991eb6b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:35.648727 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63382b2-daec-4ef2-b410-7f434991eb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:35.649009 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63382b2-daec-4ef2-b410-7f434991eb6b None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:35.650569 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63382b2-daec-4ef2-b410-7f434991eb6b None admin] RBAC: Adding query filter params (name=member) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:35.650905 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63382b2-daec-4ef2-b410-7f434991eb6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:35.652365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63382b2-daec-4ef2-b410-7f434991eb6b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:35.666825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 170/332] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:35.669068 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c16691-8774-48df-8f11-09f680045901 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:35.729176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:35.803618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c16691-8774-48df-8f11-09f680045901 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:35.847918 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d6124-8dea-4d1d-b391-9811454a699d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:35.848846 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d6124-8dea-4d1d-b391-9811454a699d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:35.849115 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d6124-8dea-4d1d-b391-9811454a699d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:35.849387 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d6124-8dea-4d1d-b391-9811454a699d None admin] PATH_INFO: `/v3/users/cdc87d7a4fd94fe2b7593e9145fcbfc9` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:35.850690 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d6124-8dea-4d1d-b391-9811454a699d None admin] RBAC: Authorizing `identity:get_user(user_id=cdc87d7a4fd94fe2b7593e9145fcbfc9)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:35.852177 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d6124-8dea-4d1d-b391-9811454a699d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:35.854248 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 163/333] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:35 2022] GET /identity/v3/users/cdc87d7a4fd94fe2b7593e9145fcbfc9 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:35.860542 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63382b2-daec-4ef2-b410-7f434991eb6b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:35.992437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63382b2-daec-4ef2-b410-7f434991eb6b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:36.007514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:36.038568 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116a5dd-8896-40b0-bbcc-cfd83bdd5634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:36.039298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116a5dd-8896-40b0-bbcc-cfd83bdd5634 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:36.039583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116a5dd-8896-40b0-bbcc-cfd83bdd5634 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:36.039851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116a5dd-8896-40b0-bbcc-cfd83bdd5634 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:36.040700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116a5dd-8896-40b0-bbcc-cfd83bdd5634 None admin] RBAC: Adding query filter params (role.id=3e320079a5ce471e863ad87a36be46b1, user.id=cdc87d7a4fd94fe2b7593e9145fcbfc9, scope.system=all) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:36.041008 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116a5dd-8896-40b0-bbcc-cfd83bdd5634 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:36.042527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116a5dd-8896-40b0-bbcc-cfd83bdd5634 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:36.056232 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 171/334] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Jun 2 18:47:35 2022] GET /identity/v3/role_assignments?user.id=cdc87d7a4fd94fe2b7593e9145fcbfc9&scope.system=all&role.id=3e320079a5ce471e863ad87a36be46b1 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:37.874978 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67db7b-2e97-42c0-83f9-0b1f3efcd00f None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:37.886427 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67db7b-2e97-42c0-83f9-0b1f3efcd00f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:37.886427 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67db7b-2e97-42c0-83f9-0b1f3efcd00f None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:37.886427 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 164/335] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:37.886684 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf6733-d240-420d-b632-16f134bba328 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:37.886684 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf6733-d240-420d-b632-16f134bba328 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:37.886684 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf6733-d240-420d-b632-16f134bba328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:37.902019 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-99bf6733-d240-420d-b632-16f134bba328 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:37.903225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-99bf6733-d240-420d-b632-16f134bba328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:37.976076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 172/336] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:38.000364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67db7b-2e97-42c0-83f9-0b1f3efcd00f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:38.071806 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835e280-5539-428c-b3a9-2bfe05b16ff3 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:38.072152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835e280-5539-428c-b3a9-2bfe05b16ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:38.072350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835e280-5539-428c-b3a9-2bfe05b16ff3 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:38.073943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 173/337] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:47:38.079806 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9137ebd-1c31-496b-9288-c71487b8a0e0 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:38.080084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9137ebd-1c31-496b-9288-c71487b8a0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:38.080354 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9137ebd-1c31-496b-9288-c71487b8a0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:38.111690 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e9137ebd-1c31-496b-9288-c71487b8a0e0 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:38.112927 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e9137ebd-1c31-496b-9288-c71487b8a0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:38.175179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67db7b-2e97-42c0-83f9-0b1f3efcd00f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:38.194198 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:38.239149 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f9a10-c0d2-49e3-a740-18be77b50149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:38.240451 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f9a10-c0d2-49e3-a740-18be77b50149 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:38.240930 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f9a10-c0d2-49e3-a740-18be77b50149 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:38.241405 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f9a10-c0d2-49e3-a740-18be77b50149 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:38.248778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 174/338] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:47:38.270774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f9a10-c0d2-49e3-a740-18be77b50149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:38.283544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-bb2f9a10-c0d2-49e3-a740-18be77b50149 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:38.283544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:38.283544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:38.283544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:38.283544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:38.283544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:38.283544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:38.283544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:38.283544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:38.283544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:38.283544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:38.283544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:38.283544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:38.283544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:38.283544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:38.283544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:38.284514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:38.284514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:38.284514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:38.284514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:38.284514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:38.284514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:38.284514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:38.284514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:38.284514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:38.284514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:38.284514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:38.284514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:38.284514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:38.284514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:38.284514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:38.284514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:38.285343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:38.285343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:38.285343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:38.285343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:38.285343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:38.285343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:38.285343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:38.285343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:38.285343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:38.285343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:38.285343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:38.285343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:38.287804 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 165/339] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:47:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:38.293852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9137ebd-1c31-496b-9288-c71487b8a0e0 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:38.301162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f9a10-c0d2-49e3-a740-18be77b50149 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:38.338205 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:38.433898 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9137ebd-1c31-496b-9288-c71487b8a0e0 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:38.485532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ce989-2dc9-44ae-9266-c0958ad8f064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:38.486243 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ce989-2dc9-44ae-9266-c0958ad8f064 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:38.486794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ce989-2dc9-44ae-9266-c0958ad8f064 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:38.487130 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ce989-2dc9-44ae-9266-c0958ad8f064 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:38.488857 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ce989-2dc9-44ae-9266-c0958ad8f064 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:38.489171 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ce989-2dc9-44ae-9266-c0958ad8f064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:38.490603 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ce989-2dc9-44ae-9266-c0958ad8f064 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:38.504600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 175/340] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:47:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:38.510127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ce989-2dc9-44ae-9266-c0958ad8f064 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:38.585215 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f9a10-c0d2-49e3-a740-18be77b50149 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:38.622692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:38.632988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ce989-2dc9-44ae-9266-c0958ad8f064 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:38.659992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a5a6d-95be-4cac-bc44-7a5321848edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:38.660948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a5a6d-95be-4cac-bc44-7a5321848edc None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:38.661302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a5a6d-95be-4cac-bc44-7a5321848edc None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:38.661617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a5a6d-95be-4cac-bc44-7a5321848edc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:38.674878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935edaa7-862b-4821-9252-c645dd9ef3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:38.675761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935edaa7-862b-4821-9252-c645dd9ef3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:38.676930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935edaa7-862b-4821-9252-c645dd9ef3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:38.677339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935edaa7-862b-4821-9252-c645dd9ef3c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:38.691840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a5a6d-95be-4cac-bc44-7a5321848edc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:38.706984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-0a6a5a6d-95be-4cac-bc44-7a5321848edc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:38.706984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:38.706984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:38.706984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:38.706984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:38.706984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:38.706984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:38.706984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:38.706984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:38.706984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:38.706984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:38.706984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:38.706984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:38.706984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:38.706984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:38.706984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:38.708472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:38.708472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:38.708472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:38.708472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:38.708472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:38.708472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:38.708472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:38.708472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:38.708472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:38.708472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:38.708472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:38.708472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:38.708472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:38.708472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:38.708472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:38.708472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:38.709325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:38.709325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:38.709325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:38.709325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:38.709325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:38.709325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:38.709325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:38.709325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:38.709325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:38.709325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:38.709325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:38.709325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:38.711449 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 166/341] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:38.714251 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b016f9-f284-498e-8eca-7f43863f3426 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:38.717146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b016f9-f284-498e-8eca-7f43863f3426 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:38.718776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b016f9-f284-498e-8eca-7f43863f3426 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:38.724815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 167/342] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:38.726914 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b016f9-f284-498e-8eca-7f43863f3426 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:38.798062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:38.813206 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935edaa7-862b-4821-9252-c645dd9ef3c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:38.814956 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935edaa7-862b-4821-9252-c645dd9ef3c1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:38.903644 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b016f9-f284-498e-8eca-7f43863f3426 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:38.917001 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:38.934490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 176/343] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 18:47:38.936083 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81ba48-9cac-4077-a732-1a8e92b2d4c3 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:38.936521 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81ba48-9cac-4077-a732-1a8e92b2d4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:38.936936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81ba48-9cac-4077-a732-1a8e92b2d4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:38.955112 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bbad1-a081-43b5-bdf8-3712ac357f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:38.955901 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bbad1-a081-43b5-bdf8-3712ac357f83 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:38.956027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bbad1-a081-43b5-bdf8-3712ac357f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:38.961819 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bbad1-a081-43b5-bdf8-3712ac357f83 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:38.961819 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bbad1-a081-43b5-bdf8-3712ac357f83 None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:38.961819 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bbad1-a081-43b5-bdf8-3712ac357f83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:38.961819 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bbad1-a081-43b5-bdf8-3712ac357f83 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:38.970807 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-eb81ba48-9cac-4077-a732-1a8e92b2d4c3 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:38.971780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 168/344] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:38.972529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bbad1-a081-43b5-bdf8-3712ac357f83 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:38.972825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-eb81ba48-9cac-4077-a732-1a8e92b2d4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:39.074181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:39.080375 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bbad1-a081-43b5-bdf8-3712ac357f83 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:39.087462 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 177/345] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:39.088538 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81ba48-9cac-4077-a732-1a8e92b2d4c3 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:39.116874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a4a1e-f0cd-4b7f-bb6d-c8f8b87213c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:39.117861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a4a1e-f0cd-4b7f-bb6d-c8f8b87213c2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:39.125838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a4a1e-f0cd-4b7f-bb6d-c8f8b87213c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:39.125838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a4a1e-f0cd-4b7f-bb6d-c8f8b87213c2 None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:39.126984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a4a1e-f0cd-4b7f-bb6d-c8f8b87213c2 None admin] RBAC: Authorizing `identity:get_project(project_id=cb94aac4115444f781367f00674d4de8)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:39.128724 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a4a1e-f0cd-4b7f-bb6d-c8f8b87213c2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:39.130993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 169/346] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:38 2022] GET /identity/v3/projects/cb94aac4115444f781367f00674d4de8 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:39.136605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a4a1e-f0cd-4b7f-bb6d-c8f8b87213c2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:39.237917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81ba48-9cac-4077-a732-1a8e92b2d4c3 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:39.253515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a4a1e-f0cd-4b7f-bb6d-c8f8b87213c2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:39.268199 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:39.284340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a03190-9287-4c63-93f7-16787276ca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:39.285005 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a03190-9287-4c63-93f7-16787276ca08 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:39.285387 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a03190-9287-4c63-93f7-16787276ca08 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:39.285666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a03190-9287-4c63-93f7-16787276ca08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:39.290988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4f273-2fb3-4766-953b-7a1d3572d67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:39.291926 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4f273-2fb3-4766-953b-7a1d3572d67c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:39.292209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4f273-2fb3-4766-953b-7a1d3572d67c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:39.292535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4f273-2fb3-4766-953b-7a1d3572d67c None admin] PATH_INFO: `/v3/groups/cdb07e9a184d4da5a24c67c0975309b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:39.300110 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4f273-2fb3-4766-953b-7a1d3572d67c None admin] RBAC: Authorizing `identity:get_group(group_id=cdb07e9a184d4da5a24c67c0975309b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:39.301641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4f273-2fb3-4766-953b-7a1d3572d67c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:39.303689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 170/347] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 2 18:47:39 2022] GET /identity/v3/groups/cdb07e9a184d4da5a24c67c0975309b1 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:39.304523 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4f273-2fb3-4766-953b-7a1d3572d67c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:39.342177 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:39.389869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a03190-9287-4c63-93f7-16787276ca08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:39.395396 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a03190-9287-4c63-93f7-16787276ca08 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:39.415689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4f273-2fb3-4766-953b-7a1d3572d67c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:39.450749 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43fa4a-8d2b-4c7a-904c-8d010195898a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:39.451565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43fa4a-8d2b-4c7a-904c-8d010195898a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:39.451845 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43fa4a-8d2b-4c7a-904c-8d010195898a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:39.452120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43fa4a-8d2b-4c7a-904c-8d010195898a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:39.463283 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43fa4a-8d2b-4c7a-904c-8d010195898a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:39.471438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-fa43fa4a-8d2b-4c7a-904c-8d010195898a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:39.471438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:39.471438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:39.471438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:39.471438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:39.471438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:39.471438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:39.471438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:39.471438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:39.471438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:39.471438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:39.471438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:39.471438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:39.471438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:39.471438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:39.471438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:39.472364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:39.472364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:39.472364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:39.472364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:39.472364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:39.472364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:39.472364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:39.472364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:39.472364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:39.472364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:39.472364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:39.472364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:39.472364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:39.472364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:39.472364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:39.472364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:39.473569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:39.473569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:39.473569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:39.473569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:39.473569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:39.473569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:39.473569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:39.473569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:39.473569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:39.473569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:39.473569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:39.473569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:39.473569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 171/348] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:39.473569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43fa4a-8d2b-4c7a-904c-8d010195898a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:39.545967 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 178/349] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:39.547227 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a03190-9287-4c63-93f7-16787276ca08 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:39.581696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:39.591243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43fa4a-8d2b-4c7a-904c-8d010195898a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:39.596707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:39.630432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3d892-9736-4d23-85df-4340e6f13915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:39.631103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3d892-9736-4d23-85df-4340e6f13915 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:39.631392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3d892-9736-4d23-85df-4340e6f13915 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:39.631668 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3d892-9736-4d23-85df-4340e6f13915 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:39.632510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3d892-9736-4d23-85df-4340e6f13915 None admin] RBAC: Adding query filter params (group.id=cdb07e9a184d4da5a24c67c0975309b1, role.id=1ecbde8dcaa44047899f618334033d43, scope.project.id=cb94aac4115444f781367f00674d4de8) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:39.632821 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3d892-9736-4d23-85df-4340e6f13915 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:39.634324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3d892-9736-4d23-85df-4340e6f13915 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:39.640880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 172/350] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 2 18:47:39 2022] GET /identity/v3/role_assignments?group.id=cdb07e9a184d4da5a24c67c0975309b1&scope.project.id=cb94aac4115444f781367f00674d4de8&role.id=1ecbde8dcaa44047899f618334033d43 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:39.641599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3d892-9736-4d23-85df-4340e6f13915 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:39.683202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a03190-9287-4c63-93f7-16787276ca08 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:39.726234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343af22b-41ed-4b49-83cb-f6362d19c8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:39.728555 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343af22b-41ed-4b49-83cb-f6362d19c8fb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:39.729127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343af22b-41ed-4b49-83cb-f6362d19c8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:39.729579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343af22b-41ed-4b49-83cb-f6362d19c8fb None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:39.730593 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343af22b-41ed-4b49-83cb-f6362d19c8fb None admin] RBAC: Adding query filter params (name=member) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:39.731074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343af22b-41ed-4b49-83cb-f6362d19c8fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:39.733153 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343af22b-41ed-4b49-83cb-f6362d19c8fb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:39.743417 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 179/351] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:39.745247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f2e85-6aa4-486a-b71d-00e04fba0c24 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:39.745713 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f2e85-6aa4-486a-b71d-00e04fba0c24 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:39.746168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f2e85-6aa4-486a-b71d-00e04fba0c24 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:39.748065 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 180/352] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:39.749536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce969d31-514e-47f9-9349-f3b95259028f None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:39.750005 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce969d31-514e-47f9-9349-f3b95259028f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:39.750442 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce969d31-514e-47f9-9349-f3b95259028f None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:39.752076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 181/353] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:39.753108 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce969d31-514e-47f9-9349-f3b95259028f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:39.793547 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3d892-9736-4d23-85df-4340e6f13915 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:39.834106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a31b93-0090-4c9d-8c0a-584e9cda6d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:39.835045 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a31b93-0090-4c9d-8c0a-584e9cda6d3c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:39.835376 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a31b93-0090-4c9d-8c0a-584e9cda6d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:39.835649 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a31b93-0090-4c9d-8c0a-584e9cda6d3c None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:39.836880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a31b93-0090-4c9d-8c0a-584e9cda6d3c None admin] RBAC: Authorizing `identity:get_project(project_id=cb94aac4115444f781367f00674d4de8)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:39.838570 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a31b93-0090-4c9d-8c0a-584e9cda6d3c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:39.840608 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 173/354] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:39 2022] GET /identity/v3/projects/cb94aac4115444f781367f00674d4de8 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:39.846300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8a4a8-5619-4d52-9497-cf237a0e3674 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:39.846612 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8a4a8-5619-4d52-9497-cf237a0e3674 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:39.846885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8a4a8-5619-4d52-9497-cf237a0e3674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:39.866583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:39.866785 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-87f8a4a8-5619-4d52-9497-cf237a0e3674 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:39.868095 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-87f8a4a8-5619-4d52-9497-cf237a0e3674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:39.880304 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce969d31-514e-47f9-9349-f3b95259028f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:39.883588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:39.923831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c68674-6f79-447e-8a1d-fa458f5e29c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:39.925276 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c68674-6f79-447e-8a1d-fa458f5e29c8 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:39.925782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c68674-6f79-447e-8a1d-fa458f5e29c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:39.926277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c68674-6f79-447e-8a1d-fa458f5e29c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:39.949454 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 174/355] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:39.951084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55617d95-29af-45cb-a78c-04a43d280731 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:39.951324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55617d95-29af-45cb-a78c-04a43d280731 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:39.951655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55617d95-29af-45cb-a78c-04a43d280731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:39.970300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-55617d95-29af-45cb-a78c-04a43d280731 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:39.971405 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-55617d95-29af-45cb-a78c-04a43d280731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:40.004886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c68674-6f79-447e-8a1d-fa458f5e29c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:40.006801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c68674-6f79-447e-8a1d-fa458f5e29c8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:40.044664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 175/356] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:40.044958 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55617d95-29af-45cb-a78c-04a43d280731 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:40.100723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:40.124810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 182/357] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:40.126727 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c68674-6f79-447e-8a1d-fa458f5e29c8 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:40.132255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:40.163092 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55617d95-29af-45cb-a78c-04a43d280731 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:40.199488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0beae-793b-4d29-b9d6-7fa1106797cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:40.200409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0beae-793b-4d29-b9d6-7fa1106797cf None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:40.200687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0beae-793b-4d29-b9d6-7fa1106797cf None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:40.201203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0beae-793b-4d29-b9d6-7fa1106797cf None admin] PATH_INFO: `/v3/groups/cdb07e9a184d4da5a24c67c0975309b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:40.203604 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0beae-793b-4d29-b9d6-7fa1106797cf None admin] RBAC: Authorizing `identity:get_group(group_id=cdb07e9a184d4da5a24c67c0975309b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:40.205172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0beae-793b-4d29-b9d6-7fa1106797cf None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:40.206946 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 176/358] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 2 18:47:40 2022] GET /identity/v3/groups/cdb07e9a184d4da5a24c67c0975309b1 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:40.207712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0beae-793b-4d29-b9d6-7fa1106797cf None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:40.252629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c68674-6f79-447e-8a1d-fa458f5e29c8 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:40.295946 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e5aba-5c2d-419b-afc8-aa478ebae5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:40.297379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e5aba-5c2d-419b-afc8-aa478ebae5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:40.297655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e5aba-5c2d-419b-afc8-aa478ebae5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:40.299395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e5aba-5c2d-419b-afc8-aa478ebae5b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:40.312373 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e5aba-5c2d-419b-afc8-aa478ebae5b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:40.324133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-0a5e5aba-5c2d-419b-afc8-aa478ebae5b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:40.324133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:40.324133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:40.324133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:40.324133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:40.324133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:40.324133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:40.324133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:40.324133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:40.324133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:40.324133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:40.324133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:40.324133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:40.324133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:40.324133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:40.324133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:40.325039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:40.325039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:40.325039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:40.325039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:40.325039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:40.325039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:40.325039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:40.325039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:40.325039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:40.325039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:40.325039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:40.325039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:40.325039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:40.325039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:40.325039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:40.325039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:40.326491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:40.326491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:40.326491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:40.326491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:40.326491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:40.326491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:40.326491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:40.326491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:40.326491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:40.326491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:40.326491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:40.326491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:40.326491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 183/359] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:47:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:40.327133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f5b64-91c7-48ad-83e2-6e2ef764822b None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:40.327402 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f5b64-91c7-48ad-83e2-6e2ef764822b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:40.328052 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f5b64-91c7-48ad-83e2-6e2ef764822b None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:40.329235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 184/360] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:40.333579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f5b64-91c7-48ad-83e2-6e2ef764822b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:40.343100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0beae-793b-4d29-b9d6-7fa1106797cf None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:40.385718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:40.389184 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbebbe2-eb6f-4d40-84de-307315b8e7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:40.390538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbebbe2-eb6f-4d40-84de-307315b8e7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:40.390998 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbebbe2-eb6f-4d40-84de-307315b8e7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:40.391449 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbebbe2-eb6f-4d40-84de-307315b8e7c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:40.405447 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbebbe2-eb6f-4d40-84de-307315b8e7c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:40.414880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-8cbebbe2-eb6f-4d40-84de-307315b8e7c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 18:47:40.414880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:40.414880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:40.414880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:40.414880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:40.414880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:40.414880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:40.414880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:40.414880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:40.414880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:40.414880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:40.414880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:40.414880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:40.414880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:40.414880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:40.414880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:40.415862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:40.415862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:40.415862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:40.415862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:40.415862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:40.415862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:40.415862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:40.415862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:40.415862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:40.415862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:40.415862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:40.415862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:40.415862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:40.415862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:40.415862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:40.415862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:40.416664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:40.416664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:40.416664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:40.416664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:40.416664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:40.416664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:40.416664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:40.416664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:40.416664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:40.416664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:40.416664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 18:47:40.416664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:40.421606 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 177/361] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:40.421606 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbebbe2-eb6f-4d40-84de-307315b8e7c8 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:40.425832 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:40.454204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f5b64-91c7-48ad-83e2-6e2ef764822b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:40.496960 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ca573-2ae6-4f6b-b376-a0c7651c8482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:40.498078 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ca573-2ae6-4f6b-b376-a0c7651c8482 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:40.498354 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ca573-2ae6-4f6b-b376-a0c7651c8482 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:40.498892 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ca573-2ae6-4f6b-b376-a0c7651c8482 None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:40.500384 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ca573-2ae6-4f6b-b376-a0c7651c8482 None admin] RBAC: Authorizing `identity:get_project(project_id=32a6d4fba36a446bb95799ce1b96d071)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:40.501887 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ca573-2ae6-4f6b-b376-a0c7651c8482 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:40.504340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 185/362] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:40 2022] GET /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:40.505052 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79f1b1-28df-4550-977b-87c76ff7e2f1 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:40.505331 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79f1b1-28df-4550-977b-87c76ff7e2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:40.505604 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79f1b1-28df-4550-977b-87c76ff7e2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:40.527953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4f79f1b1-28df-4550-977b-87c76ff7e2f1 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:40.529836 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4f79f1b1-28df-4550-977b-87c76ff7e2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:40.546930 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbebbe2-eb6f-4d40-84de-307315b8e7c8 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:40.590214 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1ac0b-48e7-404b-a3d6-491887e0b154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:40.591737 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1ac0b-48e7-404b-a3d6-491887e0b154 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:40.592120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1ac0b-48e7-404b-a3d6-491887e0b154 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:40.592712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1ac0b-48e7-404b-a3d6-491887e0b154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:40.594342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1ac0b-48e7-404b-a3d6-491887e0b154 None admin] RBAC: Adding query filter params (group.id=cdb07e9a184d4da5a24c67c0975309b1, role.id=3e320079a5ce471e863ad87a36be46b1, scope.project.id=cb94aac4115444f781367f00674d4de8) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:40.594652 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1ac0b-48e7-404b-a3d6-491887e0b154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:40.596265 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1ac0b-48e7-404b-a3d6-491887e0b154 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:40.602688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 178/363] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 2 18:47:40 2022] GET /identity/v3/role_assignments?group.id=cdb07e9a184d4da5a24c67c0975309b1&scope.project.id=cb94aac4115444f781367f00674d4de8&role.id=3e320079a5ce471e863ad87a36be46b1 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:40.604129 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1ac0b-48e7-404b-a3d6-491887e0b154 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:40.624998 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 186/364] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:40.629828 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79f1b1-28df-4550-977b-87c76ff7e2f1 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:40.698461 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:40.720947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:40.766874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1ac0b-48e7-404b-a3d6-491887e0b154 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:40.783184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79f1b1-28df-4550-977b-87c76ff7e2f1 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:40.815502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76f471-4de8-4de2-a1d0-68ae35175b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:40.816673 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f471-4de8-4de2-a1d0-68ae35175b77 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:40.817224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f471-4de8-4de2-a1d0-68ae35175b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:40.817745 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f471-4de8-4de2-a1d0-68ae35175b77 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:40.818734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76f471-4de8-4de2-a1d0-68ae35175b77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:40.819379 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76f471-4de8-4de2-a1d0-68ae35175b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:40.821371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76f471-4de8-4de2-a1d0-68ae35175b77 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:40.822321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e4301-099c-4c59-aac1-86d637ecd160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:40.823089 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e4301-099c-4c59-aac1-86d637ecd160 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:40.823508 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e4301-099c-4c59-aac1-86d637ecd160 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:40.823849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e4301-099c-4c59-aac1-86d637ecd160 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:40.825560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e4301-099c-4c59-aac1-86d637ecd160 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:40.826192 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e4301-099c-4c59-aac1-86d637ecd160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:40.827807 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e4301-099c-4c59-aac1-86d637ecd160 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:40.836989 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 179/365] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:47:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:40.836989 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76f471-4de8-4de2-a1d0-68ae35175b77 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:40.845718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 187/366] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:40.846863 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e4301-099c-4c59-aac1-86d637ecd160 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:40.958201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76f471-4de8-4de2-a1d0-68ae35175b77 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:40.969394 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e4301-099c-4c59-aac1-86d637ecd160 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:40.973720 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:40.998506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:41.005926 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea56c23-4008-471b-923e-f2f40da8dc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:41.007048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea56c23-4008-471b-923e-f2f40da8dc45 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:41.007326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea56c23-4008-471b-923e-f2f40da8dc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:41.008001 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea56c23-4008-471b-923e-f2f40da8dc45 None admin] PATH_INFO: `/v3/groups/cdb07e9a184d4da5a24c67c0975309b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:41.009422 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea56c23-4008-471b-923e-f2f40da8dc45 None admin] RBAC: Authorizing `identity:get_group(group_id=cdb07e9a184d4da5a24c67c0975309b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:41.011793 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea56c23-4008-471b-923e-f2f40da8dc45 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:41.014149 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 180/367] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 2 18:47:40 2022] GET /identity/v3/groups/cdb07e9a184d4da5a24c67c0975309b1 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:41.015187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea56c23-4008-471b-923e-f2f40da8dc45 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:41.019099 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f6fad-dde7-49d9-b586-fddd419249e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:41.023208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f6fad-dde7-49d9-b586-fddd419249e6 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:41.023496 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f6fad-dde7-49d9-b586-fddd419249e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:41.023772 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f6fad-dde7-49d9-b586-fddd419249e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:41.043561 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f6fad-dde7-49d9-b586-fddd419249e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:41.054694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-9a9f6fad-dde7-49d9-b586-fddd419249e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:47:41.054694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:41.054694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:41.054694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:41.054694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:41.054694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:41.054694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:41.054694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:41.054694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:41.054694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:41.054694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:41.054694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:41.054694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:41.054694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:41.054694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:41.054694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:41.055661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:41.055661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:41.055661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:41.055661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:41.055661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:41.055661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:41.055661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:41.055661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:41.055661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:41.055661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:41.055661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:41.055661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:41.055661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:41.055661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:41.055661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:41.055661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:41.056455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:41.056455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:41.056455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:41.056455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:41.056455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:41.056455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:41.056455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:41.056455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:41.056455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:41.056455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:41.056455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:47:41.056455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:41.056455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 188/368] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:47:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:41.057142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f6fad-dde7-49d9-b586-fddd419249e6 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:41.136074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea56c23-4008-471b-923e-f2f40da8dc45 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:41.182954 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a356bd-fa09-4f7a-9521-ff63e8e03410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:41.183616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a356bd-fa09-4f7a-9521-ff63e8e03410 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:41.183891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a356bd-fa09-4f7a-9521-ff63e8e03410 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:41.184159 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a356bd-fa09-4f7a-9521-ff63e8e03410 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:41.203845 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f6fad-dde7-49d9-b586-fddd419249e6 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:41.244804 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6426cbd-fc1a-4364-97fd-37e78b26c9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:41.245759 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6426cbd-fc1a-4364-97fd-37e78b26c9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:41.246262 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6426cbd-fc1a-4364-97fd-37e78b26c9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:41.246377 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6426cbd-fc1a-4364-97fd-37e78b26c9a6 None admin] PATH_INFO: `/v3/users/20334b34131842aeba3ef88718735440` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:41.250923 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6426cbd-fc1a-4364-97fd-37e78b26c9a6 None admin] RBAC: Authorizing `identity:get_user(user_id=20334b34131842aeba3ef88718735440)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:41.252594 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6426cbd-fc1a-4364-97fd-37e78b26c9a6 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:41.254831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 189/369] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:47:41 2022] GET /identity/v3/users/20334b34131842aeba3ef88718735440 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:41.255672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6426cbd-fc1a-4364-97fd-37e78b26c9a6 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:41.281017 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:41.290343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a356bd-fa09-4f7a-9521-ff63e8e03410 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:41.292021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a356bd-fa09-4f7a-9521-ff63e8e03410 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:41.297698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:41.384179 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6426cbd-fc1a-4364-97fd-37e78b26c9a6 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:41.405995 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 181/370] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:41.406921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a356bd-fa09-4f7a-9521-ff63e8e03410 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:41.426782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e865488-5193-4120-be31-f1b88491f491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:41.427744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e865488-5193-4120-be31-f1b88491f491 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:41.428024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e865488-5193-4120-be31-f1b88491f491 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:41.428295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e865488-5193-4120-be31-f1b88491f491 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:41.429130 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e865488-5193-4120-be31-f1b88491f491 None admin] RBAC: Adding query filter params (group.id=cdb07e9a184d4da5a24c67c0975309b1, role.id=3e320079a5ce471e863ad87a36be46b1, scope.project.id=32a6d4fba36a446bb95799ce1b96d071) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:41.429441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e865488-5193-4120-be31-f1b88491f491 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:41.431377 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e865488-5193-4120-be31-f1b88491f491 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:41.439536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 190/371] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 2 18:47:41 2022] GET /identity/v3/role_assignments?group.id=cdb07e9a184d4da5a24c67c0975309b1&scope.project.id=32a6d4fba36a446bb95799ce1b96d071&role.id=3e320079a5ce471e863ad87a36be46b1 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:41.440785 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e865488-5193-4120-be31-f1b88491f491 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:41.544817 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:41.550541 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a356bd-fa09-4f7a-9521-ff63e8e03410 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:41.580672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:41.588743 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e865488-5193-4120-be31-f1b88491f491 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:41.600972 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef4231-fb88-473f-9a5d-6074a296431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:41.601661 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef4231-fb88-473f-9a5d-6074a296431a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:41.601965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef4231-fb88-473f-9a5d-6074a296431a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:41.602237 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef4231-fb88-473f-9a5d-6074a296431a None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:41.602990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef4231-fb88-473f-9a5d-6074a296431a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:41.603290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef4231-fb88-473f-9a5d-6074a296431a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:41.604729 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef4231-fb88-473f-9a5d-6074a296431a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:41.614289 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 182/372] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:41.615163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef4231-fb88-473f-9a5d-6074a296431a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:41.638549 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18fe6f-f5f5-4663-be2d-ec49d1d0956d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:41.639761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18fe6f-f5f5-4663-be2d-ec49d1d0956d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:41.640047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18fe6f-f5f5-4663-be2d-ec49d1d0956d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:41.640475 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18fe6f-f5f5-4663-be2d-ec49d1d0956d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:41.641478 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18fe6f-f5f5-4663-be2d-ec49d1d0956d None admin] RBAC: Adding query filter params (role.id=83b821ffac7d4dbdb849c13f1dbd4ead, user.id=20334b34131842aeba3ef88718735440, scope.system=all) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:41.641815 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18fe6f-f5f5-4663-be2d-ec49d1d0956d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:41.643806 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18fe6f-f5f5-4663-be2d-ec49d1d0956d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:41.661218 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 191/373] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Jun 2 18:47:41 2022] GET /identity/v3/role_assignments?user.id=20334b34131842aeba3ef88718735440&scope.system=all&role.id=83b821ffac7d4dbdb849c13f1dbd4ead => generated 510 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:41.662373 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18fe6f-f5f5-4663-be2d-ec49d1d0956d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:41.741221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef4231-fb88-473f-9a5d-6074a296431a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:41.793701 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3120bbd-fc62-43e5-a88f-a61f3db3e1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:41.794781 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3120bbd-fc62-43e5-a88f-a61f3db3e1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:41.795054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3120bbd-fc62-43e5-a88f-a61f3db3e1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:41.795321 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3120bbd-fc62-43e5-a88f-a61f3db3e1f4 None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:41.797320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3120bbd-fc62-43e5-a88f-a61f3db3e1f4 None admin] RBAC: Authorizing `identity:get_project(project_id=32a6d4fba36a446bb95799ce1b96d071)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:41.801774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3120bbd-fc62-43e5-a88f-a61f3db3e1f4 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:41.802175 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 183/374] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:41 2022] GET /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:41.806278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3120bbd-fc62-43e5-a88f-a61f3db3e1f4 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:41.814978 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18fe6f-f5f5-4663-be2d-ec49d1d0956d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:41.867916 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec59e0-3b16-48b6-a453-e26831eaf92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:41.868873 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec59e0-3b16-48b6-a453-e26831eaf92c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:41.869149 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec59e0-3b16-48b6-a453-e26831eaf92c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:41.869420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec59e0-3b16-48b6-a453-e26831eaf92c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:41.878397 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:41.917769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:41.981404 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3120bbd-fc62-43e5-a88f-a61f3db3e1f4 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:42.008951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec59e0-3b16-48b6-a453-e26831eaf92c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:42.010669 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec59e0-3b16-48b6-a453-e26831eaf92c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:42.021342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bd0e7-6e88-46d5-81ee-908df684dcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:42.022291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bd0e7-6e88-46d5-81ee-908df684dcb7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:42.022566 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bd0e7-6e88-46d5-81ee-908df684dcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:42.022836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bd0e7-6e88-46d5-81ee-908df684dcb7 None admin] PATH_INFO: `/v3/groups/cdb07e9a184d4da5a24c67c0975309b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:42.024040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bd0e7-6e88-46d5-81ee-908df684dcb7 None admin] RBAC: Authorizing `identity:get_group(group_id=cdb07e9a184d4da5a24c67c0975309b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:42.025633 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bd0e7-6e88-46d5-81ee-908df684dcb7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:42.029858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 184/375] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 2 18:47:41 2022] GET /identity/v3/groups/cdb07e9a184d4da5a24c67c0975309b1 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:42.033877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bd0e7-6e88-46d5-81ee-908df684dcb7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:42.136637 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:42.138651 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 192/376] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:42.145963 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bd0e7-6e88-46d5-81ee-908df684dcb7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:42.147623 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec59e0-3b16-48b6-a453-e26831eaf92c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:42.189318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac35b75-421c-4549-8d47-447a27108e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:42.190027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac35b75-421c-4549-8d47-447a27108e5e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:42.190375 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac35b75-421c-4549-8d47-447a27108e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:42.190718 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac35b75-421c-4549-8d47-447a27108e5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:42.191562 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac35b75-421c-4549-8d47-447a27108e5e None admin] RBAC: Adding query filter params (group.id=cdb07e9a184d4da5a24c67c0975309b1, role.id=1ecbde8dcaa44047899f618334033d43, scope.project.id=32a6d4fba36a446bb95799ce1b96d071) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:42.191875 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac35b75-421c-4549-8d47-447a27108e5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:42.193344 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac35b75-421c-4549-8d47-447a27108e5e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:42.200070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 185/377] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 2 18:47:42 2022] GET /identity/v3/role_assignments?group.id=cdb07e9a184d4da5a24c67c0975309b1&scope.project.id=32a6d4fba36a446bb95799ce1b96d071&role.id=1ecbde8dcaa44047899f618334033d43 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:42.222879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:42.290742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec59e0-3b16-48b6-a453-e26831eaf92c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:42.336573 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2571f6a-29fd-4187-94b5-9ac6bab46c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:42.337485 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2571f6a-29fd-4187-94b5-9ac6bab46c05 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:42.337767 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2571f6a-29fd-4187-94b5-9ac6bab46c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:42.338094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2571f6a-29fd-4187-94b5-9ac6bab46c05 None admin] PATH_INFO: `/v3/projects/b970ca87a411459db54f4a7b6d487f4a` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:42.340816 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2571f6a-29fd-4187-94b5-9ac6bab46c05 None admin] RBAC: Authorizing `identity:get_project(project_id=b970ca87a411459db54f4a7b6d487f4a)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:42.342416 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2571f6a-29fd-4187-94b5-9ac6bab46c05 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:42.344359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 193/378] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:42 2022] GET /identity/v3/projects/b970ca87a411459db54f4a7b6d487f4a => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:42.349923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac35b75-421c-4549-8d47-447a27108e5e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:42.494874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac35b75-421c-4549-8d47-447a27108e5e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:42.533737 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8416e7e-7e86-40c6-bc9d-e18d4d8e2357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:42.534310 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8416e7e-7e86-40c6-bc9d-e18d4d8e2357 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:42.534855 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8416e7e-7e86-40c6-bc9d-e18d4d8e2357 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:42.535130 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8416e7e-7e86-40c6-bc9d-e18d4d8e2357 None admin] PATH_INFO: `/v3/groups/e5837fd1fbc5445ebfedef57815b7224` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:42.535416 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3db76-7769-4be6-94b4-29ce22cc097a None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:42.535704 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3db76-7769-4be6-94b4-29ce22cc097a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:42.535981 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3db76-7769-4be6-94b4-29ce22cc097a None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:42.537551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 194/379] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:42.540551 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8416e7e-7e86-40c6-bc9d-e18d4d8e2357 None admin] RBAC: Authorizing `identity:get_group(group_id=e5837fd1fbc5445ebfedef57815b7224)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:42.542044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8416e7e-7e86-40c6-bc9d-e18d4d8e2357 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:42.543826 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 186/380] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 2 18:47:42 2022] GET /identity/v3/groups/e5837fd1fbc5445ebfedef57815b7224 => generated 229 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:42.547241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366a494-30db-4ec7-853c-7ad8c3885341 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:42.547531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366a494-30db-4ec7-853c-7ad8c3885341 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:42.547811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366a494-30db-4ec7-853c-7ad8c3885341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:42.549855 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8416e7e-7e86-40c6-bc9d-e18d4d8e2357 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:42.576592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-8366a494-30db-4ec7-853c-7ad8c3885341 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:42.578234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8366a494-30db-4ec7-853c-7ad8c3885341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:42.582352 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:42.702764 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8416e7e-7e86-40c6-bc9d-e18d4d8e2357 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:42.706019 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 195/381] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:42.741688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ba08e-28d2-44b1-8ca8-cc2ce68b233c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:42.742386 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ba08e-28d2-44b1-8ca8-cc2ce68b233c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:42.742667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ba08e-28d2-44b1-8ca8-cc2ce68b233c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:42.742943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ba08e-28d2-44b1-8ca8-cc2ce68b233c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:42.743781 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ba08e-28d2-44b1-8ca8-cc2ce68b233c None admin] RBAC: Adding query filter params (group.id=e5837fd1fbc5445ebfedef57815b7224, role.id=8560bac1acf74dce81ea6a76f751b641, scope.project.id=b970ca87a411459db54f4a7b6d487f4a) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:42.744089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ba08e-28d2-44b1-8ca8-cc2ce68b233c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:42.745599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ba08e-28d2-44b1-8ca8-cc2ce68b233c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:42.749320 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366a494-30db-4ec7-853c-7ad8c3885341 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:42.751791 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 187/382] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 2 18:47:42 2022] GET /identity/v3/role_assignments?group.id=e5837fd1fbc5445ebfedef57815b7224&scope.project.id=b970ca87a411459db54f4a7b6d487f4a&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:42.810298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:42.873233 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366a494-30db-4ec7-853c-7ad8c3885341 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:42.921865 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d9e65-37cc-4da1-b138-6cd93605bee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:42.922764 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d9e65-37cc-4da1-b138-6cd93605bee4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:42.923038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d9e65-37cc-4da1-b138-6cd93605bee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:42.923305 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d9e65-37cc-4da1-b138-6cd93605bee4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:42.937950 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d9e65-37cc-4da1-b138-6cd93605bee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:42.946392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-c94d9e65-37cc-4da1-b138-6cd93605bee4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:42.946392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:42.946392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:42.946392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:42.946392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:42.946392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:42.946392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:42.946392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:42.946392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:42.946392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:42.946392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:42.946392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:42.946392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:42.946392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:42.946392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:42.946392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:42.947360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:42.947360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:42.947360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:42.947360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:42.947360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:42.947360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:42.947360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:42.947360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:42.947360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:42.947360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:42.947360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:42.947360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:42.947360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:42.947360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:42.947360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:42.947360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:42.948145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:42.948145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:42.948145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:42.948145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:42.948145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:42.948145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:42.948145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:42.948145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:42.948145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:42.948145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:42.948145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:42.948145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:42.948145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 196/383] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:47:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:47:42.955788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ba08e-28d2-44b1-8ca8-cc2ce68b233c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:43.081035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:43.094558 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ba08e-28d2-44b1-8ca8-cc2ce68b233c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:43.130652 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc3c42-9fce-4f7c-a9f1-67aeba308b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:43.131338 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc3c42-9fce-4f7c-a9f1-67aeba308b05 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:43.131619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc3c42-9fce-4f7c-a9f1-67aeba308b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:43.131893 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc3c42-9fce-4f7c-a9f1-67aeba308b05 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:43.132652 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc3c42-9fce-4f7c-a9f1-67aeba308b05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:43.132956 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc3c42-9fce-4f7c-a9f1-67aeba308b05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:43.134373 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc3c42-9fce-4f7c-a9f1-67aeba308b05 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:43.143492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 188/384] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:47:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:43.148998 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d9e65-37cc-4da1-b138-6cd93605bee4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:43.277773 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d9e65-37cc-4da1-b138-6cd93605bee4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:43.298341 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:43.325760 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb1eed-608f-4486-a40b-9849776f453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:43.326916 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb1eed-608f-4486-a40b-9849776f453c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:43.327192 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb1eed-608f-4486-a40b-9849776f453c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:43.327462 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb1eed-608f-4486-a40b-9849776f453c None admin] PATH_INFO: `/v3/groups/cdb07e9a184d4da5a24c67c0975309b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:43.334914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb1eed-608f-4486-a40b-9849776f453c None admin] RBAC: Authorizing `identity:get_group(group_id=cdb07e9a184d4da5a24c67c0975309b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:43.336515 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb1eed-608f-4486-a40b-9849776f453c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:43.339033 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 197/385] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 2 18:47:43 2022] GET /identity/v3/groups/cdb07e9a184d4da5a24c67c0975309b1 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:43.345317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc3c42-9fce-4f7c-a9f1-67aeba308b05 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:43.486845 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc3c42-9fce-4f7c-a9f1-67aeba308b05 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:43.523908 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cace9-c663-49c0-b7d7-dfad2e0eb6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:43.525200 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cace9-c663-49c0-b7d7-dfad2e0eb6ff None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:43.525682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cace9-c663-49c0-b7d7-dfad2e0eb6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:43.526192 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cace9-c663-49c0-b7d7-dfad2e0eb6ff None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:43.527671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6cace9-c663-49c0-b7d7-dfad2e0eb6ff None admin] RBAC: Authorizing `identity:get_project(project_id=cb94aac4115444f781367f00674d4de8)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:43.529386 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6cace9-c663-49c0-b7d7-dfad2e0eb6ff None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:43.531735 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 189/386] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:43 2022] GET /identity/v3/projects/cb94aac4115444f781367f00674d4de8 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:43.537215 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb1eed-608f-4486-a40b-9849776f453c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:43.653818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb1eed-608f-4486-a40b-9849776f453c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:43.695875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce44fe-364a-4dd9-916d-e352af8328d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:43.697239 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce44fe-364a-4dd9-916d-e352af8328d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:43.697717 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce44fe-364a-4dd9-916d-e352af8328d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:43.698214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce44fe-364a-4dd9-916d-e352af8328d7 None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8/groups/cdb07e9a184d4da5a24c67c0975309b1/roles/1ecbde8dcaa44047899f618334033d43` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:43.700703 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce44fe-364a-4dd9-916d-e352af8328d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb94aac4115444f781367f00674d4de8, group_id=cdb07e9a184d4da5a24c67c0975309b1, role_id=1ecbde8dcaa44047899f618334033d43)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:43.702463 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce44fe-364a-4dd9-916d-e352af8328d7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:43.724390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 198/387] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Jun 2 18:47:43 2022] PUT /identity/v3/projects/cb94aac4115444f781367f00674d4de8/groups/cdb07e9a184d4da5a24c67c0975309b1/roles/1ecbde8dcaa44047899f618334033d43 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:47:43.862250 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b005c31-87cb-4b2b-9114-75932ff4ce55 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:43.862587 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b005c31-87cb-4b2b-9114-75932ff4ce55 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:43.862810 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b005c31-87cb-4b2b-9114-75932ff4ce55 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:43.864222 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 190/388] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:43.877250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e5dd7-b9b0-426c-9248-74b2d75b7cec None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:43.877930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e5dd7-b9b0-426c-9248-74b2d75b7cec None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:43.878395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e5dd7-b9b0-426c-9248-74b2d75b7cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:43.900999 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-846e5dd7-b9b0-426c-9248-74b2d75b7cec None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:43.902642 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-846e5dd7-b9b0-426c-9248-74b2d75b7cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:43.947058 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:43.985090 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 199/389] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:44.008961 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b005c31-87cb-4b2b-9114-75932ff4ce55 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:44.034046 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:44.125722 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b005c31-87cb-4b2b-9114-75932ff4ce55 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:44.167598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bc683-e3d5-46b7-86df-80ae5d486abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:44.168462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bc683-e3d5-46b7-86df-80ae5d486abd None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:44.168740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bc683-e3d5-46b7-86df-80ae5d486abd None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:44.169110 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bc683-e3d5-46b7-86df-80ae5d486abd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:44.186727 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bc683-e3d5-46b7-86df-80ae5d486abd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:44.194563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-b53bc683-e3d5-46b7-86df-80ae5d486abd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:44.194563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:44.194563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:44.194563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:44.194563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:44.194563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:44.194563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:44.194563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:44.194563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:44.194563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:44.194563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:44.194563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:44.194563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:44.194563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:44.194563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:44.194563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:44.195431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:44.195431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:44.195431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:44.195431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:44.195431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:44.195431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:44.195431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:44.195431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:44.195431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:44.195431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:44.195431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:44.195431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:44.195431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:44.195431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:44.195431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:44.195431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:44.196213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:44.196213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:44.196213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:44.196213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:44.196213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:44.196213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:44.196213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:44.196213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:44.196213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:44.196213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:44.196213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:44.196213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:44.196213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 191/390] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:44.202170 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e5dd7-b9b0-426c-9248-74b2d75b7cec None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:44.319322 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e5dd7-b9b0-426c-9248-74b2d75b7cec None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:44.355055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028ea8d-c34c-489f-a5c4-9b26e5bc0800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:44.356126 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028ea8d-c34c-489f-a5c4-9b26e5bc0800 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:44.356824 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028ea8d-c34c-489f-a5c4-9b26e5bc0800 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:44.357327 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028ea8d-c34c-489f-a5c4-9b26e5bc0800 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:44.358304 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028ea8d-c34c-489f-a5c4-9b26e5bc0800 None admin] RBAC: Adding query filter params (name=member) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:44.358798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028ea8d-c34c-489f-a5c4-9b26e5bc0800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:44.360366 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028ea8d-c34c-489f-a5c4-9b26e5bc0800 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:44.369728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 200/391] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:44.379240 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bc683-e3d5-46b7-86df-80ae5d486abd None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:44.491742 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:44.515590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bc683-e3d5-46b7-86df-80ae5d486abd None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:44.550830 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b77a0-7fe2-49d8-9d6e-d1e391a0c995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:44.551706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b77a0-7fe2-49d8-9d6e-d1e391a0c995 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:44.551981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b77a0-7fe2-49d8-9d6e-d1e391a0c995 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:44.552250 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b77a0-7fe2-49d8-9d6e-d1e391a0c995 None admin] PATH_INFO: `/v3/groups/cdb07e9a184d4da5a24c67c0975309b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:44.553410 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b77a0-7fe2-49d8-9d6e-d1e391a0c995 None admin] RBAC: Authorizing `identity:get_group(group_id=cdb07e9a184d4da5a24c67c0975309b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:44.554902 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b77a0-7fe2-49d8-9d6e-d1e391a0c995 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:44.556884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 192/392] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 2 18:47:44 2022] GET /identity/v3/groups/cdb07e9a184d4da5a24c67c0975309b1 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:44.562316 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028ea8d-c34c-489f-a5c4-9b26e5bc0800 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:44.621574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:44.715940 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028ea8d-c34c-489f-a5c4-9b26e5bc0800 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:44.750301 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe4d51-e387-4be8-891d-0f0002fc7586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:44.751620 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe4d51-e387-4be8-891d-0f0002fc7586 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:44.751895 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe4d51-e387-4be8-891d-0f0002fc7586 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:44.752167 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe4d51-e387-4be8-891d-0f0002fc7586 None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:44.753353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe4d51-e387-4be8-891d-0f0002fc7586 None admin] RBAC: Authorizing `identity:get_project(project_id=cb94aac4115444f781367f00674d4de8)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:44.754830 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe4d51-e387-4be8-891d-0f0002fc7586 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:44.756544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 201/393] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:44 2022] GET /identity/v3/projects/cb94aac4115444f781367f00674d4de8 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:44.763237 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b77a0-7fe2-49d8-9d6e-d1e391a0c995 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:44.908083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b77a0-7fe2-49d8-9d6e-d1e391a0c995 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:44.953309 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41227ba1-4148-4202-acfe-a8ce93ce38d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:44.954642 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41227ba1-4148-4202-acfe-a8ce93ce38d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:44.955147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41227ba1-4148-4202-acfe-a8ce93ce38d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:44.955606 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41227ba1-4148-4202-acfe-a8ce93ce38d6 None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8/groups/cdb07e9a184d4da5a24c67c0975309b1/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:44.958132 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41227ba1-4148-4202-acfe-a8ce93ce38d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb94aac4115444f781367f00674d4de8, group_id=cdb07e9a184d4da5a24c67c0975309b1, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:44.959805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41227ba1-4148-4202-acfe-a8ce93ce38d6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:44.978199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 193/394] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Jun 2 18:47:44 2022] PUT /identity/v3/projects/cb94aac4115444f781367f00674d4de8/groups/cdb07e9a184d4da5a24c67c0975309b1/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:47:45.161390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affff8c0-2b5f-47af-b20c-ec295dd242cc None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:45.161786 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affff8c0-2b5f-47af-b20c-ec295dd242cc None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:45.161986 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affff8c0-2b5f-47af-b20c-ec295dd242cc None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:45.163629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 202/395] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:45.169831 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89521f-6bfe-47ba-8e53-942bb202b114 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:45.170385 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89521f-6bfe-47ba-8e53-942bb202b114 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:45.170385 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89521f-6bfe-47ba-8e53-942bb202b114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:45.182698 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:45.191169 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ef89521f-6bfe-47ba-8e53-942bb202b114 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:45.192371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ef89521f-6bfe-47ba-8e53-942bb202b114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:45.212915 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3df07-199c-4913-8a0f-e145e54b5555 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:45.213443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3df07-199c-4913-8a0f-e145e54b5555 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:45.213443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3df07-199c-4913-8a0f-e145e54b5555 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:45.215160 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 203/396] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:45.221579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235fef7-f15c-4ad9-8fbc-ed384e9620ff None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:45.221945 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235fef7-f15c-4ad9-8fbc-ed384e9620ff None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:45.222218 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235fef7-f15c-4ad9-8fbc-ed384e9620ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:45.249506 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b235fef7-f15c-4ad9-8fbc-ed384e9620ff None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:45.250783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b235fef7-f15c-4ad9-8fbc-ed384e9620ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:45.312592 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 194/397] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:45.336270 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 204/398] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:47:45.340206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89521f-6bfe-47ba-8e53-942bb202b114 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:45.361710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235fef7-f15c-4ad9-8fbc-ed384e9620ff None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:45.397438 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:45.499742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235fef7-f15c-4ad9-8fbc-ed384e9620ff None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:45.501833 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89521f-6bfe-47ba-8e53-942bb202b114 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:45.579216 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01160c36-e6e9-432b-8a72-da87fda91750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:45.580783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047d67f-5dea-4562-bca3-0bc13e39c6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:45.581901 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01160c36-e6e9-432b-8a72-da87fda91750 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:45.582387 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01160c36-e6e9-432b-8a72-da87fda91750 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:45.583221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01160c36-e6e9-432b-8a72-da87fda91750 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:45.583741 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047d67f-5dea-4562-bca3-0bc13e39c6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:45.584021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047d67f-5dea-4562-bca3-0bc13e39c6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:45.584318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047d67f-5dea-4562-bca3-0bc13e39c6f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:45.587314 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:45.598361 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01160c36-e6e9-432b-8a72-da87fda91750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:45.606891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-01160c36-e6e9-432b-8a72-da87fda91750 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:45.606891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:45.606891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:45.606891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:45.606891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:45.606891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:45.606891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:45.606891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:45.606891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:45.606891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:45.606891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:45.606891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:45.606891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:45.606891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:45.606891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:45.606891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:45.607912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:45.607912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:45.607912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:45.607912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:45.607912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:45.607912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:45.607912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:45.607912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:45.607912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:45.607912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:45.607912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:45.607912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:45.607912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:45.607912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:45.607912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:45.607912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:45.608713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:45.608713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:45.608713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:45.608713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:45.608713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:45.608713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:45.608713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:45.608713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:45.608713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:45.608713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:45.608713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:45.608713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:45.611724 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 195/399] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:45.617492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01160c36-e6e9-432b-8a72-da87fda91750 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:45.621295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047d67f-5dea-4562-bca3-0bc13e39c6f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:45.629574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-e047d67f-5dea-4562-bca3-0bc13e39c6f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:45.629574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:45.629574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:45.629574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:45.629574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:45.629574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:45.629574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:45.629574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:45.629574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:45.629574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:45.629574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:45.629574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:45.629574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:45.629574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:45.629574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:45.629574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:45.630464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:45.630464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:45.630464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:45.630464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:45.630464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:45.630464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:45.630464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:45.630464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:45.630464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:45.630464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:45.630464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:45.630464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:45.630464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:45.630464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:45.630464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:45.630464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:45.631247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:45.631247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:45.631247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:45.631247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:45.631247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:45.631247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:45.631247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:45.631247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:45.631247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:45.631247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:45.631247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:45.631247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:45.631247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 205/400] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:47:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:47:45.640829 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047d67f-5dea-4562-bca3-0bc13e39c6f4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:45.766446 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:45.782440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047d67f-5dea-4562-bca3-0bc13e39c6f4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:45.809669 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01160c36-e6e9-432b-8a72-da87fda91750 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:45.847888 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d3b82-eec9-46a6-a072-7b4472796dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:45.848578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d3b82-eec9-46a6-a072-7b4472796dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:45.848860 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d3b82-eec9-46a6-a072-7b4472796dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:45.849135 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d3b82-eec9-46a6-a072-7b4472796dd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:45.849921 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d3b82-eec9-46a6-a072-7b4472796dd2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:45.850235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d3b82-eec9-46a6-a072-7b4472796dd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:45.851641 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d3b82-eec9-46a6-a072-7b4472796dd2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:45.864725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 206/401] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:47:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:45.871082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d3b82-eec9-46a6-a072-7b4472796dd2 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:45.876574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c87ed1-2aee-463f-8ac9-b2b1494d0239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:45.877321 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c87ed1-2aee-463f-8ac9-b2b1494d0239 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:45.877605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c87ed1-2aee-463f-8ac9-b2b1494d0239 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:45.877899 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c87ed1-2aee-463f-8ac9-b2b1494d0239 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:45.878826 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c87ed1-2aee-463f-8ac9-b2b1494d0239 None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:45.879346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c87ed1-2aee-463f-8ac9-b2b1494d0239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:45.880952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c87ed1-2aee-463f-8ac9-b2b1494d0239 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:45.895896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 196/402] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:45.901951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c87ed1-2aee-463f-8ac9-b2b1494d0239 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:45.972776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:46.016618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c87ed1-2aee-463f-8ac9-b2b1494d0239 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:46.030243 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d3b82-eec9-46a6-a072-7b4472796dd2 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:46.056511 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f661366-665a-42ad-b311-fcc840fc23f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:46.057681 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f661366-665a-42ad-b311-fcc840fc23f0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:46.058162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f661366-665a-42ad-b311-fcc840fc23f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:46.058602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f661366-665a-42ad-b311-fcc840fc23f0 None admin] PATH_INFO: `/v3/groups/cdb07e9a184d4da5a24c67c0975309b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:46.060040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f661366-665a-42ad-b311-fcc840fc23f0 None admin] RBAC: Authorizing `identity:get_group(group_id=cdb07e9a184d4da5a24c67c0975309b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:46.061686 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f661366-665a-42ad-b311-fcc840fc23f0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:46.063846 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 197/403] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 2 18:47:45 2022] GET /identity/v3/groups/cdb07e9a184d4da5a24c67c0975309b1 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:46.065258 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f64052-0f7e-498d-99bf-ff207001c22f None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:46.065738 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f64052-0f7e-498d-99bf-ff207001c22f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:46.066239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f64052-0f7e-498d-99bf-ff207001c22f None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:46.071777 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 198/404] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:46.071777 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f64052-0f7e-498d-99bf-ff207001c22f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:46.079833 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f3713-7a5e-4dd6-ba41-35bbb7f13933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:46.080999 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f3713-7a5e-4dd6-ba41-35bbb7f13933 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:46.081546 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f3713-7a5e-4dd6-ba41-35bbb7f13933 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:46.082090 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f3713-7a5e-4dd6-ba41-35bbb7f13933 None admin] PATH_INFO: `/v3/groups/cdb07e9a184d4da5a24c67c0975309b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:46.083830 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f3713-7a5e-4dd6-ba41-35bbb7f13933 None admin] RBAC: Authorizing `identity:get_group(group_id=cdb07e9a184d4da5a24c67c0975309b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:46.085678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f3713-7a5e-4dd6-ba41-35bbb7f13933 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:46.087885 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 207/405] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 2 18:47:45 2022] GET /identity/v3/groups/cdb07e9a184d4da5a24c67c0975309b1 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:46.089362 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc683bf-f819-45bc-89b2-68a02525ac34 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:46.089945 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc683bf-f819-45bc-89b2-68a02525ac34 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:46.090411 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc683bf-f819-45bc-89b2-68a02525ac34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:46.108248 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-acc683bf-f819-45bc-89b2-68a02525ac34 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:46.109983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-acc683bf-f819-45bc-89b2-68a02525ac34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:46.127172 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:46.191816 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 208/406] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:46.192903 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc683bf-f819-45bc-89b2-68a02525ac34 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:46.226025 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f64052-0f7e-498d-99bf-ff207001c22f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:46.254948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:46.265437 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477e3d2-8e44-437f-b5cd-029dcfe3e9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:46.266522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477e3d2-8e44-437f-b5cd-029dcfe3e9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:46.266996 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477e3d2-8e44-437f-b5cd-029dcfe3e9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:46.267308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477e3d2-8e44-437f-b5cd-029dcfe3e9c3 None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:46.268721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477e3d2-8e44-437f-b5cd-029dcfe3e9c3 None admin] RBAC: Authorizing `identity:get_project(project_id=32a6d4fba36a446bb95799ce1b96d071)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:46.270379 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477e3d2-8e44-437f-b5cd-029dcfe3e9c3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:46.272567 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 199/407] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:46 2022] GET /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:46.273161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477e3d2-8e44-437f-b5cd-029dcfe3e9c3 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:46.318667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc683bf-f819-45bc-89b2-68a02525ac34 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:46.359498 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16896c2-a562-4dd9-a1d0-8cf108553788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:46.360672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16896c2-a562-4dd9-a1d0-8cf108553788 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:46.361109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16896c2-a562-4dd9-a1d0-8cf108553788 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:46.361520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16896c2-a562-4dd9-a1d0-8cf108553788 None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:46.363067 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16896c2-a562-4dd9-a1d0-8cf108553788 None admin] RBAC: Authorizing `identity:get_project(project_id=32a6d4fba36a446bb95799ce1b96d071)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:46.364661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16896c2-a562-4dd9-a1d0-8cf108553788 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:46.366775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 209/408] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:46 2022] GET /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:46.367661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16896c2-a562-4dd9-a1d0-8cf108553788 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:46.382042 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477e3d2-8e44-437f-b5cd-029dcfe3e9c3 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:46.388463 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:46.417433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4d7b8-0ec1-4843-a4ec-e57504fdef8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:46.418396 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4d7b8-0ec1-4843-a4ec-e57504fdef8c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:46.418777 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4d7b8-0ec1-4843-a4ec-e57504fdef8c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:46.419316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4d7b8-0ec1-4843-a4ec-e57504fdef8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:46.430457 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4d7b8-0ec1-4843-a4ec-e57504fdef8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:46.438624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-25f4d7b8-0ec1-4843-a4ec-e57504fdef8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:47:46.438624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:46.438624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:46.438624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:46.438624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:46.438624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:46.438624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:46.438624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:46.438624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:46.438624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:46.438624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:46.438624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:46.438624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:46.438624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:46.438624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:46.438624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:46.439543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:46.439543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:46.439543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:46.439543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:46.439543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:46.439543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:46.439543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:46.439543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:46.439543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:46.439543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:46.439543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:46.439543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:46.439543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:46.439543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:46.439543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:46.439543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:46.440342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:46.440342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:46.440342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:46.440342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:46.440342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:46.440342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:46.440342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:46.440342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:46.440342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:46.440342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:46.440342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:47:46.440342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:46.445317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 200/409] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:47:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:46.445848 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4d7b8-0ec1-4843-a4ec-e57504fdef8c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:46.482205 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16896c2-a562-4dd9-a1d0-8cf108553788 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:46.505146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:46.524777 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36881beb-7daa-4df1-b3fa-47ec9cde812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:46.526038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36881beb-7daa-4df1-b3fa-47ec9cde812c None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:46.526540 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36881beb-7daa-4df1-b3fa-47ec9cde812c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:46.527075 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36881beb-7daa-4df1-b3fa-47ec9cde812c None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071/groups/cdb07e9a184d4da5a24c67c0975309b1/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:46.529475 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36881beb-7daa-4df1-b3fa-47ec9cde812c None admin] RBAC: Authorizing `identity:create_grant(project_id=32a6d4fba36a446bb95799ce1b96d071, group_id=cdb07e9a184d4da5a24c67c0975309b1, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:46.531290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36881beb-7daa-4df1-b3fa-47ec9cde812c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:46.552312 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 210/410] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Jun 2 18:47:46 2022] PUT /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071/groups/cdb07e9a184d4da5a24c67c0975309b1/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:47:46.553666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36881beb-7daa-4df1-b3fa-47ec9cde812c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:46.557092 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4d7b8-0ec1-4843-a4ec-e57504fdef8c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:46.606786 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62281da4-3669-4e3a-af9b-b0ff21575b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:46.608206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62281da4-3669-4e3a-af9b-b0ff21575b5e None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:46.608678 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62281da4-3669-4e3a-af9b-b0ff21575b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:46.609132 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62281da4-3669-4e3a-af9b-b0ff21575b5e None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071/groups/cdb07e9a184d4da5a24c67c0975309b1/roles/1ecbde8dcaa44047899f618334033d43` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:46.612138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62281da4-3669-4e3a-af9b-b0ff21575b5e None admin] RBAC: Authorizing `identity:create_grant(project_id=32a6d4fba36a446bb95799ce1b96d071, group_id=cdb07e9a184d4da5a24c67c0975309b1, role_id=1ecbde8dcaa44047899f618334033d43)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:46.614062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62281da4-3669-4e3a-af9b-b0ff21575b5e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:46.639507 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 201/411] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Jun 2 18:47:46 2022] PUT /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071/groups/cdb07e9a184d4da5a24c67c0975309b1/roles/1ecbde8dcaa44047899f618334033d43 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:47:46.655625 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:46.684128 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36881beb-7daa-4df1-b3fa-47ec9cde812c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:46.690430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258a2f2-6124-4430-a397-2188f8e60d9f None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:46.691050 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258a2f2-6124-4430-a397-2188f8e60d9f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:46.691490 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258a2f2-6124-4430-a397-2188f8e60d9f None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:46.693460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 202/412] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:46.701960 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fde702-0db6-4550-828e-880bfbe08a25 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:46.702306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fde702-0db6-4550-828e-880bfbe08a25 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:46.702506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fde702-0db6-4550-828e-880bfbe08a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:46.736422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be5ee2-db38-4e49-9da2-8a1b895802bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:46.737232 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be5ee2-db38-4e49-9da2-8a1b895802bb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:46.737519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be5ee2-db38-4e49-9da2-8a1b895802bb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:46.737813 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be5ee2-db38-4e49-9da2-8a1b895802bb None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:46.738770 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be5ee2-db38-4e49-9da2-8a1b895802bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:46.739137 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be5ee2-db38-4e49-9da2-8a1b895802bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:46.740602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be5ee2-db38-4e49-9da2-8a1b895802bb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:46.746947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-20fde702-0db6-4550-828e-880bfbe08a25 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:46.748444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-20fde702-0db6-4550-828e-880bfbe08a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:46.757529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 211/413] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:46.763765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be5ee2-db38-4e49-9da2-8a1b895802bb None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:46.878577 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 203/414] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:47:46.909458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be5ee2-db38-4e49-9da2-8a1b895802bb None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:46.910588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fde702-0db6-4550-828e-880bfbe08a25 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:46.967193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f2649-b210-48c1-a9f2-ecd4f3ff48cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:46.968131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f2649-b210-48c1-a9f2-ecd4f3ff48cf None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:46.968523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f2649-b210-48c1-a9f2-ecd4f3ff48cf None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:46.968800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f2649-b210-48c1-a9f2-ecd4f3ff48cf None admin] PATH_INFO: `/v3/groups/e5837fd1fbc5445ebfedef57815b7224` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:46.971030 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f2649-b210-48c1-a9f2-ecd4f3ff48cf None admin] RBAC: Authorizing `identity:get_group(group_id=e5837fd1fbc5445ebfedef57815b7224)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:46.971760 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:46.973247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f2649-b210-48c1-a9f2-ecd4f3ff48cf None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:46.975065 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 212/415] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 2 18:47:46 2022] GET /identity/v3/groups/e5837fd1fbc5445ebfedef57815b7224 => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:46.980718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f2649-b210-48c1-a9f2-ecd4f3ff48cf None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:46.995020 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:47.043347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fde702-0db6-4550-828e-880bfbe08a25 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:47.103895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf9f33-75a9-44f6-b8da-5d7555ceb1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:47.104732 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf9f33-75a9-44f6-b8da-5d7555ceb1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:47.105011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf9f33-75a9-44f6-b8da-5d7555ceb1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:47.105288 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf9f33-75a9-44f6-b8da-5d7555ceb1f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:47.125299 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf9f33-75a9-44f6-b8da-5d7555ceb1f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:47.133513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-47cf9f33-75a9-44f6-b8da-5d7555ceb1f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:47.133513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:47.133513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:47.133513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:47.133513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:47.133513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:47.133513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:47.133513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:47.133513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:47.133513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:47.133513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:47.133513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:47.133513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:47.133513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:47.133513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:47.133513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:47.134462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:47.134462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:47.134462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:47.134462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:47.134462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:47.134462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:47.134462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:47.134462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:47.134462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:47.134462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:47.134462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:47.134462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:47.134462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:47.134462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:47.134462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:47.134462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:47.135257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:47.135257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:47.135257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:47.135257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:47.135257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:47.135257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:47.135257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:47.135257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:47.135257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:47.135257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:47.135257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:47.135257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:47.136105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 204/416] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:47:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:47.139243 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f2649-b210-48c1-a9f2-ecd4f3ff48cf None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:47.148188 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf9f33-75a9-44f6-b8da-5d7555ceb1f0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:47.223982 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1775e8-ff97-4864-955c-9291ac025ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:47.224989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1775e8-ff97-4864-955c-9291ac025ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:47.225359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1775e8-ff97-4864-955c-9291ac025ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:47.225656 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1775e8-ff97-4864-955c-9291ac025ea1 None admin] PATH_INFO: `/v3/projects/b970ca87a411459db54f4a7b6d487f4a` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:47.230747 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1775e8-ff97-4864-955c-9291ac025ea1 None admin] RBAC: Authorizing `identity:get_project(project_id=b970ca87a411459db54f4a7b6d487f4a)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:47.232438 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1775e8-ff97-4864-955c-9291ac025ea1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:47.234276 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 213/417] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:46 2022] GET /identity/v3/projects/b970ca87a411459db54f4a7b6d487f4a => generated 344 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:47.239882 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1775e8-ff97-4864-955c-9291ac025ea1 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:47.261132 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf9f33-75a9-44f6-b8da-5d7555ceb1f0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:47.264466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:47.297635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb45582-4fd4-4011-bbdc-02c7d12bfb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:47.298349 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb45582-4fd4-4011-bbdc-02c7d12bfb3b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:47.298631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb45582-4fd4-4011-bbdc-02c7d12bfb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:47.298955 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb45582-4fd4-4011-bbdc-02c7d12bfb3b None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:47.299793 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb45582-4fd4-4011-bbdc-02c7d12bfb3b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:47.300102 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb45582-4fd4-4011-bbdc-02c7d12bfb3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:47.301498 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb45582-4fd4-4011-bbdc-02c7d12bfb3b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:47.321821 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 205/418] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:47:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:47.323244 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb45582-4fd4-4011-bbdc-02c7d12bfb3b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:47.394376 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:47.428218 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1775e8-ff97-4864-955c-9291ac025ea1 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:47.469687 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd8348-3c83-4600-a7bd-6a27411fda28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:47.470931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd8348-3c83-4600-a7bd-6a27411fda28 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:47.471350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd8348-3c83-4600-a7bd-6a27411fda28 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:47.471761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd8348-3c83-4600-a7bd-6a27411fda28 None admin] PATH_INFO: `/v3/projects/b970ca87a411459db54f4a7b6d487f4a/groups/e5837fd1fbc5445ebfedef57815b7224/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:47.474621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd8348-3c83-4600-a7bd-6a27411fda28 None admin] RBAC: Authorizing `identity:create_grant(project_id=b970ca87a411459db54f4a7b6d487f4a, group_id=e5837fd1fbc5445ebfedef57815b7224, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:47.476227 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd8348-3c83-4600-a7bd-6a27411fda28 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:47.502184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 214/419] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Jun 2 18:47:47 2022] PUT /identity/v3/projects/b970ca87a411459db54f4a7b6d487f4a/groups/e5837fd1fbc5445ebfedef57815b7224/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:47:47.520857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb45582-4fd4-4011-bbdc-02c7d12bfb3b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:47.568380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d7dd1-81ee-4900-8f42-0f94be25d4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:47.569110 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d7dd1-81ee-4900-8f42-0f94be25d4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:47.569598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d7dd1-81ee-4900-8f42-0f94be25d4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:47.569970 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d7dd1-81ee-4900-8f42-0f94be25d4b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:47.626844 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:47.679634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d7dd1-81ee-4900-8f42-0f94be25d4b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:47.681164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d7dd1-81ee-4900-8f42-0f94be25d4b3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:47.724766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07629da5-1cd9-4a64-bcb8-df25cd963058 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:47.725283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07629da5-1cd9-4a64-bcb8-df25cd963058 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:47.725700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07629da5-1cd9-4a64-bcb8-df25cd963058 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:47.727537 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 215/420] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:47:47.733480 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad1eba-97e6-41e5-9908-1855c5d44b33 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:47.734012 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad1eba-97e6-41e5-9908-1855c5d44b33 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:47.734447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad1eba-97e6-41e5-9908-1855c5d44b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:47.752266 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-91ad1eba-97e6-41e5-9908-1855c5d44b33 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:47.753767 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-91ad1eba-97e6-41e5-9908-1855c5d44b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:47.817454 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 206/421] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 18:47:47.823391 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d7dd1-81ee-4900-8f42-0f94be25d4b3 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:47.835099 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 216/422] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:47:47.858675 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad1eba-97e6-41e5-9908-1855c5d44b33 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:47.902501 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:47.928708 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:47.948060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d7dd1-81ee-4900-8f42-0f94be25d4b3 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:47.975043 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad1eba-97e6-41e5-9908-1855c5d44b33 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:48.013470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46692c43-b0c5-4d1b-9adc-64f434bd414e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:48.014383 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692c43-b0c5-4d1b-9adc-64f434bd414e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:48.014651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692c43-b0c5-4d1b-9adc-64f434bd414e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:48.014918 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692c43-b0c5-4d1b-9adc-64f434bd414e None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:48.016691 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46692c43-b0c5-4d1b-9adc-64f434bd414e None admin] RBAC: Authorizing `identity:get_project(project_id=cb94aac4115444f781367f00674d4de8)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:48.018169 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46692c43-b0c5-4d1b-9adc-64f434bd414e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:48.021517 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 207/423] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:47 2022] GET /identity/v3/projects/cb94aac4115444f781367f00674d4de8 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:48.025560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46692c43-b0c5-4d1b-9adc-64f434bd414e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:48.039431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e6fa0-71de-4192-ac92-d214b864fbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:48.040248 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e6fa0-71de-4192-ac92-d214b864fbee None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:48.040573 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e6fa0-71de-4192-ac92-d214b864fbee None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:48.040845 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e6fa0-71de-4192-ac92-d214b864fbee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:48.059379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e6fa0-71de-4192-ac92-d214b864fbee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:48.067592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-956e6fa0-71de-4192-ac92-d214b864fbee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:48.067592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:48.067592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:48.067592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:48.067592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:48.067592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:48.067592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:48.067592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:48.067592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:48.067592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:48.067592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:48.067592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:48.067592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:48.067592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:48.067592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:48.067592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:48.068558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:48.068558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:48.068558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:48.068558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:48.068558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:48.068558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:48.068558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:48.068558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:48.068558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:48.068558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:48.068558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:48.068558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:48.068558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:48.068558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:48.068558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:48.068558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:48.069332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:48.069332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:48.069332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:48.069332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:48.069332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:48.069332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:48.069332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:48.069332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:48.069332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:48.069332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:48.069332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:48.069332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:48.069332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 217/424] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:47:48.074780 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e6fa0-71de-4192-ac92-d214b864fbee None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:48.182854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e6fa0-71de-4192-ac92-d214b864fbee None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:48.210009 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:48.227293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984b30a-0537-4b12-8502-8db2baef012e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:48.227988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984b30a-0537-4b12-8502-8db2baef012e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:48.228264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984b30a-0537-4b12-8502-8db2baef012e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:48.228530 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984b30a-0537-4b12-8502-8db2baef012e None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:48.229281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984b30a-0537-4b12-8502-8db2baef012e None admin] RBAC: Adding query filter params (name=member) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:48.229844 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984b30a-0537-4b12-8502-8db2baef012e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:48.232327 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984b30a-0537-4b12-8502-8db2baef012e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:48.247412 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 218/425] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:48.255256 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984b30a-0537-4b12-8502-8db2baef012e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:48.299892 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46692c43-b0c5-4d1b-9adc-64f434bd414e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:48.374701 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99af3e-904c-45a0-9088-8947b7f4c294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:48.375559 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99af3e-904c-45a0-9088-8947b7f4c294 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:48.375843 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99af3e-904c-45a0-9088-8947b7f4c294 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:48.376131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99af3e-904c-45a0-9088-8947b7f4c294 None admin] PATH_INFO: `/v3/groups/cdb07e9a184d4da5a24c67c0975309b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:48.377337 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99af3e-904c-45a0-9088-8947b7f4c294 None admin] RBAC: Authorizing `identity:get_group(group_id=cdb07e9a184d4da5a24c67c0975309b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:48.378836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99af3e-904c-45a0-9088-8947b7f4c294 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:48.380791 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 208/426] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 2 18:47:48 2022] GET /identity/v3/groups/cdb07e9a184d4da5a24c67c0975309b1 => generated 226 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:48.386260 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99af3e-904c-45a0-9088-8947b7f4c294 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:48.391665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:48.408660 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984b30a-0537-4b12-8502-8db2baef012e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:48.489919 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a74aa4-19b7-42f8-b647-551282ee64d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:48.490554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a74aa4-19b7-42f8-b647-551282ee64d9 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:48.490863 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a74aa4-19b7-42f8-b647-551282ee64d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:48.491432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a74aa4-19b7-42f8-b647-551282ee64d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:48.586935 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99af3e-904c-45a0-9088-8947b7f4c294 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:48.605197 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:48.621138 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a74aa4-19b7-42f8-b647-551282ee64d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:48.623794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a74aa4-19b7-42f8-b647-551282ee64d9 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:48.651855 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69216070-079a-4385-ae8f-5a8266112987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:48.652529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69216070-079a-4385-ae8f-5a8266112987 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:48.652813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69216070-079a-4385-ae8f-5a8266112987 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:48.653089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69216070-079a-4385-ae8f-5a8266112987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:48.654280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69216070-079a-4385-ae8f-5a8266112987 None admin] RBAC: Adding query filter params (group.id=cdb07e9a184d4da5a24c67c0975309b1, role.id=1ecbde8dcaa44047899f618334033d43, scope.project.id=cb94aac4115444f781367f00674d4de8) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:48.654405 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69216070-079a-4385-ae8f-5a8266112987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:48.655828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69216070-079a-4385-ae8f-5a8266112987 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:48.669771 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 209/427] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 2 18:47:48 2022] GET /identity/v3/role_assignments?group.id=cdb07e9a184d4da5a24c67c0975309b1&scope.project.id=cb94aac4115444f781367f00674d4de8&role.id=1ecbde8dcaa44047899f618334033d43 => generated 611 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:48.739646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 219/428] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:47:48.745708 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69216070-079a-4385-ae8f-5a8266112987 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:48.861467 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:48.909006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69216070-079a-4385-ae8f-5a8266112987 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:48.945363 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ca4ae-9abe-4397-8268-fb796c053443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:48.946279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ca4ae-9abe-4397-8268-fb796c053443 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:48.946563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ca4ae-9abe-4397-8268-fb796c053443 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:48.946840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ca4ae-9abe-4397-8268-fb796c053443 None admin] PATH_INFO: `/v3/projects/cb94aac4115444f781367f00674d4de8` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:48.948026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ca4ae-9abe-4397-8268-fb796c053443 None admin] RBAC: Authorizing `identity:get_project(project_id=cb94aac4115444f781367f00674d4de8)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:48.949488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ca4ae-9abe-4397-8268-fb796c053443 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:48.951721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 210/429] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:48 2022] GET /identity/v3/projects/cb94aac4115444f781367f00674d4de8 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:48.957195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a74aa4-19b7-42f8-b647-551282ee64d9 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:49.058916 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:49.072964 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a74aa4-19b7-42f8-b647-551282ee64d9 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:49.115393 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49282d2e-8938-41f3-be25-9698ba08ac44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:49.116570 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49282d2e-8938-41f3-be25-9698ba08ac44 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:49.116996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49282d2e-8938-41f3-be25-9698ba08ac44 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:49.117413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49282d2e-8938-41f3-be25-9698ba08ac44 None admin] PATH_INFO: `/v3/groups/cdb07e9a184d4da5a24c67c0975309b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:49.118777 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49282d2e-8938-41f3-be25-9698ba08ac44 None admin] RBAC: Authorizing `identity:get_group(group_id=cdb07e9a184d4da5a24c67c0975309b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:49.120368 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49282d2e-8938-41f3-be25-9698ba08ac44 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:49.125206 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 220/430] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 2 18:47:48 2022] GET /identity/v3/groups/cdb07e9a184d4da5a24c67c0975309b1 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:49.131352 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ca4ae-9abe-4397-8268-fb796c053443 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:49.247103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ca4ae-9abe-4397-8268-fb796c053443 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:49.285319 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03779c07-c57d-4a68-8e8e-56a14bac29cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:49.286055 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03779c07-c57d-4a68-8e8e-56a14bac29cd None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:49.286342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03779c07-c57d-4a68-8e8e-56a14bac29cd None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:49.286615 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03779c07-c57d-4a68-8e8e-56a14bac29cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:49.287452 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03779c07-c57d-4a68-8e8e-56a14bac29cd None admin] RBAC: Adding query filter params (group.id=cdb07e9a184d4da5a24c67c0975309b1, role.id=3e320079a5ce471e863ad87a36be46b1, scope.project.id=cb94aac4115444f781367f00674d4de8) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:49.287761 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03779c07-c57d-4a68-8e8e-56a14bac29cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:49.289280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03779c07-c57d-4a68-8e8e-56a14bac29cd None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:49.295960 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 211/431] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 2 18:47:49 2022] GET /identity/v3/role_assignments?group.id=cdb07e9a184d4da5a24c67c0975309b1&scope.project.id=cb94aac4115444f781367f00674d4de8&role.id=3e320079a5ce471e863ad87a36be46b1 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:49.296225 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:49.352474 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97793bc-8ae9-4320-afb6-c6fa890ee745 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:49.352757 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97793bc-8ae9-4320-afb6-c6fa890ee745 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:49.353102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97793bc-8ae9-4320-afb6-c6fa890ee745 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:49.354810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 221/432] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:49.360530 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dc58f-b600-4521-a259-8ad287ae0c76 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:49.360998 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dc58f-b600-4521-a259-8ad287ae0c76 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:49.361071 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dc58f-b600-4521-a259-8ad287ae0c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:49.383948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-355dc58f-b600-4521-a259-8ad287ae0c76 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:49.385176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-355dc58f-b600-4521-a259-8ad287ae0c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:49.460864 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 212/433] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:49.485238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97793bc-8ae9-4320-afb6-c6fa890ee745 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:49.606928 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97793bc-8ae9-4320-afb6-c6fa890ee745 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:49.645403 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de12c0-aa24-4b2b-b5ae-dd9913d80918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:49.646373 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de12c0-aa24-4b2b-b5ae-dd9913d80918 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:49.646676 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de12c0-aa24-4b2b-b5ae-dd9913d80918 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:49.646947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de12c0-aa24-4b2b-b5ae-dd9913d80918 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:49.658653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de12c0-aa24-4b2b-b5ae-dd9913d80918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:49.662973 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbe7bd-d105-40c3-a4d3-40e99750bc46 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:49.663253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbe7bd-d105-40c3-a4d3-40e99750bc46 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:49.663526 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbe7bd-d105-40c3-a4d3-40e99750bc46 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:49.664907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 213/434] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:47:49.666617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-a3de12c0-aa24-4b2b-b5ae-dd9913d80918 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:49.666617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:49.666617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:49.666617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:49.666617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:49.666617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:49.666617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:49.666617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:49.666617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:49.666617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:49.666617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:49.666617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:49.666617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:49.666617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:49.666617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:49.666617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:49.667499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:49.667499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:49.667499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:49.667499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:49.667499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:49.667499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:49.667499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:49.667499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:49.667499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:49.667499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:49.667499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:49.667499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:49.667499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:49.667499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:49.667499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:49.667499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:49.668712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:49.668712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:49.668712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:49.668712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:49.668712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:49.668712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:49.668712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:49.668712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:49.668712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:49.668712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:49.668712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 18:47:49.668712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:49.668712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 222/435] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:49.670058 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e3af0-d652-47e1-a1c6-96dc74467f74 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:49.670235 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e3af0-d652-47e1-a1c6-96dc74467f74 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:49.670512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e3af0-d652-47e1-a1c6-96dc74467f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:49.676045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de12c0-aa24-4b2b-b5ae-dd9913d80918 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:49.689979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-207e3af0-d652-47e1-a1c6-96dc74467f74 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:49.691675 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-207e3af0-d652-47e1-a1c6-96dc74467f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:49.697709 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:49.785859 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 214/436] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:47:49.791702 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de12c0-aa24-4b2b-b5ae-dd9913d80918 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:49.807607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e3af0-d652-47e1-a1c6-96dc74467f74 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:49.837774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb60ef-2ad6-4658-9325-6a3bfe4777b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:49.838479 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb60ef-2ad6-4658-9325-6a3bfe4777b1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:49.838756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb60ef-2ad6-4658-9325-6a3bfe4777b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:49.839024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb60ef-2ad6-4658-9325-6a3bfe4777b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:49.839772 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb60ef-2ad6-4658-9325-6a3bfe4777b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:49.840075 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb60ef-2ad6-4658-9325-6a3bfe4777b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:49.841666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb60ef-2ad6-4658-9325-6a3bfe4777b1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:49.850436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 223/437] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:47:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:49.856051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb60ef-2ad6-4658-9325-6a3bfe4777b1 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:49.883616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:49.945269 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e3af0-d652-47e1-a1c6-96dc74467f74 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:49.966481 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:49.994846 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb60ef-2ad6-4658-9325-6a3bfe4777b1 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:49.995036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1c165-5d34-4c20-a8af-9b88d57754cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:49.995763 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1c165-5d34-4c20-a8af-9b88d57754cb None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:49.996040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1c165-5d34-4c20-a8af-9b88d57754cb None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:49.996308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1c165-5d34-4c20-a8af-9b88d57754cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:50.010690 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1c165-5d34-4c20-a8af-9b88d57754cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:50.019754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-acb1c165-5d34-4c20-a8af-9b88d57754cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:50.019754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:50.019754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:50.019754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:50.019754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:50.019754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:50.019754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:50.019754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:50.019754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:50.019754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:50.019754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:50.019754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:50.019754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:50.019754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:50.019754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:50.019754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:50.020734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:50.020734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:50.020734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:50.020734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:50.020734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:50.020734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:50.020734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:50.020734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:50.020734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:50.020734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:50.020734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:50.020734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:50.020734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:50.020734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:50.020734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:50.020734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:50.021519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:50.021519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:50.021519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:50.021519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:50.021519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:50.021519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:50.021519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:50.021519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:50.021519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:50.021519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:50.021519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:50.021519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:50.021519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 215/438] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:47:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:47:50.026968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1c165-5d34-4c20-a8af-9b88d57754cb None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:50.042198 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ea22f-d0ee-48c2-a4cb-89c7b001914d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:50.043203 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ea22f-d0ee-48c2-a4cb-89c7b001914d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:50.043653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ea22f-d0ee-48c2-a4cb-89c7b001914d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:50.044216 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ea22f-d0ee-48c2-a4cb-89c7b001914d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:50.116929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ea22f-d0ee-48c2-a4cb-89c7b001914d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:50.118427 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ea22f-d0ee-48c2-a4cb-89c7b001914d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:50.133864 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1c165-5d34-4c20-a8af-9b88d57754cb None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:50.151234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:50.170665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253cf0f-67be-4a79-a76e-606afe0b6749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:50.171340 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253cf0f-67be-4a79-a76e-606afe0b6749 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:50.171675 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253cf0f-67be-4a79-a76e-606afe0b6749 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:50.171947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253cf0f-67be-4a79-a76e-606afe0b6749 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:50.172721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253cf0f-67be-4a79-a76e-606afe0b6749 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:50.173021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253cf0f-67be-4a79-a76e-606afe0b6749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:50.174455 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253cf0f-67be-4a79-a76e-606afe0b6749 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:50.183174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 216/439] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:47:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:50.188778 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253cf0f-67be-4a79-a76e-606afe0b6749 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:50.212867 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:50.238697 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 224/440] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 18:47:50.244015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ea22f-d0ee-48c2-a4cb-89c7b001914d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:50.293397 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253cf0f-67be-4a79-a76e-606afe0b6749 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:50.327351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac822c-daf8-4c44-aa09-84a836a62880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:50.327996 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac822c-daf8-4c44-aa09-84a836a62880 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:50.328276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac822c-daf8-4c44-aa09-84a836a62880 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:50.328549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac822c-daf8-4c44-aa09-84a836a62880 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:50.341134 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ea22f-d0ee-48c2-a4cb-89c7b001914d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:50.373838 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fb0e9-d464-4a16-94e0-fb9827323d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:50.374702 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fb0e9-d464-4a16-94e0-fb9827323d73 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:50.374979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fb0e9-d464-4a16-94e0-fb9827323d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:50.375252 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fb0e9-d464-4a16-94e0-fb9827323d73 None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:50.376077 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:50.376534 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fb0e9-d464-4a16-94e0-fb9827323d73 None admin] RBAC: Authorizing `identity:get_project(project_id=32a6d4fba36a446bb95799ce1b96d071)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:50.377978 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fb0e9-d464-4a16-94e0-fb9827323d73 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:50.379690 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 225/441] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:50 2022] GET /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:50.380872 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb089e9-109a-4ac3-abb2-8be9a17afe3c None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:50.381153 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb089e9-109a-4ac3-abb2-8be9a17afe3c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:50.381433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb089e9-109a-4ac3-abb2-8be9a17afe3c None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:50.382673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 226/442] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:50.387609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb089e9-109a-4ac3-abb2-8be9a17afe3c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:50.396702 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac822c-daf8-4c44-aa09-84a836a62880 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:50.398217 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac822c-daf8-4c44-aa09-84a836a62880 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:50.435289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:50.489127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb089e9-109a-4ac3-abb2-8be9a17afe3c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:50.496303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 217/443] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 18:47:50.497972 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388dd4f-6310-4b44-9820-967ed0c7ac7f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:50.498264 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388dd4f-6310-4b44-9820-967ed0c7ac7f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:50.498512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388dd4f-6310-4b44-9820-967ed0c7ac7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:50.515199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d388dd4f-6310-4b44-9820-967ed0c7ac7f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:50.516396 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d388dd4f-6310-4b44-9820-967ed0c7ac7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:50.526972 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e448b-c610-4053-8a8d-a55cc6a04b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:50.527847 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e448b-c610-4053-8a8d-a55cc6a04b50 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:50.528116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e448b-c610-4053-8a8d-a55cc6a04b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:50.528439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e448b-c610-4053-8a8d-a55cc6a04b50 None admin] PATH_INFO: `/v3/groups/cdb07e9a184d4da5a24c67c0975309b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:50.529889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e448b-c610-4053-8a8d-a55cc6a04b50 None admin] RBAC: Authorizing `identity:get_group(group_id=cdb07e9a184d4da5a24c67c0975309b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:50.531450 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e448b-c610-4053-8a8d-a55cc6a04b50 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:50.538504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 227/444] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 2 18:47:50 2022] GET /identity/v3/groups/cdb07e9a184d4da5a24c67c0975309b1 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:50.538504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e448b-c610-4053-8a8d-a55cc6a04b50 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:50.583904 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 218/445] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:50.584741 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388dd4f-6310-4b44-9820-967ed0c7ac7f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:50.596007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:50.643030 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e448b-c610-4053-8a8d-a55cc6a04b50 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:50.657173 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:50.677029 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7efe8-c8dd-4fa0-95bd-2a310f97470a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:50.677922 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7efe8-c8dd-4fa0-95bd-2a310f97470a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:50.678196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7efe8-c8dd-4fa0-95bd-2a310f97470a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:50.678459 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7efe8-c8dd-4fa0-95bd-2a310f97470a None admin] PATH_INFO: `/v3/projects/32a6d4fba36a446bb95799ce1b96d071` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:50.679612 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7efe8-c8dd-4fa0-95bd-2a310f97470a None admin] RBAC: Authorizing `identity:get_project(project_id=32a6d4fba36a446bb95799ce1b96d071)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:50.681051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7efe8-c8dd-4fa0-95bd-2a310f97470a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:50.682775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 228/446] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:50 2022] GET /identity/v3/projects/32a6d4fba36a446bb95799ce1b96d071 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:50.682895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388dd4f-6310-4b44-9820-967ed0c7ac7f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:50.683513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7efe8-c8dd-4fa0-95bd-2a310f97470a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:50.720204 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89333f-291d-429a-b3dc-c4a71520b952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:50.720858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89333f-291d-429a-b3dc-c4a71520b952 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:50.721135 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89333f-291d-429a-b3dc-c4a71520b952 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:50.721403 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89333f-291d-429a-b3dc-c4a71520b952 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:50.722262 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89333f-291d-429a-b3dc-c4a71520b952 None admin] RBAC: Adding query filter params (group.id=cdb07e9a184d4da5a24c67c0975309b1, role.id=3e320079a5ce471e863ad87a36be46b1, scope.project.id=32a6d4fba36a446bb95799ce1b96d071) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:50.722569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89333f-291d-429a-b3dc-c4a71520b952 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:50.724023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89333f-291d-429a-b3dc-c4a71520b952 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:50.729915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 219/447] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 2 18:47:50 2022] GET /identity/v3/role_assignments?group.id=cdb07e9a184d4da5a24c67c0975309b1&scope.project.id=32a6d4fba36a446bb95799ce1b96d071&role.id=3e320079a5ce471e863ad87a36be46b1 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:50.730702 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89333f-291d-429a-b3dc-c4a71520b952 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:50.788195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7efe8-c8dd-4fa0-95bd-2a310f97470a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:50.816795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:50.828825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e4ade-953b-47a9-97d7-2a0dadc40ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:50.829661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e4ade-953b-47a9-97d7-2a0dadc40ddd None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:50.829979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e4ade-953b-47a9-97d7-2a0dadc40ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:50.830250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e4ade-953b-47a9-97d7-2a0dadc40ddd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:50.848151 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e4ade-953b-47a9-97d7-2a0dadc40ddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:50.849534 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89333f-291d-429a-b3dc-c4a71520b952 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:50.856745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-347e4ade-953b-47a9-97d7-2a0dadc40ddd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:47:50.856745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:50.856745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:50.856745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:50.856745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:50.856745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:50.856745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:50.856745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:50.856745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:50.856745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:50.856745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:50.856745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:50.856745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:50.856745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:50.856745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:50.856745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:50.857726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:50.857726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:50.857726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:50.857726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:50.857726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:50.857726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:50.857726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:50.857726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:50.857726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:50.857726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:50.857726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:50.857726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:50.857726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:50.857726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:50.857726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:50.857726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:50.864333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:50.864333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:50.864333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:50.864333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:50.864333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:50.864333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:50.864333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:50.864333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:50.864333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:50.864333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:50.864333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:47:50.864333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:50.864333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 229/448] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:47:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:50.864333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e4ade-953b-47a9-97d7-2a0dadc40ddd None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:50.895646 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a63780-09cb-4f18-a9ce-64ca60ffcf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:50.896441 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a63780-09cb-4f18-a9ce-64ca60ffcf46 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:50.896719 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a63780-09cb-4f18-a9ce-64ca60ffcf46 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:50.896993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a63780-09cb-4f18-a9ce-64ca60ffcf46 None admin] PATH_INFO: `/v3/groups/cdb07e9a184d4da5a24c67c0975309b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:50.898390 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a63780-09cb-4f18-a9ce-64ca60ffcf46 None admin] RBAC: Authorizing `identity:get_group(group_id=cdb07e9a184d4da5a24c67c0975309b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:50.900274 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a63780-09cb-4f18-a9ce-64ca60ffcf46 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:50.902119 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 220/449] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 2 18:47:50 2022] GET /identity/v3/groups/cdb07e9a184d4da5a24c67c0975309b1 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:50.908670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a63780-09cb-4f18-a9ce-64ca60ffcf46 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:50.924458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:50.988073 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e4ade-953b-47a9-97d7-2a0dadc40ddd None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:51.028414 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a27893-5f88-4a2c-8b0f-1c03d60860bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:51.029098 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a27893-5f88-4a2c-8b0f-1c03d60860bb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:51.029381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a27893-5f88-4a2c-8b0f-1c03d60860bb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:51.029651 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a27893-5f88-4a2c-8b0f-1c03d60860bb None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:51.030431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a27893-5f88-4a2c-8b0f-1c03d60860bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:51.030732 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a27893-5f88-4a2c-8b0f-1c03d60860bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:51.032125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a27893-5f88-4a2c-8b0f-1c03d60860bb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:51.033341 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a63780-09cb-4f18-a9ce-64ca60ffcf46 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:51.042664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 230/450] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:47:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:51.048544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a27893-5f88-4a2c-8b0f-1c03d60860bb None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:51.073472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6b6d6-e28a-4b2e-a2f4-167dcf3adc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:51.074325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6b6d6-e28a-4b2e-a2f4-167dcf3adc43 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:51.074604 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6b6d6-e28a-4b2e-a2f4-167dcf3adc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:51.074878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6b6d6-e28a-4b2e-a2f4-167dcf3adc43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:51.075761 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6b6d6-e28a-4b2e-a2f4-167dcf3adc43 None admin] RBAC: Adding query filter params (group.id=cdb07e9a184d4da5a24c67c0975309b1, role.id=1ecbde8dcaa44047899f618334033d43, scope.project.id=32a6d4fba36a446bb95799ce1b96d071) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:51.076105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6b6d6-e28a-4b2e-a2f4-167dcf3adc43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:51.077572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6b6d6-e28a-4b2e-a2f4-167dcf3adc43 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:51.084662 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 221/451] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 2 18:47:50 2022] GET /identity/v3/role_assignments?group.id=cdb07e9a184d4da5a24c67c0975309b1&scope.project.id=32a6d4fba36a446bb95799ce1b96d071&role.id=1ecbde8dcaa44047899f618334033d43 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:51.171819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a27893-5f88-4a2c-8b0f-1c03d60860bb None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:51.175161 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:51.208250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a5554-5bc8-4671-aad1-7ad8ec4fb936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:51.208915 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5554-5bc8-4671-aad1-7ad8ec4fb936 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:51.209193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5554-5bc8-4671-aad1-7ad8ec4fb936 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:51.209461 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5554-5bc8-4671-aad1-7ad8ec4fb936 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:51.281948 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a5554-5bc8-4671-aad1-7ad8ec4fb936 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:51.283427 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a5554-5bc8-4671-aad1-7ad8ec4fb936 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:51.387035 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 231/452] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:47:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 18:47:51.393506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6b6d6-e28a-4b2e-a2f4-167dcf3adc43 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:51.403257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:51.498939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6b6d6-e28a-4b2e-a2f4-167dcf3adc43 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:51.536064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda96d5a-1c2f-461f-866a-f6b3b7d733c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:51.537434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda96d5a-1c2f-461f-866a-f6b3b7d733c9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:51.537919 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda96d5a-1c2f-461f-866a-f6b3b7d733c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:51.538400 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda96d5a-1c2f-461f-866a-f6b3b7d733c9 None admin] PATH_INFO: `/v3/projects/b970ca87a411459db54f4a7b6d487f4a` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:51.540439 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda96d5a-1c2f-461f-866a-f6b3b7d733c9 None admin] RBAC: Authorizing `identity:get_project(project_id=b970ca87a411459db54f4a7b6d487f4a)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:51.542847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda96d5a-1c2f-461f-866a-f6b3b7d733c9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:51.545013 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 222/453] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:47:51 2022] GET /identity/v3/projects/b970ca87a411459db54f4a7b6d487f4a => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:51.550743 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a5554-5bc8-4671-aad1-7ad8ec4fb936 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:51.554566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:51.652658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a5554-5bc8-4671-aad1-7ad8ec4fb936 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:51.688561 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30e2e7-859c-4ca6-aaef-a68362bd843f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:51.689412 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30e2e7-859c-4ca6-aaef-a68362bd843f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:51.689686 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30e2e7-859c-4ca6-aaef-a68362bd843f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:51.689982 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30e2e7-859c-4ca6-aaef-a68362bd843f None admin] PATH_INFO: `/v3/groups/e5837fd1fbc5445ebfedef57815b7224` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:51.691270 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30e2e7-859c-4ca6-aaef-a68362bd843f None admin] RBAC: Authorizing `identity:get_group(group_id=e5837fd1fbc5445ebfedef57815b7224)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:51.692716 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30e2e7-859c-4ca6-aaef-a68362bd843f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:51.694371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 232/454] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 2 18:47:51 2022] GET /identity/v3/groups/e5837fd1fbc5445ebfedef57815b7224 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:47:51.700481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda96d5a-1c2f-461f-866a-f6b3b7d733c9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:51.782340 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:51.813023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda96d5a-1c2f-461f-866a-f6b3b7d733c9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:51.853652 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dc129-2261-4383-aca2-2e6dc1ec80fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:51.854329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dc129-2261-4383-aca2-2e6dc1ec80fe None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:51.854618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dc129-2261-4383-aca2-2e6dc1ec80fe None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:51.854887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dc129-2261-4383-aca2-2e6dc1ec80fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:51.855713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dc129-2261-4383-aca2-2e6dc1ec80fe None admin] RBAC: Adding query filter params (group.id=e5837fd1fbc5445ebfedef57815b7224, role.id=8560bac1acf74dce81ea6a76f751b641, scope.project.id=b970ca87a411459db54f4a7b6d487f4a) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:51.856022 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dc129-2261-4383-aca2-2e6dc1ec80fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:51.857674 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dc129-2261-4383-aca2-2e6dc1ec80fe None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:51.863678 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 223/455] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 2 18:47:51 2022] GET /identity/v3/role_assignments?group.id=e5837fd1fbc5445ebfedef57815b7224&scope.project.id=b970ca87a411459db54f4a7b6d487f4a&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:54.917078 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a0cb2-dfce-48c1-9e4a-0d68659409b1 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:54.918312 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a0cb2-dfce-48c1-9e4a-0d68659409b1 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:54.918581 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a0cb2-dfce-48c1-9e4a-0d68659409b1 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:54.920471 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 233/456] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:54.922247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e4c2c-0fea-48a3-bdaa-cea0c32748ed None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:54.923101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e4c2c-0fea-48a3-bdaa-cea0c32748ed None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:54.923562 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e4c2c-0fea-48a3-bdaa-cea0c32748ed None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:54.925485 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 224/457] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:54.927130 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f25bb8-abe2-4e7a-a701-e2b10fb8595f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:54.927625 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f25bb8-abe2-4e7a-a701-e2b10fb8595f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:54.928080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f25bb8-abe2-4e7a-a701-e2b10fb8595f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:54.934685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad77d77-4391-4bb9-9ecf-f732021ebb7e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:54.936087 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad77d77-4391-4bb9-9ecf-f732021ebb7e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:54.936557 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad77d77-4391-4bb9-9ecf-f732021ebb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:54.951583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-14f25bb8-abe2-4e7a-a701-e2b10fb8595f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:54.953035 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-14f25bb8-abe2-4e7a-a701-e2b10fb8595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:54.964195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-dad77d77-4391-4bb9-9ecf-f732021ebb7e None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:54.965882 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-dad77d77-4391-4bb9-9ecf-f732021ebb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:55.026906 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 234/458] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:55.028829 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ea769-bd58-4bb4-86a8-178b6b56cbb7 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:55.029305 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ea769-bd58-4bb4-86a8-178b6b56cbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:55.029774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ea769-bd58-4bb4-86a8-178b6b56cbb7 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:55.031498 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 235/459] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:55.043227 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e58d67-3007-41ec-8de1-76487404510e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:55.043854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e58d67-3007-41ec-8de1-76487404510e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:55.044329 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e58d67-3007-41ec-8de1-76487404510e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:55.053480 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:55.067279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f8e58d67-3007-41ec-8de1-76487404510e None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:55.067975 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 225/460] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:55.068692 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad77d77-4391-4bb9-9ecf-f732021ebb7e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:55.069448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f8e58d67-3007-41ec-8de1-76487404510e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:55.143217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 236/461] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:47:55.144443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e58d67-3007-41ec-8de1-76487404510e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:55.166204 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:55.200565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad77d77-4391-4bb9-9ecf-f732021ebb7e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:55.234896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5ebf5-3728-4c56-8e48-3092b8f3a4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:55.235696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5ebf5-3728-4c56-8e48-3092b8f3a4aa None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:55.235973 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5ebf5-3728-4c56-8e48-3092b8f3a4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:55.236245 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5ebf5-3728-4c56-8e48-3092b8f3a4aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:55.246202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5ebf5-3728-4c56-8e48-3092b8f3a4aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:55.247876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5ebf5-3728-4c56-8e48-3092b8f3a4aa None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:55.256256 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e58d67-3007-41ec-8de1-76487404510e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:55.264907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-f4b5ebf5-3728-4c56-8e48-3092b8f3a4aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:47:55.264907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:55.264907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:55.264907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:55.264907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:55.264907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:55.264907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:55.264907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:55.264907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:55.264907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:55.264907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:55.264907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:55.264907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:47:55.264907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:47:55.264907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:47:55.265828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:47:55.265828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:55.265828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:55.265828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:55.265828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:55.265828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:55.265828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:55.265828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:55.265828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:55.265828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:55.265828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:55.265828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:55.265828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:55.265828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:55.265828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:55.265828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:55.265828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:55.266695 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:47:55.266695 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:47:55.266695 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:47:55.266695 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:55.266695 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 226/462] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:55.267424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05bf40-5a94-4da4-a9cc-361243516924 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:55.267707 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05bf40-5a94-4da4-a9cc-361243516924 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:55.267977 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05bf40-5a94-4da4-a9cc-361243516924 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:55.269384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 227/463] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:55.270578 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05bf40-5a94-4da4-a9cc-361243516924 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:55.292183 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:55.297891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e27aad-0048-4d55-9182-5c8019055909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:55.298705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e27aad-0048-4d55-9182-5c8019055909 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:55.298989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e27aad-0048-4d55-9182-5c8019055909 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:55.299675 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e27aad-0048-4d55-9182-5c8019055909 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:55.310475 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e27aad-0048-4d55-9182-5c8019055909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:55.312064 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e27aad-0048-4d55-9182-5c8019055909 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:55.330318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-23e27aad-0048-4d55-9182-5c8019055909 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:47:55.330318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:55.330318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:55.330318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:55.330318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:55.330318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:55.330318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:55.330318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:55.330318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:55.330318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:55.330318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:55.330318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:55.330318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:47:55.330318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:47:55.330318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:47:55.331238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:47:55.331238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:55.331238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:55.331238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:55.331238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:55.331238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:55.331238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:55.331238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:55.331238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:55.331238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:55.331238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:55.331238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:55.331238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:55.331238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:55.331238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:55.331238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:55.331238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:55.332096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:47:55.332096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:47:55.332096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:47:55.332096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:55.332096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 237/464] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:55.333221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e27aad-0048-4d55-9182-5c8019055909 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:55.393950 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05bf40-5a94-4da4-a9cc-361243516924 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:55.416233 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:55.431581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e03d68-3e2e-4a9f-96b6-561e05bd2fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:55.432375 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e03d68-3e2e-4a9f-96b6-561e05bd2fcf None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:55.432653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e03d68-3e2e-4a9f-96b6-561e05bd2fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:55.433078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e03d68-3e2e-4a9f-96b6-561e05bd2fcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:55.436858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e27aad-0048-4d55-9182-5c8019055909 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:55.443519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e03d68-3e2e-4a9f-96b6-561e05bd2fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:55.445082 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e03d68-3e2e-4a9f-96b6-561e05bd2fcf None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:55.463685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-b3e03d68-3e2e-4a9f-96b6-561e05bd2fcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:47:55.463685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:55.463685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:55.463685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:55.463685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:55.463685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:55.463685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:55.463685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:55.463685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:55.463685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:55.463685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:55.463685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:55.463685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:47:55.463685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:47:55.463685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:47:55.464546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:47:55.464546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:55.464546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:55.464546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:55.464546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:55.464546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:55.464546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:55.464546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:55.464546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:55.464546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:55.464546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:55.464546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:55.464546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:55.464546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:55.464546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:55.464546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:55.464546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:55.465365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:47:55.465365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:47:55.465365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:47:55.465365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:55.465365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 228/465] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:55.466261 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a2004-1818-49d4-8ebb-0ecb892b04dd None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:55.466455 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a2004-1818-49d4-8ebb-0ecb892b04dd None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:55.466730 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a2004-1818-49d4-8ebb-0ecb892b04dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:55.479464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5f71b-aadc-4911-91fd-a1f910fa8251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:55.480139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5f71b-aadc-4911-91fd-a1f910fa8251 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:55.480420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5f71b-aadc-4911-91fd-a1f910fa8251 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:55.480697 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5f71b-aadc-4911-91fd-a1f910fa8251 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:55.481679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5f71b-aadc-4911-91fd-a1f910fa8251 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:55.482048 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5f71b-aadc-4911-91fd-a1f910fa8251 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:55.483440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5f71b-aadc-4911-91fd-a1f910fa8251 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:55.484170 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d88a2004-1818-49d4-8ebb-0ecb892b04dd None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:55.485502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d88a2004-1818-49d4-8ebb-0ecb892b04dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:55.499848 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 238/466] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:55.499848 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5f71b-aadc-4911-91fd-a1f910fa8251 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:55.552599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:55.616006 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5f71b-aadc-4911-91fd-a1f910fa8251 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:55.654995 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b32ab-0928-4b30-b773-a1591f335016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:55.655664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b32ab-0928-4b30-b773-a1591f335016 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:55.655940 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b32ab-0928-4b30-b773-a1591f335016 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:55.656208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b32ab-0928-4b30-b773-a1591f335016 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:55.656937 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b32ab-0928-4b30-b773-a1591f335016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:55.657236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b32ab-0928-4b30-b773-a1591f335016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:55.658800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b32ab-0928-4b30-b773-a1591f335016 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:55.676417 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 239/467] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:55.676417 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b32ab-0928-4b30-b773-a1591f335016 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:55.699307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 229/468] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:55.699954 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a2004-1818-49d4-8ebb-0ecb892b04dd None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:55.790015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b32ab-0928-4b30-b773-a1591f335016 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:55.793312 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:55.818877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a2004-1818-49d4-8ebb-0ecb892b04dd None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:55.820742 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:55.827814 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427acf0-e926-4fa8-9b01-2fc42d88a096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:55.828457 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427acf0-e926-4fa8-9b01-2fc42d88a096 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:55.828738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427acf0-e926-4fa8-9b01-2fc42d88a096 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:55.829009 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427acf0-e926-4fa8-9b01-2fc42d88a096 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:55.829733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7427acf0-e926-4fa8-9b01-2fc42d88a096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:55.830059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7427acf0-e926-4fa8-9b01-2fc42d88a096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:55.831581 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7427acf0-e926-4fa8-9b01-2fc42d88a096 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:55.844339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 240/469] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:55.845394 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427acf0-e926-4fa8-9b01-2fc42d88a096 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:55.861470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16e713-2f61-4261-8878-83cbb552562f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:55.862202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16e713-2f61-4261-8878-83cbb552562f None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:55.862469 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16e713-2f61-4261-8878-83cbb552562f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:55.862745 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16e713-2f61-4261-8878-83cbb552562f None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:55.863463 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16e713-2f61-4261-8878-83cbb552562f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:55.864926 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16e713-2f61-4261-8878-83cbb552562f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:55.889449 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 230/470] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 2 18:47:55 2022] POST /identity/v3/users => generated 246 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:47:55.890548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16e713-2f61-4261-8878-83cbb552562f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:55.988640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427acf0-e926-4fa8-9b01-2fc42d88a096 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:56.021592 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16e713-2f61-4261-8878-83cbb552562f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:56.033885 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68944c-4f97-4448-b7d7-4d4f2d1f5b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:56.034724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68944c-4f97-4448-b7d7-4d4f2d1f5b18 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:56.035094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68944c-4f97-4448-b7d7-4d4f2d1f5b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:56.035460 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68944c-4f97-4448-b7d7-4d4f2d1f5b18 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:56.036349 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68944c-4f97-4448-b7d7-4d4f2d1f5b18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:56.037983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68944c-4f97-4448-b7d7-4d4f2d1f5b18 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:56.065747 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 241/471] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 2 18:47:55 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:47:56.066790 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68944c-4f97-4448-b7d7-4d4f2d1f5b18 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:56.069021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b8333-03ca-4c9a-9b31-a81662adffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:56.070413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b8333-03ca-4c9a-9b31-a81662adffd2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:56.070846 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b8333-03ca-4c9a-9b31-a81662adffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:56.072278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b8333-03ca-4c9a-9b31-a81662adffd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:56.087494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b8333-03ca-4c9a-9b31-a81662adffd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:56.090123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b8333-03ca-4c9a-9b31-a81662adffd2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:56.097416 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:56.129981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-3d6b8333-03ca-4c9a-9b31-a81662adffd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:47:56.129981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:56.129981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:56.129981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:56.129981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:56.129981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:56.129981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:56.129981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:56.129981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:56.129981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:56.129981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:56.129981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:56.129981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:47:56.129981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:47:56.129981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:47:56.131043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:47:56.131043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:56.131043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:56.131043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:56.131043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:56.131043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:56.131043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:56.131043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:56.131043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:56.131043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:56.131043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:56.131043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:56.131043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:56.131043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:56.131043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:56.131043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:56.131043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:56.132279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:47:56.132279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:47:56.132279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:47:56.132279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:56.134051 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 231/472] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:56.144897 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b8333-03ca-4c9a-9b31-a81662adffd2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:56.160774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:56.244776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68944c-4f97-4448-b7d7-4d4f2d1f5b18 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:56.286051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0413cd-1ea4-4e35-8e84-892aa4d5eb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:56.287112 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0413cd-1ea4-4e35-8e84-892aa4d5eb78 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:56.287559 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0413cd-1ea4-4e35-8e84-892aa4d5eb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:56.287963 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0413cd-1ea4-4e35-8e84-892aa4d5eb78 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:56.288823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0413cd-1ea4-4e35-8e84-892aa4d5eb78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:56.290015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b8333-03ca-4c9a-9b31-a81662adffd2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:56.290686 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0413cd-1ea4-4e35-8e84-892aa4d5eb78 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:56.318432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 242/473] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 2 18:47:56 2022] POST /identity/v3/users => generated 248 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:47:56.319681 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56204c-8207-46bf-a6d7-97734da2c2de None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:56.319973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56204c-8207-46bf-a6d7-97734da2c2de None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:56.320238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56204c-8207-46bf-a6d7-97734da2c2de None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:56.322588 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 243/474] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:56.329175 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06dfa9-d870-4f42-bab0-aa9d10435075 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:56.329532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06dfa9-d870-4f42-bab0-aa9d10435075 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:56.329734 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06dfa9-d870-4f42-bab0-aa9d10435075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:56.337347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f7ea7-5c52-4fac-b6b9-b8f9a74c50df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:56.338180 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f7ea7-5c52-4fac-b6b9-b8f9a74c50df None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:56.338473 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f7ea7-5c52-4fac-b6b9-b8f9a74c50df None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:56.338751 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f7ea7-5c52-4fac-b6b9-b8f9a74c50df None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:56.339697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f7ea7-5c52-4fac-b6b9-b8f9a74c50df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:56.340015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f7ea7-5c52-4fac-b6b9-b8f9a74c50df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:56.342298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f7ea7-5c52-4fac-b6b9-b8f9a74c50df None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:56.352969 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-fc06dfa9-d870-4f42-bab0-aa9d10435075 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:56.354462 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fc06dfa9-d870-4f42-bab0-aa9d10435075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:56.356196 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 232/475] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:56.364411 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f7ea7-5c52-4fac-b6b9-b8f9a74c50df None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:56.443090 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 244/476] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:56.458986 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:56.472663 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06dfa9-d870-4f42-bab0-aa9d10435075 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:56.491772 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:56.499006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f7ea7-5c52-4fac-b6b9-b8f9a74c50df None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:56.544612 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efd29d-5fa3-4013-9380-d6be5506ee3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:56.545318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efd29d-5fa3-4013-9380-d6be5506ee3b None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:56.546869 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efd29d-5fa3-4013-9380-d6be5506ee3b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:56.547169 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efd29d-5fa3-4013-9380-d6be5506ee3b None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:56.548135 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efd29d-5fa3-4013-9380-d6be5506ee3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:56.549644 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efd29d-5fa3-4013-9380-d6be5506ee3b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:56.585035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 233/477] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 2 18:47:56 2022] POST /identity/v3/users => generated 249 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:47:56.622469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06dfa9-d870-4f42-bab0-aa9d10435075 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:56.663221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513a08c-1375-4bc3-9e87-35fe13ab7b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:56.663911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513a08c-1375-4bc3-9e87-35fe13ab7b9a None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:56.664197 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513a08c-1375-4bc3-9e87-35fe13ab7b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:56.664479 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513a08c-1375-4bc3-9e87-35fe13ab7b9a None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:56.665293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513a08c-1375-4bc3-9e87-35fe13ab7b9a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:56.666833 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513a08c-1375-4bc3-9e87-35fe13ab7b9a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:56.676621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.sql.core [None req-1513a08c-1375-4bc3-9e87-35fe13ab7b9a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 18:47:56.676621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 18:47:56.676621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [parameters: {'id': 'd23cb2e8b7d2426aa069871cb5d32d21', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 18:47:56.676621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80258) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 18:47:56.694531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-1513a08c-1375-4bc3-9e87-35fe13ab7b9a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 18:47:56.694531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:56.694531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 18:47:56.694531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 18:47:56.694531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 18:47:56.694531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 18:47:56.694531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 18:47:56.694531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 18:47:56.694531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 18:47:56.694531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application conn.query(q) Jun 02 18:47:56.694531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 18:47:56.694531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 18:47:56.694531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 18:47:56.694531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application result.read() Jun 02 18:47:56.694531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 18:47:56.695531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 18:47:56.695531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 18:47:56.695531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 18:47:56.695531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 18:47:56.695531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 18:47:56.695531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 18:47:56.695531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 18:47:56.695531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 18:47:56.695531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:56.695531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 18:47:56.695531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:56.695531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:56.695531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 18:47:56.695531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 18:47:56.695531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 02 18:47:56.695531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return ref.to_dict() Jun 02 18:47:56.695531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 18:47:56.695531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application next(self.gen) Jun 02 18:47:56.696453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 18:47:56.696453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application yield resource Jun 02 18:47:56.696453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 18:47:56.696453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application next(self.gen) Jun 02 18:47:56.696453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 18:47:56.696453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 18:47:56.696453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 18:47:56.696453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 18:47:56.696453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 18:47:56.696453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise self.value Jun 02 18:47:56.696453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 18:47:56.696453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 18:47:56.696453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 18:47:56.696453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application session.commit() Jun 02 18:47:56.696453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 18:47:56.696453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 18:47:56.696453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 18:47:56.697300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 18:47:56.697300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 18:47:56.697300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.session.flush() Jun 02 18:47:56.697300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 18:47:56.697300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 18:47:56.697300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 18:47:56.697300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 18:47:56.697300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 18:47:56.697300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application compat.raise_( Jun 02 18:47:56.697300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 18:47:56.697300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception Jun 02 18:47:56.697300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 18:47:56.697300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 18:47:56.697300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 18:47:56.697300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 18:47:56.697300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 18:47:56.697300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 18:47:56.698211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 18:47:56.698211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 18:47:56.698211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 18:47:56.698211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 18:47:56.698211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 18:47:56.698211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 18:47:56.698211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 18:47:56.698211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 18:47:56.698211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 18:47:56.698211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 18:47:56.698211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 18:47:56.698211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 18:47:56.698211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 18:47:56.698211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 18:47:56.698211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 18:47:56.698211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception Jun 02 18:47:56.699044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 18:47:56.699044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 18:47:56.699044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 18:47:56.699044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 18:47:56.699044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 18:47:56.699044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 18:47:56.699044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 18:47:56.699044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application conn.query(q) Jun 02 18:47:56.699044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 18:47:56.699044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 18:47:56.699044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 18:47:56.699044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application result.read() Jun 02 18:47:56.699044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 18:47:56.699044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 18:47:56.699044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 18:47:56.699044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 18:47:56.699817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 18:47:56.699817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 18:47:56.699817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 18:47:56.699817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 18:47:56.699817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 18:47:56.699817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 18:47:56.699817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [parameters: {'id': 'd23cb2e8b7d2426aa069871cb5d32d21', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 18:47:56.699817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 18:47:56.699817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:56.699817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:47:56.699817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:56.699817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:56.699817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:56.699817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:56.699817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:56.699817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:56.700653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:56.700653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:56.700653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:56.700653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:56.700653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:56.700653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:56.700653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 02 18:47:56.700653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 02 18:47:56.700653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:56.700653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:56.700653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 02 18:47:56.700653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 02 18:47:56.700653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 18:47:56.700653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 18:47:56.700653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 18:47:56.700653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:56.701469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 245/478] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Jun 2 18:47:56 2022] POST /identity/v3/roles => generated 144 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:47:56.702878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efd29d-5fa3-4013-9380-d6be5506ee3b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:56.822008 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efd29d-5fa3-4013-9380-d6be5506ee3b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:56.852149 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:56.865697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93932fec-095f-4bbc-b189-bc48894b969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:56.866565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93932fec-095f-4bbc-b189-bc48894b969f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:56.866846 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93932fec-095f-4bbc-b189-bc48894b969f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:56.867121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93932fec-095f-4bbc-b189-bc48894b969f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:56.880146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93932fec-095f-4bbc-b189-bc48894b969f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:56.893303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-93932fec-095f-4bbc-b189-bc48894b969f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:56.893303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:56.893303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:56.893303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:56.893303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:56.893303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:56.893303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:56.893303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:56.893303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:56.893303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:56.893303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:56.893303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:56.893303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:56.893303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:56.893303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:56.893303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:56.894307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:56.894307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:56.894307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:56.894307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:56.894307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:56.894307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:56.894307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:56.894307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:56.894307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:56.894307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:56.894307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:56.894307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:56.894307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:56.894307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:56.894307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:56.894307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:56.895083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:56.895083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:56.895083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:56.895083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:56.895083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:56.895083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:56.895083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:56.895083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:56.895083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:56.895083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:56.895083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 18:47:56.895083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:56.895083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 234/479] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:47:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:56.900775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513a08c-1375-4bc3-9e87-35fe13ab7b9a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:56.978118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:57.014245 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513a08c-1375-4bc3-9e87-35fe13ab7b9a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:57.050414 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ea04f-0080-48ea-8f79-ecfed8e7bb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:57.051101 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea04f-0080-48ea-8f79-ecfed8e7bb77 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:57.051383 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea04f-0080-48ea-8f79-ecfed8e7bb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:57.051659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea04f-0080-48ea-8f79-ecfed8e7bb77 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:57.052417 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ea04f-0080-48ea-8f79-ecfed8e7bb77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:57.052725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ea04f-0080-48ea-8f79-ecfed8e7bb77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:57.054142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ea04f-0080-48ea-8f79-ecfed8e7bb77 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:57.069961 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 246/480] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:47:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:58.792750 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7835e53-8a7d-49a2-a8c2-3adee7217a45 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:58.793851 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7835e53-8a7d-49a2-a8c2-3adee7217a45 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:58.794368 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7835e53-8a7d-49a2-a8c2-3adee7217a45 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:58.796455 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 235/481] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:58.801948 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa587c-ae74-4131-9223-64745da37cb9 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:58.802849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa587c-ae74-4131-9223-64745da37cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:58.803324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa587c-ae74-4131-9223-64745da37cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:58.828318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-68fa587c-ae74-4131-9223-64745da37cb9 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:58.829984 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-68fa587c-ae74-4131-9223-64745da37cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:58.877131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f945c0-8087-4db0-9235-28fb82aba236 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:58.877449 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f945c0-8087-4db0-9235-28fb82aba236 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:58.877679 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f945c0-8087-4db0-9235-28fb82aba236 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:58.880304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 236/482] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:47:58.884187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9247e-bccd-4e96-918b-6cca26eb7472 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:58.884460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9247e-bccd-4e96-918b-6cca26eb7472 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:58.884735 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9247e-bccd-4e96-918b-6cca26eb7472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:58.902411 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-46b9247e-bccd-4e96-918b-6cca26eb7472 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:58.903381 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-46b9247e-bccd-4e96-918b-6cca26eb7472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:58.922025 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 247/483] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:58.944241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa587c-ae74-4131-9223-64745da37cb9 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:59.007075 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 237/484] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:47:59.032273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9247e-bccd-4e96-918b-6cca26eb7472 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:59.094197 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:59.144551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa587c-ae74-4131-9223-64745da37cb9 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:59.202863 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9247e-bccd-4e96-918b-6cca26eb7472 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:59.211619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad063c6-f324-4746-8174-8e6573435a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:59.212433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad063c6-f324-4746-8174-8e6573435a78 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:59.212708 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad063c6-f324-4746-8174-8e6573435a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:59.212979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad063c6-f324-4746-8174-8e6573435a78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:59.231934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad063c6-f324-4746-8174-8e6573435a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:59.240328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-8ad063c6-f324-4746-8174-8e6573435a78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:47:59.240328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:59.240328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:59.240328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:59.240328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:59.240328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:59.240328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:59.240328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:59.240328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:59.240328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:59.240328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:59.240328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:59.240328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:59.240328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:59.240328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:59.240328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:59.241313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:59.241313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:59.241313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:59.241313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:59.241313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:59.241313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:59.241313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:59.241313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:59.241313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:59.241313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:59.241313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:59.241313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:59.241313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:59.241313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:59.241313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:59.241313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:59.242705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:59.242705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:59.242705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:59.242705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:59.242705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:59.242705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:59.242705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:59.242705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:59.242705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:59.242705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:59.242705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:47:59.242705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:59.242705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 248/485] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:47:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:59.243374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:59.245839 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df724bdb-03b6-4253-a89b-d60905af5d76 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:59.245839 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df724bdb-03b6-4253-a89b-d60905af5d76 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:59.245839 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df724bdb-03b6-4253-a89b-d60905af5d76 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:59.247220 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 249/486] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:59.248497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df724bdb-03b6-4253-a89b-d60905af5d76 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:59.268894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466d912-ff1f-4481-ad7f-95c633b66051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:59.270208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d912-ff1f-4481-ad7f-95c633b66051 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:59.270677 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d912-ff1f-4481-ad7f-95c633b66051 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:59.271131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d912-ff1f-4481-ad7f-95c633b66051 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:59.283018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466d912-ff1f-4481-ad7f-95c633b66051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:59.291867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-3466d912-ff1f-4481-ad7f-95c633b66051 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:47:59.291867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:59.291867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:59.291867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:59.291867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:59.291867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:59.291867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:59.291867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:59.291867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:59.291867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:59.291867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:59.291867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:59.291867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:59.291867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:59.291867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:59.291867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:59.292915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:59.292915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:59.292915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:59.292915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:59.292915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:59.292915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:59.292915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:59.292915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:59.292915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:59.292915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:59.292915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:59.292915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:59.292915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:59.292915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:59.292915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:59.292915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:59.293820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:59.293820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:59.293820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:59.293820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:59.293820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:59.293820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:59.293820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:59.293820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:59.293820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:59.293820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:59.293820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:47:59.293820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:59.296613 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 238/487] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:47:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:59.298123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d47546-252b-4949-9ae6-114e23cbc383 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:59.298639 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d47546-252b-4949-9ae6-114e23cbc383 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:59.299096 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d47546-252b-4949-9ae6-114e23cbc383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:59.325350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-93d47546-252b-4949-9ae6-114e23cbc383 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:47:59.326941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-93d47546-252b-4949-9ae6-114e23cbc383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:47:59.391183 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df724bdb-03b6-4253-a89b-d60905af5d76 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:59.420605 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:59.426203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 239/488] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:47:59.427329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d47546-252b-4949-9ae6-114e23cbc383 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:59.439798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb50326-b3a7-473a-a34e-c6c22392eebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:59.440527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb50326-b3a7-473a-a34e-c6c22392eebb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:59.440806 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb50326-b3a7-473a-a34e-c6c22392eebb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:59.441119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb50326-b3a7-473a-a34e-c6c22392eebb None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:59.441947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb50326-b3a7-473a-a34e-c6c22392eebb None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:59.442251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb50326-b3a7-473a-a34e-c6c22392eebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:59.445592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb50326-b3a7-473a-a34e-c6c22392eebb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:59.459758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 250/489] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:47:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:59.460919 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb50326-b3a7-473a-a34e-c6c22392eebb None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:59.561615 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d47546-252b-4949-9ae6-114e23cbc383 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:59.569425 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:59.570968 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb50326-b3a7-473a-a34e-c6c22392eebb None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:59.599427 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06781ad4-e545-4b55-a414-2879a183b06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:59.600122 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06781ad4-e545-4b55-a414-2879a183b06e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:59.600492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06781ad4-e545-4b55-a414-2879a183b06e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:59.600859 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06781ad4-e545-4b55-a414-2879a183b06e None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:59.601705 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06781ad4-e545-4b55-a414-2879a183b06e None admin] RBAC: Adding query filter params (name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:59.602148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06781ad4-e545-4b55-a414-2879a183b06e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:59.603665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06781ad4-e545-4b55-a414-2879a183b06e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:59.608156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca812bc-3983-4a9e-afa8-2279f158b72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:59.609142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca812bc-3983-4a9e-afa8-2279f158b72e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:59.609564 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca812bc-3983-4a9e-afa8-2279f158b72e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:59.610014 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca812bc-3983-4a9e-afa8-2279f158b72e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:59.613418 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 240/490] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:47:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:59.614393 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06781ad4-e545-4b55-a414-2879a183b06e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:59.621512 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca812bc-3983-4a9e-afa8-2279f158b72e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:47:59.629886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-2ca812bc-3983-4a9e-afa8-2279f158b72e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:47:59.629886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:59.629886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:59.629886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:59.629886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:59.629886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:59.629886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:59.629886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:59.629886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:59.629886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:59.629886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:59.629886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:59.629886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:47:59.629886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:47:59.629886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:47:59.629886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:47:59.630823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:47:59.630823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:47:59.630823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:47:59.630823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:47:59.630823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:59.630823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:59.630823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:59.630823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:59.630823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:59.630823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:59.630823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:59.630823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:59.630823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:59.630823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:59.630823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:59.630823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:59.631629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:59.631629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:59.631629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:59.631629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:59.631629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:47:59.631629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:47:59.631629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:47:59.631629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:47:59.631629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:47:59.631629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:47:59.631629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:47:59.631629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:59.637932 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 251/491] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:47:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:59.638987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca812bc-3983-4a9e-afa8-2279f158b72e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:59.689891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:59.722626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06781ad4-e545-4b55-a414-2879a183b06e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:59.758475 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca812bc-3983-4a9e-afa8-2279f158b72e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:59.760665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11422d8-333e-4637-8440-1019e22e1a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:59.761469 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11422d8-333e-4637-8440-1019e22e1a22 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:59.761747 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11422d8-333e-4637-8440-1019e22e1a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:59.762059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11422d8-333e-4637-8440-1019e22e1a22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:59.773940 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11422d8-333e-4637-8440-1019e22e1a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:59.775389 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11422d8-333e-4637-8440-1019e22e1a22 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:59.792448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-f11422d8-333e-4637-8440-1019e22e1a22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:47:59.792448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:59.792448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:59.792448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:59.792448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:59.792448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:59.792448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:59.792448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:59.792448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:59.792448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:59.792448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:59.792448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:59.792448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:47:59.792448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:47:59.792448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:47:59.793849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:47:59.793849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:59.793849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:59.793849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:59.793849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:59.793849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:59.793849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:59.793849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:59.793849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:59.793849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:59.793849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:59.793849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:59.793849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:59.793849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:59.793849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:59.793849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:59.793849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:59.794695 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:47:59.794695 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:47:59.794695 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:47:59.794695 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:47:59.794695 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 241/492] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:59.794695 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11422d8-333e-4637-8440-1019e22e1a22 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:59.800526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b9b9b-13ea-40b7-b58a-8c5419b33ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:59.801573 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b9b9b-13ea-40b7-b58a-8c5419b33ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:59.802052 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b9b9b-13ea-40b7-b58a-8c5419b33ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:59.802590 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b9b9b-13ea-40b7-b58a-8c5419b33ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:59.815141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b9b9b-13ea-40b7-b58a-8c5419b33ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:59.817102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b9b9b-13ea-40b7-b58a-8c5419b33ba8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:59.824065 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:59.835453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-611b9b9b-13ea-40b7-b58a-8c5419b33ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:47:59.835453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:47:59.835453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:47:59.835453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:47:59.835453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:47:59.835453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:47:59.835453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:47:59.835453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:47:59.835453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:47:59.835453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:47:59.835453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:47:59.835453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:47:59.835453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:47:59.835453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:47:59.835453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:47:59.836310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:47:59.836310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:47:59.836310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:47:59.836310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:47:59.836310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:47:59.836310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:47:59.836310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:47:59.836310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:47:59.836310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:47:59.836310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:47:59.836310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:47:59.836310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:47:59.836310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:47:59.836310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:47:59.836310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:47:59.836310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:47:59.836310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:47:59.837236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:47:59.837236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:47:59.837236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:47:59.837236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:47:59.838940 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 252/493] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:47:59.840279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e6350-e067-46fa-b346-64c79513f31b None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:59.840769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e6350-e067-46fa-b346-64c79513f31b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:59.841177 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e6350-e067-46fa-b346-64c79513f31b None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:59.842614 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 253/494] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:47:59.843491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e6350-e067-46fa-b346-64c79513f31b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:59.909474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11422d8-333e-4637-8440-1019e22e1a22 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:59.946825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:47:59.948086 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face65e1-b2d9-43c0-8de8-26b8de6fb267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:59.948491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face65e1-b2d9-43c0-8de8-26b8de6fb267 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:59.948730 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face65e1-b2d9-43c0-8de8-26b8de6fb267 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:59.949179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face65e1-b2d9-43c0-8de8-26b8de6fb267 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:59.949765 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face65e1-b2d9-43c0-8de8-26b8de6fb267 None admin] RBAC: Adding query filter params (name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:59.950244 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face65e1-b2d9-43c0-8de8-26b8de6fb267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:59.951625 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face65e1-b2d9-43c0-8de8-26b8de6fb267 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:47:59.954631 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e6350-e067-46fa-b346-64c79513f31b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:47:59.965292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 242/495] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:47:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:47:59.965292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face65e1-b2d9-43c0-8de8-26b8de6fb267 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:47:59.994080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9371f9-864b-4bef-b894-9ff8f1654183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:47:59.994755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9371f9-864b-4bef-b894-9ff8f1654183 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:47:59.995031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9371f9-864b-4bef-b894-9ff8f1654183 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:47:59.995304 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9371f9-864b-4bef-b894-9ff8f1654183 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:47:59.996017 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9371f9-864b-4bef-b894-9ff8f1654183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:47:59.996316 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9371f9-864b-4bef-b894-9ff8f1654183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:47:59.997912 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9371f9-864b-4bef-b894-9ff8f1654183 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:00.010081 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 254/496] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:00.011367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093117c5-1171-44f9-b1eb-e0a38e76b8c0 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:00.011652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093117c5-1171-44f9-b1eb-e0a38e76b8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:00.011917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093117c5-1171-44f9-b1eb-e0a38e76b8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:00.028413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-093117c5-1171-44f9-b1eb-e0a38e76b8c0 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:00.029595 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-093117c5-1171-44f9-b1eb-e0a38e76b8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:00.053434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:00.071731 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face65e1-b2d9-43c0-8de8-26b8de6fb267 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:00.096558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 255/497] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:48:00.098549 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093117c5-1171-44f9-b1eb-e0a38e76b8c0 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:00.104826 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f860880-8509-4619-9c0a-60a7582c5fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:00.105495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f860880-8509-4619-9c0a-60a7582c5fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:00.105773 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f860880-8509-4619-9c0a-60a7582c5fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:00.106195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f860880-8509-4619-9c0a-60a7582c5fe8 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:00.107004 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f860880-8509-4619-9c0a-60a7582c5fe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:00.107294 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f860880-8509-4619-9c0a-60a7582c5fe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:00.108668 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f860880-8509-4619-9c0a-60a7582c5fe8 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:00.122285 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 243/498] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:00.122798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f860880-8509-4619-9c0a-60a7582c5fe8 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:00.187786 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:00.204172 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093117c5-1171-44f9-b1eb-e0a38e76b8c0 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:00.221399 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f860880-8509-4619-9c0a-60a7582c5fe8 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:00.239535 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d86f58-94b7-463c-984c-551f512817eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:00.240330 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d86f58-94b7-463c-984c-551f512817eb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:00.240602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d86f58-94b7-463c-984c-551f512817eb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:00.240868 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d86f58-94b7-463c-984c-551f512817eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:00.251131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d86f58-94b7-463c-984c-551f512817eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:00.252600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d86f58-94b7-463c-984c-551f512817eb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:00.255983 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b2d6b-97ca-4a62-be40-93abc71b54e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:00.256781 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b2d6b-97ca-4a62-be40-93abc71b54e2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:00.257059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b2d6b-97ca-4a62-be40-93abc71b54e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:00.257329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b2d6b-97ca-4a62-be40-93abc71b54e2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:00.264587 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b2d6b-97ca-4a62-be40-93abc71b54e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:00.266057 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b2d6b-97ca-4a62-be40-93abc71b54e2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:00.270936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-b0d86f58-94b7-463c-984c-551f512817eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:00.270936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:00.270936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:00.270936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:00.270936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:00.270936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:00.270936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:00.270936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:00.270936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:00.270936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:00.270936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:00.270936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:00.270936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:00.270936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:00.270936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:00.271787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:00.271787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:00.271787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:00.271787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:00.271787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:00.271787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:00.271787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:00.271787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:00.271787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:00.271787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:00.271787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:00.271787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:00.271787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:00.271787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:00.271787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:00.271787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:00.271787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:00.272633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:00.272633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:00.272633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:00.272633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:00.276687 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 256/499] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:00.277964 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bac6d9-a38f-4721-8b3f-e879a6a49090 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:00.278340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bac6d9-a38f-4721-8b3f-e879a6a49090 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:00.278605 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bac6d9-a38f-4721-8b3f-e879a6a49090 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:00.279860 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 257/500] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:00.280533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bac6d9-a38f-4721-8b3f-e879a6a49090 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:00.281861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-dc1b2d6b-97ca-4a62-be40-93abc71b54e2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 18:48:00.281861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:00.281861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:00.281861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:00.281861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:00.281861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:00.281861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:00.281861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:00.281861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:00.281861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:00.281861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:00.281861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:00.281861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:00.281861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:00.281861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:00.281861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:00.282712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:00.282712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:00.282712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:00.282712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:00.282712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:00.282712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:00.282712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:00.282712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:00.282712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:00.282712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:00.282712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:00.282712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:00.282712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:00.282712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:00.282712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:00.282712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:00.282712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:00.282712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:00.283717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:00.283717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:00.283717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:00.283717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:00.283717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:00.283717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:00.283717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:00.283717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:00.283717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 18:48:00.283717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:00.283717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 244/501] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:48:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:00.284757 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b2d6b-97ca-4a62-be40-93abc71b54e2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:00.287178 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:00.383321 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b2d6b-97ca-4a62-be40-93abc71b54e2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:00.387035 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bac6d9-a38f-4721-8b3f-e879a6a49090 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:00.416292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec180f-623b-48ca-995f-76613e17aa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:00.417091 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec180f-623b-48ca-995f-76613e17aa86 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:00.417371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec180f-623b-48ca-995f-76613e17aa86 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:00.417645 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec180f-623b-48ca-995f-76613e17aa86 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:00.419585 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ac68c-3825-4b2a-ab54-5d25858cdbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:00.420376 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ac68c-3825-4b2a-ab54-5d25858cdbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:00.420655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ac68c-3825-4b2a-ab54-5d25858cdbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:00.420926 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ac68c-3825-4b2a-ab54-5d25858cdbb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:00.425911 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec180f-623b-48ca-995f-76613e17aa86 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:00.427380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec180f-623b-48ca-995f-76613e17aa86 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:00.428263 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:00.432133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ac68c-3825-4b2a-ab54-5d25858cdbb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:00.440670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-461ac68c-3825-4b2a-ab54-5d25858cdbb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:00.440670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:00.440670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:00.440670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:00.440670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:00.440670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:00.440670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:00.440670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:00.440670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:00.440670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:00.440670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:00.440670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:00.440670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:00.440670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:00.440670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:00.440670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:00.441744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:00.441744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:00.441744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:00.441744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:00.441744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:00.441744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:00.441744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:00.441744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:00.441744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:00.441744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:00.441744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:00.441744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:00.441744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:00.441744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:00.441744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:00.441744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:00.442578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:00.442578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:00.442578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:00.442578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:00.442578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:00.442578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:00.442578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:00.442578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:00.442578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:00.442578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:00.442578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:00.442578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:00.442578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 258/502] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:48:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:00.443224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-d4ec180f-623b-48ca-995f-76613e17aa86 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 18:48:00.443224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:00.443224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:00.443224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:00.443224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:00.443224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:00.443224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:00.443224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:00.443224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:00.443224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:00.443224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:00.443224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:00.443224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:00.443224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:00.443224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:00.443224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:00.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:00.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:00.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:00.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:00.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:00.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:00.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:00.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:00.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:00.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:00.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:00.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:00.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:00.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:00.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:00.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:00.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:00.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:00.444976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:00.444976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:00.444976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:00.444976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:00.444976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:00.444976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:00.444976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:00.444976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:00.444976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 18:48:00.444976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:00.445489 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ac68c-3825-4b2a-ab54-5d25858cdbb0 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:00.445555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 245/503] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jun 2 18:48:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:00.445555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0660f9-a220-405f-975c-314ac3943a2f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:00.445555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0660f9-a220-405f-975c-314ac3943a2f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:00.445555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0660f9-a220-405f-975c-314ac3943a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:00.463553 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-7a0660f9-a220-405f-975c-314ac3943a2f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:00.464681 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7a0660f9-a220-405f-975c-314ac3943a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:00.521576 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:00.534796 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 246/504] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:48:00.535797 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0660f9-a220-405f-975c-314ac3943a2f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:00.555420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ac68c-3825-4b2a-ab54-5d25858cdbb0 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:00.590099 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98bb4c-33e4-4b22-bf4d-fa2877c2d87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:00.590960 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98bb4c-33e4-4b22-bf4d-fa2877c2d87d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:00.591313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98bb4c-33e4-4b22-bf4d-fa2877c2d87d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:00.591592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98bb4c-33e4-4b22-bf4d-fa2877c2d87d None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:00.592311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98bb4c-33e4-4b22-bf4d-fa2877c2d87d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:00.592617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98bb4c-33e4-4b22-bf4d-fa2877c2d87d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:00.594035 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98bb4c-33e4-4b22-bf4d-fa2877c2d87d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:00.605876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 259/505] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:00.607222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98bb4c-33e4-4b22-bf4d-fa2877c2d87d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:00.640134 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0660f9-a220-405f-975c-314ac3943a2f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:00.664231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:00.673133 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121fa25-5d53-4527-b7bc-aae54bce40eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:00.673826 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121fa25-5d53-4527-b7bc-aae54bce40eb None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:00.674133 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121fa25-5d53-4527-b7bc-aae54bce40eb None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:00.674397 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121fa25-5d53-4527-b7bc-aae54bce40eb None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:00.675235 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121fa25-5d53-4527-b7bc-aae54bce40eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:00.675534 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121fa25-5d53-4527-b7bc-aae54bce40eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:00.676970 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121fa25-5d53-4527-b7bc-aae54bce40eb None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:00.707454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98bb4c-33e4-4b22-bf4d-fa2877c2d87d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:00.713879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 247/506] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Jun 2 18:48:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:00.714657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121fa25-5d53-4527-b7bc-aae54bce40eb None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:00.742460 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e18821-3e94-4d0e-9429-845d15b4cbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:00.743136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e18821-3e94-4d0e-9429-845d15b4cbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:00.743380 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e18821-3e94-4d0e-9429-845d15b4cbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:00.743687 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e18821-3e94-4d0e-9429-845d15b4cbf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:00.744431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e18821-3e94-4d0e-9429-845d15b4cbf2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:00.744735 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e18821-3e94-4d0e-9429-845d15b4cbf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:00.746161 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e18821-3e94-4d0e-9429-845d15b4cbf2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:00.754371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 260/507] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:48:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:00.755147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e18821-3e94-4d0e-9429-845d15b4cbf2 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:00.769711 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:00.820070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121fa25-5d53-4527-b7bc-aae54bce40eb None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:00.854602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbc852-dcbe-4e84-8f78-82f60ac01d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:00.855273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbc852-dcbe-4e84-8f78-82f60ac01d78 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:00.855556 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbc852-dcbe-4e84-8f78-82f60ac01d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:00.855829 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbc852-dcbe-4e84-8f78-82f60ac01d78 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:00.856129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e18821-3e94-4d0e-9429-845d15b4cbf2 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:00.856758 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbc852-dcbe-4e84-8f78-82f60ac01d78 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:00.857057 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbc852-dcbe-4e84-8f78-82f60ac01d78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:00.858518 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbc852-dcbe-4e84-8f78-82f60ac01d78 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:00.875996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:00.876555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 248/508] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jun 2 18:48:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:00.877505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbc852-dcbe-4e84-8f78-82f60ac01d78 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:00.892859 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0214d-9bdf-4bb2-beb2-b1901c84e73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:00.893696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0214d-9bdf-4bb2-beb2-b1901c84e73c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:00.894001 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0214d-9bdf-4bb2-beb2-b1901c84e73c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:00.894271 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0214d-9bdf-4bb2-beb2-b1901c84e73c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:00.906189 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0214d-9bdf-4bb2-beb2-b1901c84e73c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:00.907687 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0214d-9bdf-4bb2-beb2-b1901c84e73c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:00.927939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-6ed0214d-9bdf-4bb2-beb2-b1901c84e73c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:00.927939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:00.927939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:00.927939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:00.927939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:00.927939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:00.927939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:00.927939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:00.927939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:00.927939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:00.927939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:00.927939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:00.927939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:00.927939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:00.927939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:00.928831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:00.928831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:00.928831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:00.928831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:00.928831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:00.928831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:00.928831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:00.928831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:00.928831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:00.928831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:00.928831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:00.928831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:00.928831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:00.928831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:00.928831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:00.928831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:00.928831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:00.929661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:00.929661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:00.929661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:00.929661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:00.929661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 261/509] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:00.929958 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0214d-9bdf-4bb2-beb2-b1901c84e73c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:00.987116 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbc852-dcbe-4e84-8f78-82f60ac01d78 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:00.995930 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:01.022907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b82ce-b62a-4b78-9d4b-09b6a0c7e301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:01.023712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b82ce-b62a-4b78-9d4b-09b6a0c7e301 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:01.023986 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b82ce-b62a-4b78-9d4b-09b6a0c7e301 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:01.024370 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b82ce-b62a-4b78-9d4b-09b6a0c7e301 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:01.031564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b82ce-b62a-4b78-9d4b-09b6a0c7e301 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:01.032468 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0214d-9bdf-4bb2-beb2-b1901c84e73c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:01.033013 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b82ce-b62a-4b78-9d4b-09b6a0c7e301 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:01.048035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-058b82ce-b62a-4b78-9d4b-09b6a0c7e301 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 18:48:01.048035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:01.048035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:01.048035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:01.048035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:01.048035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:01.048035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:01.048035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:01.048035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:01.048035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:01.048035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:01.048035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:01.048035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:01.048035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:01.048035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:01.048035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:01.049043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:01.049043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:01.049043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:01.049043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:01.049043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:01.049043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:01.049043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:01.049043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:01.049043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:01.049043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:01.049043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:01.049043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:01.049043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:01.049043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:01.049043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:01.049043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:01.049043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:01.049043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:01.050018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:01.050018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:01.050018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:01.050018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:01.050018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:01.050018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:01.050018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:01.050018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:01.050018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 18:48:01.050018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:01.050018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 249/510] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:48:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:01.050018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b82ce-b62a-4b78-9d4b-09b6a0c7e301 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:01.068696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c6dba-4b5f-488d-b7ea-4c8c46e43108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:01.069349 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c6dba-4b5f-488d-b7ea-4c8c46e43108 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:01.069623 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c6dba-4b5f-488d-b7ea-4c8c46e43108 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:01.069921 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c6dba-4b5f-488d-b7ea-4c8c46e43108 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:01.113366 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:01.140930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c6dba-4b5f-488d-b7ea-4c8c46e43108 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:01.142473 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c6dba-4b5f-488d-b7ea-4c8c46e43108 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:01.156223 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b82ce-b62a-4b78-9d4b-09b6a0c7e301 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:01.190931 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742800d-1ea1-4df2-9419-5157a2ad2ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:01.191706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742800d-1ea1-4df2-9419-5157a2ad2ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:01.192012 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742800d-1ea1-4df2-9419-5157a2ad2ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:01.192282 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742800d-1ea1-4df2-9419-5157a2ad2ba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:01.203152 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742800d-1ea1-4df2-9419-5157a2ad2ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:01.204591 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742800d-1ea1-4df2-9419-5157a2ad2ba1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:01.221409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-5742800d-1ea1-4df2-9419-5157a2ad2ba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:01.221409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:01.221409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:01.221409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:01.221409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:01.221409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:01.221409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:01.221409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:01.221409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:01.221409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:01.221409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:01.221409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:01.221409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:01.221409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:01.221409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:01.222324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:01.222324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:01.222324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:01.222324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:01.222324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:01.222324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:01.222324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:01.222324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:01.222324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:01.222324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:01.222324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:01.222324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:01.222324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:01.222324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:01.222324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:01.222324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:01.222324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:01.223152 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:01.223152 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:01.223152 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:01.223152 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:01.223152 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 250/511] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:01.223420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742800d-1ea1-4df2-9419-5157a2ad2ba1 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:01.244906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:01.245908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 262/512] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:48:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:48:01.246980 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c6dba-4b5f-488d-b7ea-4c8c46e43108 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:01.316647 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:01.327245 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742800d-1ea1-4df2-9419-5157a2ad2ba1 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:01.348160 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c6dba-4b5f-488d-b7ea-4c8c46e43108 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:01.362502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366aff70-e139-4282-b4a7-af15285d6088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:01.363155 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366aff70-e139-4282-b4a7-af15285d6088 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:01.363433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366aff70-e139-4282-b4a7-af15285d6088 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:01.363708 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366aff70-e139-4282-b4a7-af15285d6088 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:01.383031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ccb5f-d994-4145-bb71-51b913b0ad8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:01.383694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ccb5f-d994-4145-bb71-51b913b0ad8b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:01.383973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ccb5f-d994-4145-bb71-51b913b0ad8b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:01.384246 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ccb5f-d994-4145-bb71-51b913b0ad8b None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:01.384961 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ccb5f-d994-4145-bb71-51b913b0ad8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:01.385267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ccb5f-d994-4145-bb71-51b913b0ad8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:01.386689 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ccb5f-d994-4145-bb71-51b913b0ad8b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:01.397734 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 263/513] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:01.398547 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ccb5f-d994-4145-bb71-51b913b0ad8b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:01.437500 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366aff70-e139-4282-b4a7-af15285d6088 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:01.439353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366aff70-e139-4282-b4a7-af15285d6088 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:01.460745 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:01.494112 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ccb5f-d994-4145-bb71-51b913b0ad8b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:01.525966 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:01.531871 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bde019-2d52-4bdd-a5d1-989d9a6d22cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:01.532675 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bde019-2d52-4bdd-a5d1-989d9a6d22cc None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:01.532976 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bde019-2d52-4bdd-a5d1-989d9a6d22cc None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:01.533733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bde019-2d52-4bdd-a5d1-989d9a6d22cc None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:01.534113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bde019-2d52-4bdd-a5d1-989d9a6d22cc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:01.534426 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bde019-2d52-4bdd-a5d1-989d9a6d22cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:01.536063 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bde019-2d52-4bdd-a5d1-989d9a6d22cc None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:01.539783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 251/514] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:48:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:48:01.540628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366aff70-e139-4282-b4a7-af15285d6088 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:01.572684 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 264/515] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Jun 2 18:48:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:01.573819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bde019-2d52-4bdd-a5d1-989d9a6d22cc None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:01.636829 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366aff70-e139-4282-b4a7-af15285d6088 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:01.656360 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:01.670816 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80f809-04e4-48b7-ac12-45a2b6a3393a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:01.671479 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80f809-04e4-48b7-ac12-45a2b6a3393a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:01.671757 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80f809-04e4-48b7-ac12-45a2b6a3393a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:01.672030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80f809-04e4-48b7-ac12-45a2b6a3393a None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:01.672232 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bde019-2d52-4bdd-a5d1-989d9a6d22cc None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:01.672741 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80f809-04e4-48b7-ac12-45a2b6a3393a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:01.673042 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80f809-04e4-48b7-ac12-45a2b6a3393a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:01.674587 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80f809-04e4-48b7-ac12-45a2b6a3393a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:01.685489 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 252/516] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:01.686365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80f809-04e4-48b7-ac12-45a2b6a3393a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:01.709951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3da6e2-8555-4809-abeb-3870163cb14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:01.710748 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3da6e2-8555-4809-abeb-3870163cb14c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:01.710994 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3da6e2-8555-4809-abeb-3870163cb14c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:01.711256 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3da6e2-8555-4809-abeb-3870163cb14c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:01.721051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3da6e2-8555-4809-abeb-3870163cb14c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:01.722559 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3da6e2-8555-4809-abeb-3870163cb14c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:01.741290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-0b3da6e2-8555-4809-abeb-3870163cb14c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:01.741290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:01.741290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:01.741290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:01.741290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:01.741290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:01.741290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:01.741290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:01.741290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:01.741290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:01.741290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:01.741290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:01.741290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:01.741290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:01.741290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:01.742334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:01.742334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:01.742334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:01.742334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:01.742334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:01.742334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:01.742334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:01.742334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:01.742334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:01.742334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:01.742334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:01.742334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:01.742334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:01.742334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:01.742334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:01.742334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:01.742334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:01.743296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:01.743296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:01.743296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:01.743296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:01.743296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 265/517] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:01.743296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3da6e2-8555-4809-abeb-3870163cb14c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:01.787444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80f809-04e4-48b7-ac12-45a2b6a3393a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:01.824584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890a54c-f48c-4d80-96c4-3e115ab0bd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:01.825508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890a54c-f48c-4d80-96c4-3e115ab0bd2e None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:01.825836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890a54c-f48c-4d80-96c4-3e115ab0bd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:01.826107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890a54c-f48c-4d80-96c4-3e115ab0bd2e None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:01.826833 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890a54c-f48c-4d80-96c4-3e115ab0bd2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:01.828320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890a54c-f48c-4d80-96c4-3e115ab0bd2e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:01.855511 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 253/518] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 2 18:48:01 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:48:01.856417 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890a54c-f48c-4d80-96c4-3e115ab0bd2e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:01.900617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:01.934316 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:01.977581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890a54c-f48c-4d80-96c4-3e115ab0bd2e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:01.984653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3da6e2-8555-4809-abeb-3870163cb14c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:02.017382 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92471b33-d066-46c1-8d11-d3bc5cfe69a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:02.018091 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92471b33-d066-46c1-8d11-d3bc5cfe69a0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:02.018372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92471b33-d066-46c1-8d11-d3bc5cfe69a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:02.018649 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92471b33-d066-46c1-8d11-d3bc5cfe69a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:02.024384 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576e44a-f5da-40ea-9993-31e2366d391e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:02.025568 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576e44a-f5da-40ea-9993-31e2366d391e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:02.026079 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576e44a-f5da-40ea-9993-31e2366d391e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:02.026544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576e44a-f5da-40ea-9993-31e2366d391e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:02.039271 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576e44a-f5da-40ea-9993-31e2366d391e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:02.040775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576e44a-f5da-40ea-9993-31e2366d391e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:02.060422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-6576e44a-f5da-40ea-9993-31e2366d391e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:02.060422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:02.060422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:02.060422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:02.060422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:02.060422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:02.060422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:02.060422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:02.060422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:02.060422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:02.060422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:02.060422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:02.060422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:02.060422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:02.060422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:02.061353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:02.061353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:02.061353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:02.061353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:02.061353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:02.061353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:02.061353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:02.061353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:02.061353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:02.061353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:02.061353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:02.061353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:02.061353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:02.061353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:02.061353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:02.061353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:02.061353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:02.062241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:02.062241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:02.062241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:02.062241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:02.062241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 266/519] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:02.063953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576e44a-f5da-40ea-9993-31e2366d391e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:02.103424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92471b33-d066-46c1-8d11-d3bc5cfe69a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:02.105380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92471b33-d066-46c1-8d11-d3bc5cfe69a0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:02.143773 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:02.172457 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:02.179545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576e44a-f5da-40ea-9993-31e2366d391e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:02.214493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778cbb0-a832-44cf-86f7-0f2aa2325195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:02.215544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778cbb0-a832-44cf-86f7-0f2aa2325195 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:02.215655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778cbb0-a832-44cf-86f7-0f2aa2325195 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:02.215906 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778cbb0-a832-44cf-86f7-0f2aa2325195 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:02.223336 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 254/520] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:48:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:48:02.223336 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92471b33-d066-46c1-8d11-d3bc5cfe69a0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:02.229706 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778cbb0-a832-44cf-86f7-0f2aa2325195 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:02.231507 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778cbb0-a832-44cf-86f7-0f2aa2325195 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:02.248794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-1778cbb0-a832-44cf-86f7-0f2aa2325195 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 18:48:02.248794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:02.248794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:02.248794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:02.248794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:02.248794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:02.248794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:02.248794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:02.248794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:02.248794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:02.248794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:02.248794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:02.248794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:02.248794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:02.248794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:02.248794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:02.249784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:02.249784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:02.249784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:02.249784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:02.249784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:02.249784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:02.249784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:02.249784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:02.249784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:02.249784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:02.249784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:02.249784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:02.249784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:02.249784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:02.249784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:02.249784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:02.249784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:02.249784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:02.250711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:02.250711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:02.250711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:02.250711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:02.250711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:02.250711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:02.250711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:02.250711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:02.250711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 18:48:02.250711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:02.250711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 267/521] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:48:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:02.251263 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778cbb0-a832-44cf-86f7-0f2aa2325195 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:02.335329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92471b33-d066-46c1-8d11-d3bc5cfe69a0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:02.355480 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778cbb0-a832-44cf-86f7-0f2aa2325195 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:02.376085 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43a8ef-37d7-4b42-89d3-99f1a131d7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:02.376757 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43a8ef-37d7-4b42-89d3-99f1a131d7cd None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:02.377054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43a8ef-37d7-4b42-89d3-99f1a131d7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:02.377315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43a8ef-37d7-4b42-89d3-99f1a131d7cd None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:02.378048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43a8ef-37d7-4b42-89d3-99f1a131d7cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:02.378377 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43a8ef-37d7-4b42-89d3-99f1a131d7cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:02.379746 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43a8ef-37d7-4b42-89d3-99f1a131d7cd None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:02.382798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:02.392540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 255/522] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:02.393194 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43a8ef-37d7-4b42-89d3-99f1a131d7cd None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:02.398666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415be717-e3c0-4929-80d6-b71dd1fb7a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:02.399350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415be717-e3c0-4929-80d6-b71dd1fb7a86 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:02.399670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415be717-e3c0-4929-80d6-b71dd1fb7a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:02.399944 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415be717-e3c0-4929-80d6-b71dd1fb7a86 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:02.400677 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415be717-e3c0-4929-80d6-b71dd1fb7a86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:02.400986 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415be717-e3c0-4929-80d6-b71dd1fb7a86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:02.402436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415be717-e3c0-4929-80d6-b71dd1fb7a86 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:02.421173 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 268/523] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:02.422310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415be717-e3c0-4929-80d6-b71dd1fb7a86 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:02.440196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:02.501149 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43a8ef-37d7-4b42-89d3-99f1a131d7cd None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:02.537287 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415be717-e3c0-4929-80d6-b71dd1fb7a86 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:02.542323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1a4cf-fb6d-4f23-b92a-4c9a81e73ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:02.543136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1a4cf-fb6d-4f23-b92a-4c9a81e73ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:02.543461 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1a4cf-fb6d-4f23-b92a-4c9a81e73ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:02.543819 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1a4cf-fb6d-4f23-b92a-4c9a81e73ce7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:02.555333 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1a4cf-fb6d-4f23-b92a-4c9a81e73ce7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:02.556935 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1a4cf-fb6d-4f23-b92a-4c9a81e73ce7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:02.574062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dd23d-ebe3-4b51-8ad5-4d40b16d2ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:02.574902 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dd23d-ebe3-4b51-8ad5-4d40b16d2ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:02.575527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-23a1a4cf-fb6d-4f23-b92a-4c9a81e73ce7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:02.575527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:02.575527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:02.575527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:02.575527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:02.575527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:02.575527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:02.575527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:02.575527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:02.575527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:02.575527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:02.575527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:02.575527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:02.575527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:02.575527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:02.576334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:02.576334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:02.576334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:02.576334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:02.576334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:02.576334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:02.576334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:02.576334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:02.576334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:02.576334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:02.576334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:02.576334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:02.576334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:02.576334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:02.576334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:02.576334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:02.576334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:02.582183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:02.582183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:02.582183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:02.582183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:02.582494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dd23d-ebe3-4b51-8ad5-4d40b16d2ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:02.582494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dd23d-ebe3-4b51-8ad5-4d40b16d2ff0 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:02.582494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dd23d-ebe3-4b51-8ad5-4d40b16d2ff0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:02.582494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dd23d-ebe3-4b51-8ad5-4d40b16d2ff0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:02.583106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 256/524] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:02.583106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1a4cf-fb6d-4f23-b92a-4c9a81e73ce7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:02.583255 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dd23d-ebe3-4b51-8ad5-4d40b16d2ff0 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:02.600927 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 269/525] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Jun 2 18:48:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:02.602795 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dd23d-ebe3-4b51-8ad5-4d40b16d2ff0 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:02.635092 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:02.677000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:02.691989 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1a4cf-fb6d-4f23-b92a-4c9a81e73ce7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:02.710078 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dd23d-ebe3-4b51-8ad5-4d40b16d2ff0 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:02.726371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf0a24-d9d9-4e3d-8ab5-be9d4a022e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:02.727220 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf0a24-d9d9-4e3d-8ab5-be9d4a022e5c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:02.727499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf0a24-d9d9-4e3d-8ab5-be9d4a022e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:02.727764 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf0a24-d9d9-4e3d-8ab5-be9d4a022e5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:02.734688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf0a24-d9d9-4e3d-8ab5-be9d4a022e5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:02.736142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf0a24-d9d9-4e3d-8ab5-be9d4a022e5c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:02.746499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f7b39-0aac-449a-830c-c04f6493a95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:02.747403 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f7b39-0aac-449a-830c-c04f6493a95b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:02.747681 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f7b39-0aac-449a-830c-c04f6493a95b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:02.747953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f7b39-0aac-449a-830c-c04f6493a95b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:02.751491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-8ebf0a24-d9d9-4e3d-8ab5-be9d4a022e5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:02.751491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:02.751491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:02.751491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:02.751491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:02.751491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:02.751491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:02.751491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:02.751491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:02.751491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:02.751491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:02.751491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:02.751491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:02.751491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:02.751491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:02.752413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:02.752413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:02.752413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:02.752413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:02.752413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:02.752413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:02.752413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:02.752413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:02.752413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:02.752413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:02.752413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:02.752413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:02.752413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:02.752413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:02.752413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:02.752413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:02.752413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:02.753243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:02.753243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:02.753243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:02.753243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:02.753243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:02.753243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:02.753243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:02.753243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:02.753243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 257/526] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:02.754204 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf0a24-d9d9-4e3d-8ab5-be9d4a022e5c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:02.760076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f7b39-0aac-449a-830c-c04f6493a95b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:02.762711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f7b39-0aac-449a-830c-c04f6493a95b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:02.777363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-336f7b39-0aac-449a-830c-c04f6493a95b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:02.777363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:02.777363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:02.777363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:02.777363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:02.777363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:02.777363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:02.777363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:02.777363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:02.777363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:02.777363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:02.777363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:02.777363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:02.777363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:02.777363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:02.778482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:02.778482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:02.778482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:02.778482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:02.778482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:02.778482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:02.778482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:02.778482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:02.778482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:02.778482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:02.778482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:02.778482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:02.778482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:02.778482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:02.778482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:02.778482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:02.778482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:02.779470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:02.779470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:02.779470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:02.779470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:02.779470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:02.779470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:02.779470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:02.779470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:02.779470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 270/527] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:02.780509 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f7b39-0aac-449a-830c-c04f6493a95b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:02.867295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf0a24-d9d9-4e3d-8ab5-be9d4a022e5c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:02.878006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:02.887625 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f7b39-0aac-449a-830c-c04f6493a95b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:02.904977 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac53726-05b3-4d00-80c2-ebf1db69acac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:02.905724 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac53726-05b3-4d00-80c2-ebf1db69acac None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:02.906095 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac53726-05b3-4d00-80c2-ebf1db69acac None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:02.906434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac53726-05b3-4d00-80c2-ebf1db69acac None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:02.907226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac53726-05b3-4d00-80c2-ebf1db69acac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:02.907712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac53726-05b3-4d00-80c2-ebf1db69acac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:02.909166 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac53726-05b3-4d00-80c2-ebf1db69acac None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:02.916350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:02.922313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcc64f-965e-4717-9f27-239ede9b1dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:02.927408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcc64f-965e-4717-9f27-239ede9b1dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:02.927408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcc64f-965e-4717-9f27-239ede9b1dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:02.927642 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 258/528] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:02.927743 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcc64f-965e-4717-9f27-239ede9b1dd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:02.927825 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac53726-05b3-4d00-80c2-ebf1db69acac None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:03.001544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcc64f-965e-4717-9f27-239ede9b1dd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:03.003090 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcc64f-965e-4717-9f27-239ede9b1dd4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:03.041038 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac53726-05b3-4d00-80c2-ebf1db69acac None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:03.077375 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dd70b-7033-478d-9c25-c6768b6d9a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:03.078077 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dd70b-7033-478d-9c25-c6768b6d9a7e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:03.078355 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dd70b-7033-478d-9c25-c6768b6d9a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:03.078619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dd70b-7033-478d-9c25-c6768b6d9a7e None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:03.079412 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dd70b-7033-478d-9c25-c6768b6d9a7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:03.079717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dd70b-7033-478d-9c25-c6768b6d9a7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:03.081828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dd70b-7033-478d-9c25-c6768b6d9a7e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:03.100090 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 259/529] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:03.100767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dd70b-7033-478d-9c25-c6768b6d9a7e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:03.122292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 271/530] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:48:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:48:03.123410 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcc64f-965e-4717-9f27-239ede9b1dd4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:03.136930 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:03.157983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:03.217183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dd70b-7033-478d-9c25-c6768b6d9a7e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:03.227299 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcc64f-965e-4717-9f27-239ede9b1dd4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:03.256599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da60b4-2171-4973-b181-87e8e8fceb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:03.257514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da60b4-2171-4973-b181-87e8e8fceb8a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:03.257972 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da60b4-2171-4973-b181-87e8e8fceb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:03.258386 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da60b4-2171-4973-b181-87e8e8fceb8a None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:03.259316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da60b4-2171-4973-b181-87e8e8fceb8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:03.259768 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da60b4-2171-4973-b181-87e8e8fceb8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:03.261369 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da60b4-2171-4973-b181-87e8e8fceb8a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:03.261939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c10e01-07c4-44a0-919d-671496f8686d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:03.262768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c10e01-07c4-44a0-919d-671496f8686d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:03.263077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c10e01-07c4-44a0-919d-671496f8686d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:03.263354 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c10e01-07c4-44a0-919d-671496f8686d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:03.270411 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c10e01-07c4-44a0-919d-671496f8686d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:03.271845 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c10e01-07c4-44a0-919d-671496f8686d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:03.279369 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 260/531] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:03.279369 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da60b4-2171-4973-b181-87e8e8fceb8a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:03.287668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-e6c10e01-07c4-44a0-919d-671496f8686d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:03.287668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:03.287668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:03.287668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:03.287668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:03.287668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:03.287668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:03.287668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:03.287668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:03.287668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:03.287668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:03.287668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:03.287668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:03.287668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:03.287668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:03.288685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:03.288685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:03.288685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:03.288685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:03.288685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:03.288685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:03.288685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:03.288685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:03.288685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:03.288685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:03.288685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:03.288685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:03.288685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:03.288685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:03.288685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:03.288685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:03.288685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:03.289677 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:03.289677 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:03.289677 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:03.289677 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:03.289677 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:03.289677 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:03.289677 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:03.289677 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:03.289677 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 272/532] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:03.290629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c10e01-07c4-44a0-919d-671496f8686d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:03.375642 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:03.388264 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da60b4-2171-4973-b181-87e8e8fceb8a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:03.388611 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:03.399969 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c10e01-07c4-44a0-919d-671496f8686d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:03.424227 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20a90f-aeb5-4a18-b33d-ff9a75ff9fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:03.425030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20a90f-aeb5-4a18-b33d-ff9a75ff9fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:03.425418 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20a90f-aeb5-4a18-b33d-ff9a75ff9fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:03.425789 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20a90f-aeb5-4a18-b33d-ff9a75ff9fc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:03.426744 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20a90f-aeb5-4a18-b33d-ff9a75ff9fc2 None admin] RBAC: Adding query filter params (role.id=d3525fac5dcc418cbf1bc53ab83dbec6, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=8a1b010003c44dc19643558167424d13) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:03.427070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20a90f-aeb5-4a18-b33d-ff9a75ff9fc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:03.428518 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20a90f-aeb5-4a18-b33d-ff9a75ff9fc2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:03.434632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 261/533] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:48:03 2022] GET /identity/v3/role_assignments?user.id=8a1b010003c44dc19643558167424d13&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=d3525fac5dcc418cbf1bc53ab83dbec6 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:03.435304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20a90f-aeb5-4a18-b33d-ff9a75ff9fc2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:03.445002 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59774612-338d-4f48-a0f3-5dd33f3432db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:03.446028 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59774612-338d-4f48-a0f3-5dd33f3432db None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:03.446411 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59774612-338d-4f48-a0f3-5dd33f3432db None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:03.446783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59774612-338d-4f48-a0f3-5dd33f3432db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:03.462118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59774612-338d-4f48-a0f3-5dd33f3432db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:03.463816 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59774612-338d-4f48-a0f3-5dd33f3432db None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:03.483303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-59774612-338d-4f48-a0f3-5dd33f3432db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:03.483303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:03.483303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:03.483303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:03.483303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:03.483303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:03.483303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:03.483303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:03.483303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:03.483303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:03.483303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:03.483303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:03.483303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:03.483303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:03.483303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:03.484400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:03.484400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:03.484400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:03.484400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:03.484400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:03.484400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:03.484400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:03.484400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:03.484400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:03.484400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:03.484400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:03.484400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:03.484400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:03.484400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:03.484400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:03.484400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:03.484400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:03.485441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:03.485441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:03.485441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:03.485441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:03.487257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 273/534] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:03.488225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59774612-338d-4f48-a0f3-5dd33f3432db None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:03.585000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20a90f-aeb5-4a18-b33d-ff9a75ff9fc2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:03.617629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59774612-338d-4f48-a0f3-5dd33f3432db None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:03.634675 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c30c20-5f51-4a9f-8778-a4875f63eb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:03.635643 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c30c20-5f51-4a9f-8778-a4875f63eb43 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:03.635928 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c30c20-5f51-4a9f-8778-a4875f63eb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:03.636206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c30c20-5f51-4a9f-8778-a4875f63eb43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:03.637063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c30c20-5f51-4a9f-8778-a4875f63eb43 None admin] RBAC: Adding query filter params (role.id=d3525fac5dcc418cbf1bc53ab83dbec6, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=6b8ff9f5032e498db3c70c79cc11989b) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:03.637482 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c30c20-5f51-4a9f-8778-a4875f63eb43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:03.639782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c30c20-5f51-4a9f-8778-a4875f63eb43 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:03.649963 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 262/535] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:48:03 2022] GET /identity/v3/role_assignments?user.id=6b8ff9f5032e498db3c70c79cc11989b&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=d3525fac5dcc418cbf1bc53ab83dbec6 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:03.651195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c30c20-5f51-4a9f-8778-a4875f63eb43 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:03.665381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d541ac3-79d8-4878-ad65-56b72f897406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:03.667026 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d541ac3-79d8-4878-ad65-56b72f897406 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:03.667311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d541ac3-79d8-4878-ad65-56b72f897406 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:03.667593 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d541ac3-79d8-4878-ad65-56b72f897406 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:03.668443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d541ac3-79d8-4878-ad65-56b72f897406 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:03.669572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d541ac3-79d8-4878-ad65-56b72f897406 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:03.670871 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d541ac3-79d8-4878-ad65-56b72f897406 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:03.684215 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:03.694101 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 274/536] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:03.700457 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d541ac3-79d8-4878-ad65-56b72f897406 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:03.704462 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:03.784907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c30c20-5f51-4a9f-8778-a4875f63eb43 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:03.830699 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b1f7d-8894-4713-a945-80c9ed2a24ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:03.831580 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b1f7d-8894-4713-a945-80c9ed2a24ad None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:03.831964 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b1f7d-8894-4713-a945-80c9ed2a24ad None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:03.832382 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b1f7d-8894-4713-a945-80c9ed2a24ad None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:03.833581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b1f7d-8894-4713-a945-80c9ed2a24ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:03.836443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d541ac3-79d8-4878-ad65-56b72f897406 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:03.836936 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b1f7d-8894-4713-a945-80c9ed2a24ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:03.838564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b1f7d-8894-4713-a945-80c9ed2a24ad None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:03.880100 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f57e00-722e-419d-8034-2b7072bb5f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:03.880413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 263/537] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:03.881639 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f57e00-722e-419d-8034-2b7072bb5f31 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:03.882126 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f57e00-722e-419d-8034-2b7072bb5f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:03.882596 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f57e00-722e-419d-8034-2b7072bb5f31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:03.883666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f57e00-722e-419d-8034-2b7072bb5f31 None admin] RBAC: Adding query filter params (role.id=d3525fac5dcc418cbf1bc53ab83dbec6, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=e0141329b2cd4f668803a192d2b6cedb) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:03.884205 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f57e00-722e-419d-8034-2b7072bb5f31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:03.885902 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f57e00-722e-419d-8034-2b7072bb5f31 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:03.886212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b1f7d-8894-4713-a945-80c9ed2a24ad None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:03.893681 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 275/538] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:48:03 2022] GET /identity/v3/role_assignments?user.id=e0141329b2cd4f668803a192d2b6cedb&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=d3525fac5dcc418cbf1bc53ab83dbec6 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:04.017443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:04.043873 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b1f7d-8894-4713-a945-80c9ed2a24ad None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:04.087365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898641f2-b6f1-4de7-966c-49283f6a5bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:04.088214 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898641f2-b6f1-4de7-966c-49283f6a5bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:04.088505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898641f2-b6f1-4de7-966c-49283f6a5bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:04.088782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898641f2-b6f1-4de7-966c-49283f6a5bc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:04.099683 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898641f2-b6f1-4de7-966c-49283f6a5bc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:04.101175 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898641f2-b6f1-4de7-966c-49283f6a5bc6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:04.119492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-898641f2-b6f1-4de7-966c-49283f6a5bc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:04.119492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:04.119492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:04.119492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:04.119492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:04.119492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:04.119492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:04.119492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:04.119492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:04.119492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:04.119492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:04.119492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:04.119492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:04.119492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:04.119492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:04.120474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:04.120474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:04.120474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:04.120474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:04.120474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:04.120474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:04.120474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:04.120474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:04.120474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:04.120474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:04.120474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:04.120474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:04.120474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:04.120474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:04.120474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:04.120474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:04.120474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:04.121394 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:04.121394 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:04.121394 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:04.121394 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:04.121394 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:04.121394 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:04.121394 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:04.121394 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:04.125678 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 264/539] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:04.127136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f57e00-722e-419d-8034-2b7072bb5f31 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:04.161119 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46d571-7b79-491a-b7be-77655c2a03f3 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:04.161305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46d571-7b79-491a-b7be-77655c2a03f3 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:04.161581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46d571-7b79-491a-b7be-77655c2a03f3 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:04.163329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 265/540] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:48:04.175679 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d82283-3468-4a45-91d6-6b98045e6e49 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:04.176028 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d82283-3468-4a45-91d6-6b98045e6e49 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:04.176230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d82283-3468-4a45-91d6-6b98045e6e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:04.219739 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:04.222731 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-44d82283-3468-4a45-91d6-6b98045e6e49 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:04.226789 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-44d82283-3468-4a45-91d6-6b98045e6e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:04.258444 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f57e00-722e-419d-8034-2b7072bb5f31 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:04.328088 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54cbf2-d4f0-4873-8ced-f26aaeec6ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:04.329147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54cbf2-d4f0-4873-8ced-f26aaeec6ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:04.329631 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54cbf2-d4f0-4873-8ced-f26aaeec6ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:04.330129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54cbf2-d4f0-4873-8ced-f26aaeec6ef0 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:04.331108 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54cbf2-d4f0-4873-8ced-f26aaeec6ef0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:04.331613 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54cbf2-d4f0-4873-8ced-f26aaeec6ef0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:04.333600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54cbf2-d4f0-4873-8ced-f26aaeec6ef0 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:04.359446 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 276/541] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:04.363430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 266/542] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 02 18:48:04.370781 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54cbf2-d4f0-4873-8ced-f26aaeec6ef0 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:04.416982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d82283-3468-4a45-91d6-6b98045e6e49 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:04.520924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54cbf2-d4f0-4873-8ced-f26aaeec6ef0 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:04.528763 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:04.574195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:04.589623 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d6613-8eff-4fc4-91dc-99405d42bd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:04.590378 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d6613-8eff-4fc4-91dc-99405d42bd97 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:04.590667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d6613-8eff-4fc4-91dc-99405d42bd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:04.590939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d6613-8eff-4fc4-91dc-99405d42bd97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:04.591782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d6613-8eff-4fc4-91dc-99405d42bd97 None admin] RBAC: Adding query filter params (role.id=d3525fac5dcc418cbf1bc53ab83dbec6, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=e7714d3ad1d849f5a398fc1843f22e4b) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:04.592096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d6613-8eff-4fc4-91dc-99405d42bd97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:04.593548 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d6613-8eff-4fc4-91dc-99405d42bd97 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:04.605057 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d82283-3468-4a45-91d6-6b98045e6e49 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:04.610996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 277/543] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:48:04 2022] GET /identity/v3/role_assignments?user.id=e7714d3ad1d849f5a398fc1843f22e4b&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=d3525fac5dcc418cbf1bc53ab83dbec6 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:04.648468 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0fb73-0419-482b-8921-b6dcb95979dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:04.649318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0fb73-0419-482b-8921-b6dcb95979dd None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:04.649595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0fb73-0419-482b-8921-b6dcb95979dd None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:04.649930 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0fb73-0419-482b-8921-b6dcb95979dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:04.661431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0fb73-0419-482b-8921-b6dcb95979dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:04.669440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-46d0fb73-0419-482b-8921-b6dcb95979dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:04.669440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:04.669440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:04.669440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:04.669440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:04.669440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:04.669440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:04.669440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:04.669440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:04.669440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:04.669440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:04.669440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:04.669440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:04.669440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:04.669440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:04.669440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:04.670420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:04.670420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:04.670420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:04.670420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:04.670420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:04.670420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:04.670420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:04.670420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:04.670420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:04.670420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:04.670420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:04.670420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:04.670420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:04.670420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:04.670420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:04.670420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:04.671208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:04.671208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:04.671208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:04.671208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:04.671208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:04.671208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:04.671208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:04.671208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:04.671208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:04.671208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:04.671208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:04.671208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:04.671208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 267/544] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:48:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:04.676731 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d6613-8eff-4fc4-91dc-99405d42bd97 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:04.828792 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d6613-8eff-4fc4-91dc-99405d42bd97 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:04.877397 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a7188-ebce-4ba9-be85-67cb56616323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:04.878125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a7188-ebce-4ba9-be85-67cb56616323 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:04.878526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a7188-ebce-4ba9-be85-67cb56616323 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:04.878803 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a7188-ebce-4ba9-be85-67cb56616323 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:04.879561 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a7188-ebce-4ba9-be85-67cb56616323 None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:04.879871 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a7188-ebce-4ba9-be85-67cb56616323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:04.881263 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a7188-ebce-4ba9-be85-67cb56616323 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:04.890231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 278/545] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:48:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:04.895586 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0fb73-0419-482b-8921-b6dcb95979dd None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:05.005502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0fb73-0419-482b-8921-b6dcb95979dd None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:05.034534 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:05.043678 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a33e94-dab1-4e9a-a61e-20b100fe7b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:05.044480 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a33e94-dab1-4e9a-a61e-20b100fe7b8b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:05.044761 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a33e94-dab1-4e9a-a61e-20b100fe7b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:05.045036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a33e94-dab1-4e9a-a61e-20b100fe7b8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:05.056128 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a33e94-dab1-4e9a-a61e-20b100fe7b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:05.057604 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a33e94-dab1-4e9a-a61e-20b100fe7b8b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:05.082138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-70a33e94-dab1-4e9a-a61e-20b100fe7b8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:05.082138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:05.082138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:05.082138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:05.082138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:05.082138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:05.082138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:05.082138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:05.082138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:05.082138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:05.082138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:05.082138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:05.082138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:05.082138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:05.082138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:05.084456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:05.084456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:05.084456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:05.084456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:05.084456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:05.084456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:05.084456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:05.084456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:05.084456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:05.084456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:05.084456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:05.084456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:05.084456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:05.084456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:05.084456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:05.084456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:05.084456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:05.086450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:05.086450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:05.086450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:05.086450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:05.086450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 268/546] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:05.089252 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a7188-ebce-4ba9-be85-67cb56616323 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:05.174279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:05.224353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a7188-ebce-4ba9-be85-67cb56616323 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:05.267812 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163b4b7-c087-42dc-8fee-adba02a4371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:05.268409 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163b4b7-c087-42dc-8fee-adba02a4371a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:05.268692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163b4b7-c087-42dc-8fee-adba02a4371a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:05.268968 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163b4b7-c087-42dc-8fee-adba02a4371a None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:05.269699 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163b4b7-c087-42dc-8fee-adba02a4371a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:05.270034 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163b4b7-c087-42dc-8fee-adba02a4371a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:05.271421 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163b4b7-c087-42dc-8fee-adba02a4371a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:05.287945 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 279/547] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:05.293586 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a33e94-dab1-4e9a-a61e-20b100fe7b8b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:05.429065 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a33e94-dab1-4e9a-a61e-20b100fe7b8b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:05.481252 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed3490-6497-4cc5-8bea-cac3119149bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:05.482099 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed3490-6497-4cc5-8bea-cac3119149bb None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:05.482383 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed3490-6497-4cc5-8bea-cac3119149bb None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:05.482660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed3490-6497-4cc5-8bea-cac3119149bb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:05.496117 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed3490-6497-4cc5-8bea-cac3119149bb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:05.497648 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed3490-6497-4cc5-8bea-cac3119149bb None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:05.524945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-7eed3490-6497-4cc5-8bea-cac3119149bb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 18:48:05.524945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:05.524945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:05.524945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:05.524945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:05.524945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:05.524945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:05.524945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:05.524945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:05.524945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:05.524945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:05.524945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:05.524945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:05.524945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:05.524945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:05.524945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:05.527573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:05.527573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:05.527573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:05.527573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:05.527573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:05.527573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:05.527573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:05.527573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:05.527573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:05.527573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:05.527573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:05.527573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:05.527573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:05.527573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:05.527573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:05.527573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:05.527573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:05.527573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:05.534951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:05.534951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:05.534951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:05.534951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:05.534951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:05.534951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:05.534951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:05.534951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:05.534951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 18:48:05.534951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:05.534951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 269/548] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:48:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:05.536861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163b4b7-c087-42dc-8fee-adba02a4371a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:05.721044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163b4b7-c087-42dc-8fee-adba02a4371a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:05.743060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:05.772795 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54195b1b-c8e1-4574-b71c-c9c579b270fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:05.773477 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54195b1b-c8e1-4574-b71c-c9c579b270fc None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:05.773755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54195b1b-c8e1-4574-b71c-c9c579b270fc None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:05.774048 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54195b1b-c8e1-4574-b71c-c9c579b270fc None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:05.774891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54195b1b-c8e1-4574-b71c-c9c579b270fc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:05.775253 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54195b1b-c8e1-4574-b71c-c9c579b270fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:05.776644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54195b1b-c8e1-4574-b71c-c9c579b270fc None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:05.798972 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 280/549] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Jun 2 18:48:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:05.804104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed3490-6497-4cc5-8bea-cac3119149bb None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:05.855780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:05.939723 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed3490-6497-4cc5-8bea-cac3119149bb None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:05.994520 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287f384-3e0f-4e04-95fe-2ad77264c4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:05.995196 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287f384-3e0f-4e04-95fe-2ad77264c4ba None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:05.995481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287f384-3e0f-4e04-95fe-2ad77264c4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:05.995757 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287f384-3e0f-4e04-95fe-2ad77264c4ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:06.081763 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287f384-3e0f-4e04-95fe-2ad77264c4ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:06.083928 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287f384-3e0f-4e04-95fe-2ad77264c4ba None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:06.138562 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:06.226322 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 270/550] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:48:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:48:06.232116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54195b1b-c8e1-4574-b71c-c9c579b270fc None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:06.337821 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3bdb2-c09f-4ed8-ad5d-ecd738059154 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:06.338017 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3bdb2-c09f-4ed8-ad5d-ecd738059154 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:06.338284 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3bdb2-c09f-4ed8-ad5d-ecd738059154 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:06.339819 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 271/551] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:48:06.346827 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d3381-4300-4464-85f6-cf4c2383611f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:06.347120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d3381-4300-4464-85f6-cf4c2383611f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:06.347389 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d3381-4300-4464-85f6-cf4c2383611f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:06.382110 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54195b1b-c8e1-4574-b71c-c9c579b270fc None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:06.382778 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ee2d3381-4300-4464-85f6-cf4c2383611f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:06.383975 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ee2d3381-4300-4464-85f6-cf4c2383611f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:06.420736 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952e0a1-e872-4395-9e7c-c54a6b9cf473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:06.421543 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952e0a1-e872-4395-9e7c-c54a6b9cf473 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:06.421838 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952e0a1-e872-4395-9e7c-c54a6b9cf473 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:06.422116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952e0a1-e872-4395-9e7c-c54a6b9cf473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:06.439134 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952e0a1-e872-4395-9e7c-c54a6b9cf473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:06.440628 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952e0a1-e872-4395-9e7c-c54a6b9cf473 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:06.476768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-9952e0a1-e872-4395-9e7c-c54a6b9cf473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:06.476768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:06.476768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:06.476768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:06.476768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:06.476768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:06.476768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:06.476768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:06.476768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:06.476768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:06.476768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:06.476768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:06.476768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:06.476768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:06.476768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:06.481600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:06.481600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:06.481600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:06.481600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:06.481600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:06.481600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:06.481600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:06.481600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:06.481600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:06.481600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:06.481600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:06.481600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:06.481600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:06.481600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:06.481600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:06.481600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:06.481600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:06.482666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:06.482666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:06.482666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:06.482666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:06.482666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 281/552] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:06.484190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952e0a1-e872-4395-9e7c-c54a6b9cf473 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:06.509397 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 272/553] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:48:06.532553 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d3381-4300-4464-85f6-cf4c2383611f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:06.556898 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:06.625439 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:06.660093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d3381-4300-4464-85f6-cf4c2383611f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:06.663645 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952e0a1-e872-4395-9e7c-c54a6b9cf473 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:06.695428 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7058c-04f0-4c8a-8ab5-70ac3f6274f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:06.696407 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7058c-04f0-4c8a-8ab5-70ac3f6274f6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:06.696885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7058c-04f0-4c8a-8ab5-70ac3f6274f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:06.697261 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7058c-04f0-4c8a-8ab5-70ac3f6274f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:06.700581 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc9c57-10a5-4e53-84a5-5e8dec55b7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:06.701524 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc9c57-10a5-4e53-84a5-5e8dec55b7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:06.701996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc9c57-10a5-4e53-84a5-5e8dec55b7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:06.702437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc9c57-10a5-4e53-84a5-5e8dec55b7a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:06.703352 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc9c57-10a5-4e53-84a5-5e8dec55b7a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:06.703852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc9c57-10a5-4e53-84a5-5e8dec55b7a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:06.705392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc9c57-10a5-4e53-84a5-5e8dec55b7a4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:06.710201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7058c-04f0-4c8a-8ab5-70ac3f6274f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:06.718324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-b2f7058c-04f0-4c8a-8ab5-70ac3f6274f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:06.718324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:06.718324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:06.718324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:06.718324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:06.718324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:06.718324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:06.718324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:06.718324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:06.718324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:06.718324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:06.718324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:06.718324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:06.718324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:06.718324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:06.718324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:06.719474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:06.719474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:06.719474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:06.719474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:06.719474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:06.719474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:06.719474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:06.719474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:06.719474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:06.719474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:06.719474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:06.719474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:06.719474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:06.719474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:06.719474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:06.719474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:06.720306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:06.720306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:06.720306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:06.720306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:06.720306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:06.720306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:06.720306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:06.720306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:06.720306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:06.720306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:06.720306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:06.720306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:06.722167 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 282/555] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:06.723758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd1e51-37bc-4b76-b04a-f89f544942e6 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:06.724211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd1e51-37bc-4b76-b04a-f89f544942e6 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:06.724671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd1e51-37bc-4b76-b04a-f89f544942e6 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:06.725306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 273/555] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:48:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:06.726602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7058c-04f0-4c8a-8ab5-70ac3f6274f6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:06.726974 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 283/556] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:06.727896 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd1e51-37bc-4b76-b04a-f89f544942e6 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:06.824009 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:06.832047 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7058c-04f0-4c8a-8ab5-70ac3f6274f6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:06.845777 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd1e51-37bc-4b76-b04a-f89f544942e6 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:06.860841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:06.869514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c17cf-7d3c-4563-9427-8a2d2ac5f925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:06.870228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c17cf-7d3c-4563-9427-8a2d2ac5f925 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:06.870509 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c17cf-7d3c-4563-9427-8a2d2ac5f925 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:06.870782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c17cf-7d3c-4563-9427-8a2d2ac5f925 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:06.871603 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c17cf-7d3c-4563-9427-8a2d2ac5f925 None admin] RBAC: Adding query filter params (name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:06.871913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c17cf-7d3c-4563-9427-8a2d2ac5f925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:06.873316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c17cf-7d3c-4563-9427-8a2d2ac5f925 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:06.882258 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 274/557] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:48:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:06.883512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8fbd6-8d03-499b-af64-b0631ba4a9ed None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:06.883802 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8fbd6-8d03-499b-af64-b0631ba4a9ed None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:06.884077 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8fbd6-8d03-499b-af64-b0631ba4a9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:06.889839 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a61d9-dc4d-4b1f-bca3-5da15bdd97f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:06.890866 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a61d9-dc4d-4b1f-bca3-5da15bdd97f2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:06.892023 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a61d9-dc4d-4b1f-bca3-5da15bdd97f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:06.892305 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a61d9-dc4d-4b1f-bca3-5da15bdd97f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:06.899965 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a61d9-dc4d-4b1f-bca3-5da15bdd97f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:06.901424 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a61d9-dc4d-4b1f-bca3-5da15bdd97f2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:06.901663 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-37a8fbd6-8d03-499b-af64-b0631ba4a9ed None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:06.902994 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-37a8fbd6-8d03-499b-af64-b0631ba4a9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:06.916942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-9f9a61d9-dc4d-4b1f-bca3-5da15bdd97f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:06.916942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:06.916942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:06.916942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:06.916942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:06.916942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:06.916942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:06.916942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:06.916942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:06.916942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:06.916942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:06.916942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:06.916942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:06.916942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:06.916942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:06.918395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:06.918395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:06.918395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:06.918395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:06.918395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:06.918395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:06.918395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:06.918395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:06.918395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:06.918395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:06.918395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:06.918395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:06.918395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:06.918395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:06.918395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:06.918395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:06.918395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:06.920125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:06.920125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:06.920125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:06.920125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:06.920125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:06.920125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:06.920125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:06.920125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:06.920125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 284/558] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:06.920125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1587a-51fb-47c8-8bc3-ded755dd8a0f None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:06.920706 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1587a-51fb-47c8-8bc3-ded755dd8a0f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:06.920706 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1587a-51fb-47c8-8bc3-ded755dd8a0f None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:06.926102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 285/559] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:06.926880 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1587a-51fb-47c8-8bc3-ded755dd8a0f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:06.988605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 275/560] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:48:06.989496 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8fbd6-8d03-499b-af64-b0631ba4a9ed None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:07.055247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1587a-51fb-47c8-8bc3-ded755dd8a0f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:07.091602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961f630-8aeb-4aa4-8066-e42c35350582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:07.092410 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961f630-8aeb-4aa4-8066-e42c35350582 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:07.092695 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961f630-8aeb-4aa4-8066-e42c35350582 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:07.092973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961f630-8aeb-4aa4-8066-e42c35350582 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:07.099010 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8fbd6-8d03-499b-af64-b0631ba4a9ed None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:07.103832 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961f630-8aeb-4aa4-8066-e42c35350582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:07.105294 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961f630-8aeb-4aa4-8066-e42c35350582 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:07.108559 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:07.120725 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:07.125907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-3961f630-8aeb-4aa4-8066-e42c35350582 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:07.125907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:07.125907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:07.125907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:07.125907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:07.125907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:07.125907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:07.125907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:07.125907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:07.125907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:07.125907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:07.125907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:07.125907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:07.125907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:07.125907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:07.126879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:07.126879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:07.126879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:07.126879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:07.126879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:07.126879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:07.126879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:07.126879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:07.126879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:07.126879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:07.126879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:07.126879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:07.126879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:07.126879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:07.126879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:07.126879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:07.126879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:07.127766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:07.127766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:07.127766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:07.127766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:07.127766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 286/561] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:07.128803 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f7f2c-5a8d-43f4-a1b7-cfe2977d1512 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:07.129089 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f7f2c-5a8d-43f4-a1b7-cfe2977d1512 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:07.129371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f7f2c-5a8d-43f4-a1b7-cfe2977d1512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:07.143862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0840d1-ae94-4478-8341-1f6325e1a707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:07.144532 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0840d1-ae94-4478-8341-1f6325e1a707 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:07.144813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0840d1-ae94-4478-8341-1f6325e1a707 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:07.145087 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0840d1-ae94-4478-8341-1f6325e1a707 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:07.146866 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0840d1-ae94-4478-8341-1f6325e1a707 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:07.146866 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0840d1-ae94-4478-8341-1f6325e1a707 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:07.147132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-926f7f2c-5a8d-43f4-a1b7-cfe2977d1512 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:07.148437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-926f7f2c-5a8d-43f4-a1b7-cfe2977d1512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:07.148640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0840d1-ae94-4478-8341-1f6325e1a707 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:07.163349 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 276/562] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:07.164343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0840d1-ae94-4478-8341-1f6325e1a707 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:07.225775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 287/563] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:48:07.231010 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f7f2c-5a8d-43f4-a1b7-cfe2977d1512 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:07.272564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0840d1-ae94-4478-8341-1f6325e1a707 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:07.308247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbd405-d2b5-40a6-bd09-b1bb6df5b307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:07.309200 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbd405-d2b5-40a6-bd09-b1bb6df5b307 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:07.309672 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbd405-d2b5-40a6-bd09-b1bb6df5b307 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:07.309896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbd405-d2b5-40a6-bd09-b1bb6df5b307 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:07.320146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbd405-d2b5-40a6-bd09-b1bb6df5b307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:07.328044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-d1dbd405-d2b5-40a6-bd09-b1bb6df5b307 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:07.328044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:07.328044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:07.328044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:07.328044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:07.328044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:07.328044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:07.328044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:07.328044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:07.328044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:07.328044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:07.328044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:07.328044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:07.328044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:07.328044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:07.328044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:07.329124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:07.329124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:07.329124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:07.329124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:07.329124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:07.329124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:07.329124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:07.329124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:07.329124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:07.329124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:07.329124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:07.329124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:07.329124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:07.329124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:07.329124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:07.329124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:07.330164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:07.330164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:07.330164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:07.330164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:07.330164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:07.330164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:07.330164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:07.330164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:07.330164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:07.330164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:07.330164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:07.330164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:07.330164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 277/564] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:48:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:07.331300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbd405-d2b5-40a6-bd09-b1bb6df5b307 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:07.351377 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f7f2c-5a8d-43f4-a1b7-cfe2977d1512 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:07.371652 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:07.377616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:07.386440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2de5af-78a2-47ee-8476-a04acffca001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:07.387164 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2de5af-78a2-47ee-8476-a04acffca001 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:07.387441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2de5af-78a2-47ee-8476-a04acffca001 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:07.387711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2de5af-78a2-47ee-8476-a04acffca001 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:07.388429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2de5af-78a2-47ee-8476-a04acffca001 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:07.388734 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2de5af-78a2-47ee-8476-a04acffca001 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:07.390135 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2de5af-78a2-47ee-8476-a04acffca001 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:07.401087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 288/565] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:07.401915 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2de5af-78a2-47ee-8476-a04acffca001 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:07.429622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbd405-d2b5-40a6-bd09-b1bb6df5b307 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:07.463145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8bf27-da6f-4dd8-88fc-07bf151262cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:07.463805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8bf27-da6f-4dd8-88fc-07bf151262cd None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:07.464084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8bf27-da6f-4dd8-88fc-07bf151262cd None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:07.464343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8bf27-da6f-4dd8-88fc-07bf151262cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:07.465174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8bf27-da6f-4dd8-88fc-07bf151262cd None admin] RBAC: Adding query filter params (role.id=d3525fac5dcc418cbf1bc53ab83dbec6, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=b4faac48f82244bebf039aab92898617) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:07.465992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8bf27-da6f-4dd8-88fc-07bf151262cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:07.467445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8bf27-da6f-4dd8-88fc-07bf151262cd None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:07.472923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 278/566] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:48:07 2022] GET /identity/v3/role_assignments?user.id=b4faac48f82244bebf039aab92898617&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=d3525fac5dcc418cbf1bc53ab83dbec6 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:07.473990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb95a5c-9bb3-496a-884e-c84e0a880ad4 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:07.474275 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb95a5c-9bb3-496a-884e-c84e0a880ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:07.474547 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb95a5c-9bb3-496a-884e-c84e0a880ad4 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:07.475762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 279/567] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:07.476464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb95a5c-9bb3-496a-884e-c84e0a880ad4 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:07.535366 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2de5af-78a2-47ee-8476-a04acffca001 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:07.574757 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a5314-0554-4f4a-a039-0b409ce3f23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:07.575720 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a5314-0554-4f4a-a039-0b409ce3f23e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:07.576007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a5314-0554-4f4a-a039-0b409ce3f23e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:07.576317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a5314-0554-4f4a-a039-0b409ce3f23e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:07.589213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a5314-0554-4f4a-a039-0b409ce3f23e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:07.597432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-ac0a5314-0554-4f4a-a039-0b409ce3f23e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:07.597432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:07.597432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:07.597432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:07.597432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:07.597432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:07.597432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:07.597432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:07.597432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:07.597432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:07.597432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:07.597432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:07.597432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:07.597432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:07.597432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:07.597432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:07.598653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:07.598653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:07.598653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:07.598653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:07.598653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:07.598653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:07.598653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:07.598653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:07.598653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:07.598653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:07.598653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:07.598653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:07.598653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:07.598653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:07.598653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:07.598653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:07.604375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:07.604375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:07.604375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:07.604375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:07.604375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:07.604375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:07.604375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:07.604375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:07.604375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:07.604375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:07.604375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:07.604375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:07.604375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 289/568] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:48:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:07.604375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a5314-0554-4f4a-a039-0b409ce3f23e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:07.608789 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb95a5c-9bb3-496a-884e-c84e0a880ad4 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:07.612948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:07.651917 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e92c2-78ce-4b18-b5f9-b491352f7196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:07.652506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e92c2-78ce-4b18-b5f9-b491352f7196 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:07.653083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e92c2-78ce-4b18-b5f9-b491352f7196 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:07.653204 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e92c2-78ce-4b18-b5f9-b491352f7196 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:07.653910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e92c2-78ce-4b18-b5f9-b491352f7196 None admin] RBAC: Adding query filter params (name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:07.654208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e92c2-78ce-4b18-b5f9-b491352f7196 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:07.655006 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:07.655617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e92c2-78ce-4b18-b5f9-b491352f7196 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:07.665213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 280/569] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:48:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:07.666556 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dce3c-3e43-431d-82a5-b49899704fe4 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:07.666841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dce3c-3e43-431d-82a5-b49899704fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:07.667116 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dce3c-3e43-431d-82a5-b49899704fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:07.686216 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f19dce3c-3e43-431d-82a5-b49899704fe4 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:07.687424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f19dce3c-3e43-431d-82a5-b49899704fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:07.722710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a5314-0554-4f4a-a039-0b409ce3f23e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:07.757849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 281/570] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:48:07.758615 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dce3c-3e43-431d-82a5-b49899704fe4 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:07.772311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a5e70-db19-4a6e-b096-48754cce4e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:07.774225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a5e70-db19-4a6e-b096-48754cce4e43 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:07.774851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a5e70-db19-4a6e-b096-48754cce4e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:07.775426 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a5e70-db19-4a6e-b096-48754cce4e43 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:07.786468 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a5e70-db19-4a6e-b096-48754cce4e43 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:07.788020 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a5e70-db19-4a6e-b096-48754cce4e43 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:07.802662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-db7a5e70-db19-4a6e-b096-48754cce4e43 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 18:48:07.802662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:07.802662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:07.802662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:07.802662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:07.802662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:07.802662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:07.802662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:07.802662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:07.802662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:07.802662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:07.802662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:07.802662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:07.802662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:07.802662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:07.802662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:07.803636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:07.803636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:07.803636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:07.803636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:07.803636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:07.803636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:07.803636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:07.803636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:07.803636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:07.803636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:07.803636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:07.803636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:07.803636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:07.803636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:07.803636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:07.803636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:07.803636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:07.803636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:07.804562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:07.804562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:07.804562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:07.804562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:07.804562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:07.804562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:07.804562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:07.804562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:07.804562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 18:48:07.804562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:07.804562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 290/571] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:48:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:07.805172 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a5e70-db19-4a6e-b096-48754cce4e43 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:07.861688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:07.868014 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dce3c-3e43-431d-82a5-b49899704fe4 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:07.904322 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f51a67-cb9c-4b03-a216-0662ae30fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:07.904909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f51a67-cb9c-4b03-a216-0662ae30fde1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:07.905192 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f51a67-cb9c-4b03-a216-0662ae30fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:07.905468 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f51a67-cb9c-4b03-a216-0662ae30fde1 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:07.906252 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f51a67-cb9c-4b03-a216-0662ae30fde1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:07.906560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f51a67-cb9c-4b03-a216-0662ae30fde1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:07.907951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f51a67-cb9c-4b03-a216-0662ae30fde1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:07.913502 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a5e70-db19-4a6e-b096-48754cce4e43 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:07.916115 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 282/572] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:48:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:07.916991 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f51a67-cb9c-4b03-a216-0662ae30fde1 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:07.927787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:07.957460 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85221768-19ed-478b-97ed-36f6a6e57308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:07.958739 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85221768-19ed-478b-97ed-36f6a6e57308 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:07.959083 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85221768-19ed-478b-97ed-36f6a6e57308 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:07.959430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85221768-19ed-478b-97ed-36f6a6e57308 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:07.971777 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85221768-19ed-478b-97ed-36f6a6e57308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:07.973240 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85221768-19ed-478b-97ed-36f6a6e57308 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:07.991554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-85221768-19ed-478b-97ed-36f6a6e57308 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:07.991554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:07.991554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:07.991554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:07.991554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:07.991554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:07.991554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:07.991554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:07.991554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:07.991554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:07.991554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:07.991554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:07.991554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:07.991554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:07.991554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:07.992455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:07.992455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:07.992455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:07.992455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:07.992455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:07.992455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:07.992455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:07.992455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:07.992455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:07.992455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:07.992455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:07.992455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:07.992455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:07.992455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:07.992455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:07.992455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:07.992455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:07.993317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:07.993317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:07.993317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:07.993317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:07.993317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 291/573] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:07.993694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85221768-19ed-478b-97ed-36f6a6e57308 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:08.031481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f51a67-cb9c-4b03-a216-0662ae30fde1 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:08.066806 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b15881-16d0-4024-9ca5-cac7797e3d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:08.067616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b15881-16d0-4024-9ca5-cac7797e3d17 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:08.067897 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b15881-16d0-4024-9ca5-cac7797e3d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:08.068172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b15881-16d0-4024-9ca5-cac7797e3d17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:08.079194 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b15881-16d0-4024-9ca5-cac7797e3d17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:08.087202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-a3b15881-16d0-4024-9ca5-cac7797e3d17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:08.087202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:08.087202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:08.087202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:08.087202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:08.087202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:08.087202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:08.087202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:08.087202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:08.087202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:08.087202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:08.087202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:08.087202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:08.087202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:08.087202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:08.087202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:08.088201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:08.088201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:08.088201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:08.088201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:08.088201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:08.088201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:08.088201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:08.088201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:08.088201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:08.088201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:08.088201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:08.088201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:08.088201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:08.088201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:08.088201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:08.088201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:08.089161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:08.089161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:08.089161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:08.089161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:08.089161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:08.089161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:08.089161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:08.089161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:08.089161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:08.089161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:08.089161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:08.089161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:08.093948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 283/574] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:48:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:08.094803 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b15881-16d0-4024-9ca5-cac7797e3d17 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:08.102371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85221768-19ed-478b-97ed-36f6a6e57308 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:08.114791 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:08.140979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2c8f0-89a8-4079-bef2-70d5ea54bc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:08.141987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2c8f0-89a8-4079-bef2-70d5ea54bc1e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:08.142279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2c8f0-89a8-4079-bef2-70d5ea54bc1e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:08.142614 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2c8f0-89a8-4079-bef2-70d5ea54bc1e None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:08.143391 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2c8f0-89a8-4079-bef2-70d5ea54bc1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:08.143695 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2c8f0-89a8-4079-bef2-70d5ea54bc1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:08.145399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2c8f0-89a8-4079-bef2-70d5ea54bc1e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:08.164498 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 292/575] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Jun 2 18:48:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:08.170199 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2c8f0-89a8-4079-bef2-70d5ea54bc1e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:08.189229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:08.201314 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b15881-16d0-4024-9ca5-cac7797e3d17 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:08.239310 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08b222-f95b-42e1-b66e-1a2eaea27bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:08.240132 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08b222-f95b-42e1-b66e-1a2eaea27bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:08.240389 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08b222-f95b-42e1-b66e-1a2eaea27bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:08.240659 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08b222-f95b-42e1-b66e-1a2eaea27bb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:08.252168 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08b222-f95b-42e1-b66e-1a2eaea27bb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:08.253636 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08b222-f95b-42e1-b66e-1a2eaea27bb8 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:08.271552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-aa08b222-f95b-42e1-b66e-1a2eaea27bb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:08.271552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:08.271552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:08.271552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:08.271552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:08.271552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:08.271552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:08.271552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:08.271552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:08.271552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:08.271552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:08.271552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:08.271552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:08.271552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:08.271552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:08.272471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:08.272471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:08.272471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:08.272471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:08.272471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:08.272471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:08.272471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:08.272471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:08.272471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:08.272471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:08.272471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:08.272471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:08.272471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:08.272471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:08.272471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:08.272471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:08.272471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:08.273348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:08.273348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:08.273348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:08.273348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:08.273348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 284/576] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:08.273654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08b222-f95b-42e1-b66e-1a2eaea27bb8 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:08.286227 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2c8f0-89a8-4079-bef2-70d5ea54bc1e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:08.322230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad92a6c-d24c-4a03-a007-efd20447d687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:08.322882 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad92a6c-d24c-4a03-a007-efd20447d687 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:08.323165 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad92a6c-d24c-4a03-a007-efd20447d687 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:08.323435 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad92a6c-d24c-4a03-a007-efd20447d687 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:08.324157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad92a6c-d24c-4a03-a007-efd20447d687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:08.324483 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad92a6c-d24c-4a03-a007-efd20447d687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:08.326237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad92a6c-d24c-4a03-a007-efd20447d687 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:08.338154 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 293/577] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:08.338948 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad92a6c-d24c-4a03-a007-efd20447d687 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:08.354339 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:08.388434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08b222-f95b-42e1-b66e-1a2eaea27bb8 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:08.422571 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:08.424686 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e98ef-6672-46a4-93e6-34f7f289da5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:08.425544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e98ef-6672-46a4-93e6-34f7f289da5d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:08.426042 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e98ef-6672-46a4-93e6-34f7f289da5d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:08.426384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e98ef-6672-46a4-93e6-34f7f289da5d None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:08.427210 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e98ef-6672-46a4-93e6-34f7f289da5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:08.427736 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e98ef-6672-46a4-93e6-34f7f289da5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:08.429559 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e98ef-6672-46a4-93e6-34f7f289da5d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:08.438662 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 285/578] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:48:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:08.443838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e98ef-6672-46a4-93e6-34f7f289da5d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:08.448268 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad92a6c-d24c-4a03-a007-efd20447d687 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:08.484569 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea441c0e-32ad-46c7-85d6-d84e644d9d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:08.485766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea441c0e-32ad-46c7-85d6-d84e644d9d86 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:08.486073 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea441c0e-32ad-46c7-85d6-d84e644d9d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:08.486344 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea441c0e-32ad-46c7-85d6-d84e644d9d86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:08.500261 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea441c0e-32ad-46c7-85d6-d84e644d9d86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:08.501725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea441c0e-32ad-46c7-85d6-d84e644d9d86 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:08.523129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-ea441c0e-32ad-46c7-85d6-d84e644d9d86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:08.523129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:08.523129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:08.523129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:08.523129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:08.523129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:08.523129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:08.523129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:08.523129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:08.523129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:08.523129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:08.523129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:08.523129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:08.523129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:08.523129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:08.524231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:08.524231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:08.524231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:08.524231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:08.524231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:08.524231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:08.524231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:08.524231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:08.524231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:08.524231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:08.524231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:08.524231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:08.524231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:08.524231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:08.524231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:08.524231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:08.524231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:08.525150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:08.525150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:08.525150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:08.525150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:08.525150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 294/579] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:08.525684 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea441c0e-32ad-46c7-85d6-d84e644d9d86 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:08.557035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e98ef-6672-46a4-93e6-34f7f289da5d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:08.590033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:08.596823 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9511f4a-3c80-4979-ac80-6eb4784f58c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:08.597559 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9511f4a-3c80-4979-ac80-6eb4784f58c4 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:08.597929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9511f4a-3c80-4979-ac80-6eb4784f58c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:08.598265 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9511f4a-3c80-4979-ac80-6eb4784f58c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:08.599073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9511f4a-3c80-4979-ac80-6eb4784f58c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:08.599477 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9511f4a-3c80-4979-ac80-6eb4784f58c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:08.600919 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9511f4a-3c80-4979-ac80-6eb4784f58c4 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:08.617714 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 286/580] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:08.617714 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9511f4a-3c80-4979-ac80-6eb4784f58c4 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:08.638092 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea441c0e-32ad-46c7-85d6-d84e644d9d86 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:08.666882 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:08.679071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91937915-0258-48a4-9db8-214dec03117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:08.679801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91937915-0258-48a4-9db8-214dec03117a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:08.680076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91937915-0258-48a4-9db8-214dec03117a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:08.680350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91937915-0258-48a4-9db8-214dec03117a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:08.689031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91937915-0258-48a4-9db8-214dec03117a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:08.690518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91937915-0258-48a4-9db8-214dec03117a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:08.705550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-91937915-0258-48a4-9db8-214dec03117a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 18:48:08.705550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:08.705550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:08.705550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:08.705550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:08.705550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:08.705550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:08.705550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:08.705550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:08.705550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:08.705550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:08.705550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:08.705550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:08.705550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:08.705550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:08.705550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:08.706819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:08.706819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:08.706819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:08.706819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:08.706819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:08.706819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:08.706819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:08.706819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:08.706819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:08.706819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:08.706819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:08.706819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:08.706819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:08.706819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:08.706819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:08.706819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:08.706819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:08.706819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:08.708131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:08.708131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:08.708131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:08.708131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:08.708131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:08.708131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:08.708131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:08.708131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:08.708131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 18:48:08.708131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:08.708131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 295/581] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jun 2 18:48:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:08.708131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91937915-0258-48a4-9db8-214dec03117a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:08.729045 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9511f4a-3c80-4979-ac80-6eb4784f58c4 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:08.768378 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52282309-18bd-4166-a4c2-349ec6160121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:08.769283 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52282309-18bd-4166-a4c2-349ec6160121 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:08.769875 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52282309-18bd-4166-a4c2-349ec6160121 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:08.769996 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52282309-18bd-4166-a4c2-349ec6160121 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:08.781483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52282309-18bd-4166-a4c2-349ec6160121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:08.782968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52282309-18bd-4166-a4c2-349ec6160121 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:08.802104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-52282309-18bd-4166-a4c2-349ec6160121 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:08.802104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:08.802104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:08.802104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:08.802104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:08.802104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:08.802104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:08.802104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:08.802104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:08.802104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:08.802104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:08.802104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:08.802104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:08.802104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:08.802104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:08.803185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:08.803185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:08.803185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:08.803185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:08.803185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:08.803185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:08.803185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:08.803185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:08.803185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:08.803185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:08.803185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:08.803185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:08.803185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:08.803185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:08.803185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:08.803185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:08.803185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:08.804258 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:08.804258 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:08.804258 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:08.804258 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:08.807992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 287/582] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:08.808597 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52282309-18bd-4166-a4c2-349ec6160121 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:08.815979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91937915-0258-48a4-9db8-214dec03117a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:08.852745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee657ef-fc94-4866-9ef3-c71818ab860d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:08.853655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee657ef-fc94-4866-9ef3-c71818ab860d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:08.853820 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee657ef-fc94-4866-9ef3-c71818ab860d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:08.853983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee657ef-fc94-4866-9ef3-c71818ab860d None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:08.854776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee657ef-fc94-4866-9ef3-c71818ab860d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:08.855050 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee657ef-fc94-4866-9ef3-c71818ab860d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:08.856632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee657ef-fc94-4866-9ef3-c71818ab860d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:08.856814 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:08.873689 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 296/583] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:08.873689 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee657ef-fc94-4866-9ef3-c71818ab860d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:08.917818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52282309-18bd-4166-a4c2-349ec6160121 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:08.923806 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:08.957028 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b4895-f01c-45a0-b28c-512ad76e5a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:08.958250 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b4895-f01c-45a0-b28c-512ad76e5a3b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:08.958806 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b4895-f01c-45a0-b28c-512ad76e5a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:08.958806 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b4895-f01c-45a0-b28c-512ad76e5a3b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:08.966698 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b4895-f01c-45a0-b28c-512ad76e5a3b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:08.968155 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b4895-f01c-45a0-b28c-512ad76e5a3b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:08.976949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee657ef-fc94-4866-9ef3-c71818ab860d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:08.989317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-190b4895-f01c-45a0-b28c-512ad76e5a3b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 18:48:08.989317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:08.989317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:08.989317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:08.989317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:08.989317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:08.989317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:08.989317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:08.989317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:08.989317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:08.989317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:08.989317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:08.989317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:08.989317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:08.989317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:08.989317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:08.990359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:08.990359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:08.990359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:08.990359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:08.990359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:08.990359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:08.990359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:08.990359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:08.990359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:08.990359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:08.990359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:08.990359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:08.990359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:08.990359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:08.990359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:08.990359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:08.990359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:08.990359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:08.991281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:08.991281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:08.991281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:08.991281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:08.991281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:08.991281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:08.991281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:08.991281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:08.991281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 18:48:08.991281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:08.991281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 288/584] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:48:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:08.991861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b4895-f01c-45a0-b28c-512ad76e5a3b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:09.018271 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4701ded-f133-4458-9da1-6da348d1b8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:09.018941 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4701ded-f133-4458-9da1-6da348d1b8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:09.019223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4701ded-f133-4458-9da1-6da348d1b8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:09.019492 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4701ded-f133-4458-9da1-6da348d1b8a9 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:09.020321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4701ded-f133-4458-9da1-6da348d1b8a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:09.020624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4701ded-f133-4458-9da1-6da348d1b8a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:09.022096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4701ded-f133-4458-9da1-6da348d1b8a9 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:09.039783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 297/585] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jun 2 18:48:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:09.043124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4701ded-f133-4458-9da1-6da348d1b8a9 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:09.100894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b4895-f01c-45a0-b28c-512ad76e5a3b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:09.103221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:09.138064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff68ae9-2717-4fef-9b58-cd17bec24645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:09.138733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff68ae9-2717-4fef-9b58-cd17bec24645 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:09.139007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff68ae9-2717-4fef-9b58-cd17bec24645 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:09.139276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff68ae9-2717-4fef-9b58-cd17bec24645 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:09.139987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff68ae9-2717-4fef-9b58-cd17bec24645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:09.140285 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff68ae9-2717-4fef-9b58-cd17bec24645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:09.141652 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff68ae9-2717-4fef-9b58-cd17bec24645 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:09.152953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4701ded-f133-4458-9da1-6da348d1b8a9 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:09.154228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 289/586] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:09.159430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff68ae9-2717-4fef-9b58-cd17bec24645 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:09.161780 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:09.191119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54809c1c-0f6e-4f51-adf9-a357b58857ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:09.191854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54809c1c-0f6e-4f51-adf9-a357b58857ba None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:09.192134 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54809c1c-0f6e-4f51-adf9-a357b58857ba None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:09.192402 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54809c1c-0f6e-4f51-adf9-a357b58857ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:09.199108 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54809c1c-0f6e-4f51-adf9-a357b58857ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:09.200619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54809c1c-0f6e-4f51-adf9-a357b58857ba None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:09.214818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-54809c1c-0f6e-4f51-adf9-a357b58857ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:09.214818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:09.214818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:09.214818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:09.214818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:09.214818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:09.214818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:09.214818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:09.214818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:09.214818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:09.214818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:09.214818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:09.214818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:09.214818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:09.214818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:09.216072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:09.216072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:09.216072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:09.216072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:09.216072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:09.216072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:09.216072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:09.216072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:09.216072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:09.216072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:09.216072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:09.216072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:09.216072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:09.216072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:09.216072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:09.216072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:09.216072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:09.217517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:09.217517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:09.217517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:09.217517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:09.217517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:09.217517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:09.217517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:09.217517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:09.217517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 298/587] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:09.217517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54809c1c-0f6e-4f51-adf9-a357b58857ba None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:09.273811 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff68ae9-2717-4fef-9b58-cd17bec24645 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:09.309589 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bebcd-53d1-42fa-92e4-5e8dfdc661bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:09.310602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bebcd-53d1-42fa-92e4-5e8dfdc661bc None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:09.310887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bebcd-53d1-42fa-92e4-5e8dfdc661bc None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:09.311157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bebcd-53d1-42fa-92e4-5e8dfdc661bc None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:09.311998 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bebcd-53d1-42fa-92e4-5e8dfdc661bc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:09.312303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bebcd-53d1-42fa-92e4-5e8dfdc661bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:09.313772 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bebcd-53d1-42fa-92e4-5e8dfdc661bc None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:09.325763 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54809c1c-0f6e-4f51-adf9-a357b58857ba None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:09.337704 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 290/588] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Jun 2 18:48:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:09.337704 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bebcd-53d1-42fa-92e4-5e8dfdc661bc None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:09.361733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e76b5-9025-4443-8471-3312c44972a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:09.362561 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e76b5-9025-4443-8471-3312c44972a5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:09.362838 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e76b5-9025-4443-8471-3312c44972a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:09.363102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e76b5-9025-4443-8471-3312c44972a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:09.363940 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:09.375427 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e76b5-9025-4443-8471-3312c44972a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:09.376916 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e76b5-9025-4443-8471-3312c44972a5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:09.395289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-007e76b5-9025-4443-8471-3312c44972a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:09.395289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:09.395289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:09.395289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:09.395289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:09.395289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:09.395289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:09.395289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:09.395289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:09.395289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:09.395289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:09.395289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:09.395289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:09.395289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:09.395289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:09.396431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:09.396431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:09.396431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:09.396431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:09.396431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:09.396431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:09.396431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:09.396431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:09.396431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:09.396431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:09.396431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:09.396431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:09.396431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:09.396431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:09.396431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:09.396431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:09.396431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:09.397850 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:09.397850 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:09.397850 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:09.397850 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:09.397850 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 299/589] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:09.397850 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e76b5-9025-4443-8471-3312c44972a5 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:09.423064 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:09.452190 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bebcd-53d1-42fa-92e4-5e8dfdc661bc None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:09.487917 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab60ae6-9fa7-4e77-9b6d-1743d857a4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:09.488647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab60ae6-9fa7-4e77-9b6d-1743d857a4df None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:09.488920 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab60ae6-9fa7-4e77-9b6d-1743d857a4df None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:09.489198 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab60ae6-9fa7-4e77-9b6d-1743d857a4df None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:09.496264 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab60ae6-9fa7-4e77-9b6d-1743d857a4df None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:09.498450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab60ae6-9fa7-4e77-9b6d-1743d857a4df None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:09.510909 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e76b5-9025-4443-8471-3312c44972a5 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:09.513982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-eab60ae6-9fa7-4e77-9b6d-1743d857a4df None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 18:48:09.513982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:09.513982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:09.513982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:09.513982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:09.513982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:09.513982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:09.513982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:09.513982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:09.513982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:09.513982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:09.513982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:09.513982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:09.513982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:09.513982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:09.513982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:09.515054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:09.515054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:09.515054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:09.515054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:09.515054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:09.515054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:09.515054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:09.515054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:09.515054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:09.515054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:09.515054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:09.515054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:09.515054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:09.515054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:09.515054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:09.515054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:09.515054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:09.515054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:09.516012 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:09.516012 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:09.516012 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:09.516012 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:09.516012 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:09.516012 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:09.516012 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:09.516012 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:09.516012 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 18:48:09.516012 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:09.516012 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 291/590] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:48:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:09.516615 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab60ae6-9fa7-4e77-9b6d-1743d857a4df None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:09.554528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37087952-ac50-437a-9a31-79ba9c263387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:09.555205 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37087952-ac50-437a-9a31-79ba9c263387 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:09.555484 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37087952-ac50-437a-9a31-79ba9c263387 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:09.555752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37087952-ac50-437a-9a31-79ba9c263387 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:09.556664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37087952-ac50-437a-9a31-79ba9c263387 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:09.556837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37087952-ac50-437a-9a31-79ba9c263387 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:09.558309 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37087952-ac50-437a-9a31-79ba9c263387 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:09.576001 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 300/591] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:09.576001 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37087952-ac50-437a-9a31-79ba9c263387 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:09.615649 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:09.634740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab60ae6-9fa7-4e77-9b6d-1743d857a4df None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:09.661904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:09.673376 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeee3ca-7ae5-4c8b-b1c6-2f7ba4517a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:09.674305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeee3ca-7ae5-4c8b-b1c6-2f7ba4517a9b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:09.674653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeee3ca-7ae5-4c8b-b1c6-2f7ba4517a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:09.674993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeee3ca-7ae5-4c8b-b1c6-2f7ba4517a9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:09.685765 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeee3ca-7ae5-4c8b-b1c6-2f7ba4517a9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:09.687267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeee3ca-7ae5-4c8b-b1c6-2f7ba4517a9b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:09.689259 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37087952-ac50-437a-9a31-79ba9c263387 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:09.706342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-7aeee3ca-7ae5-4c8b-b1c6-2f7ba4517a9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:09.706342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:09.706342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:09.706342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:09.706342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:09.706342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:09.706342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:09.706342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:09.706342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:09.706342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:09.706342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:09.706342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:09.706342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:09.706342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:09.706342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:09.707416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:09.707416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:09.707416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:09.707416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:09.707416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:09.707416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:09.707416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:09.707416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:09.707416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:09.707416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:09.707416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:09.707416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:09.707416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:09.707416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:09.707416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:09.707416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:09.707416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:09.708791 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:09.708791 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:09.708791 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:09.708791 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:09.712708 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 292/592] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:09.713358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeee3ca-7ae5-4c8b-b1c6-2f7ba4517a9b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:09.727263 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a2681-a457-430f-89ea-6ba760d92eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:09.727941 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a2681-a457-430f-89ea-6ba760d92eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:09.728223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a2681-a457-430f-89ea-6ba760d92eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:09.728495 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a2681-a457-430f-89ea-6ba760d92eb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:09.729223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a2681-a457-430f-89ea-6ba760d92eb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:09.729533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a2681-a457-430f-89ea-6ba760d92eb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:09.731079 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a2681-a457-430f-89ea-6ba760d92eb7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:09.742215 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 301/593] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:09.742983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a2681-a457-430f-89ea-6ba760d92eb7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:09.814747 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeee3ca-7ae5-4c8b-b1c6-2f7ba4517a9b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:09.846181 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a2681-a457-430f-89ea-6ba760d92eb7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:09.848816 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f045c-33a9-4011-9c39-fa584475a931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:09.849495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f045c-33a9-4011-9c39-fa584475a931 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:09.849775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f045c-33a9-4011-9c39-fa584475a931 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:09.850099 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f045c-33a9-4011-9c39-fa584475a931 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:09.850920 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f045c-33a9-4011-9c39-fa584475a931 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:09.851226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f045c-33a9-4011-9c39-fa584475a931 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:09.852672 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f045c-33a9-4011-9c39-fa584475a931 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:09.854344 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:09.871318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 293/594] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Jun 2 18:48:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:09.872224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f045c-33a9-4011-9c39-fa584475a931 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:09.880614 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15fedb-a09b-488a-bd50-b9d72de82ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:09.881502 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15fedb-a09b-488a-bd50-b9d72de82ebf None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:09.881778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15fedb-a09b-488a-bd50-b9d72de82ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:09.882076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15fedb-a09b-488a-bd50-b9d72de82ebf None admin] PATH_INFO: `/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/8a1b010003c44dc19643558167424d13/roles/d3525fac5dcc418cbf1bc53ab83dbec6` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:09.890449 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:09.897409 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15fedb-a09b-488a-bd50-b9d72de82ebf None admin] RBAC: Authorizing `identity:create_grant(project_id=3a3d8f5b51ff4201b3968c9173ae06a7, user_id=8a1b010003c44dc19643558167424d13, role_id=d3525fac5dcc418cbf1bc53ab83dbec6)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:09.898891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15fedb-a09b-488a-bd50-b9d72de82ebf None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:09.911387 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 302/595] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:48:09 2022] PUT /identity/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/8a1b010003c44dc19643558167424d13/roles/d3525fac5dcc418cbf1bc53ab83dbec6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:48:09.912862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf1224-2585-4701-aa54-facd9be30a13 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:09.913148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf1224-2585-4701-aa54-facd9be30a13 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:09.913419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf1224-2585-4701-aa54-facd9be30a13 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:09.914927 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 303/596] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:09.915447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf1224-2585-4701-aa54-facd9be30a13 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:09.987230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f045c-33a9-4011-9c39-fa584475a931 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:10.028882 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891eecf3-41cb-42e2-b71c-85edced8f6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:10.029097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891eecf3-41cb-42e2-b71c-85edced8f6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:10.029264 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891eecf3-41cb-42e2-b71c-85edced8f6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:10.029534 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891eecf3-41cb-42e2-b71c-85edced8f6d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:10.030301 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891eecf3-41cb-42e2-b71c-85edced8f6d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:10.030604 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891eecf3-41cb-42e2-b71c-85edced8f6d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:10.032023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891eecf3-41cb-42e2-b71c-85edced8f6d6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:10.033359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf1224-2585-4701-aa54-facd9be30a13 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:10.045027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 294/597] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:10.045968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891eecf3-41cb-42e2-b71c-85edced8f6d6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:10.076205 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e6881-5213-4861-9ec2-42e052ffbed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:10.077024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e6881-5213-4861-9ec2-42e052ffbed5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:10.077294 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e6881-5213-4861-9ec2-42e052ffbed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:10.077559 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e6881-5213-4861-9ec2-42e052ffbed5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:10.085490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e6881-5213-4861-9ec2-42e052ffbed5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:10.086990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e6881-5213-4861-9ec2-42e052ffbed5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:10.101783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-899e6881-5213-4861-9ec2-42e052ffbed5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:10.101783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:10.101783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:10.101783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:10.101783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:10.101783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:10.101783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:10.101783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:10.101783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:10.101783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:10.101783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:10.101783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:10.101783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:10.101783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:10.101783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:10.102933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:10.102933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:10.102933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:10.102933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:10.102933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:10.102933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:10.102933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:10.102933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:10.102933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:10.102933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:10.102933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:10.102933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:10.102933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:10.102933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:10.102933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:10.102933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:10.102933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:10.103989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:10.103989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:10.103989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:10.103989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:10.103989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:10.103989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:10.103989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:10.103989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:10.103989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 304/598] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:10.104565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfcf22-104b-4ae5-a403-1e78afde9496 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:10.104565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfcf22-104b-4ae5-a403-1e78afde9496 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:10.104793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfcf22-104b-4ae5-a403-1e78afde9496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:10.116050 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:10.128845 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-83dfcf22-104b-4ae5-a403-1e78afde9496 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:10.130076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-83dfcf22-104b-4ae5-a403-1e78afde9496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:10.178906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891eecf3-41cb-42e2-b71c-85edced8f6d6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:10.180607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:10.209196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 305/599] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:48:10.210987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfcf22-104b-4ae5-a403-1e78afde9496 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:10.219434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98925806-f3ac-48a6-8547-6c052e523354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:10.220598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98925806-f3ac-48a6-8547-6c052e523354 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:10.221405 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98925806-f3ac-48a6-8547-6c052e523354 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:10.221907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98925806-f3ac-48a6-8547-6c052e523354 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:10.234173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98925806-f3ac-48a6-8547-6c052e523354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:10.235898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98925806-f3ac-48a6-8547-6c052e523354 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:10.253199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-98925806-f3ac-48a6-8547-6c052e523354 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:10.253199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:10.253199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:10.253199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:10.253199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:10.253199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:10.253199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:10.253199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:10.253199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:10.253199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:10.253199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:10.253199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:10.253199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:10.253199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:10.253199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:10.254266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:10.254266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:10.254266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:10.254266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:10.254266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:10.254266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:10.254266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:10.254266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:10.254266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:10.254266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:10.254266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:10.254266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:10.254266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:10.254266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:10.254266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:10.254266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:10.254266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:10.255153 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:10.255153 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:10.255153 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:10.255153 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:10.255567 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 295/600] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:10.256340 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98925806-f3ac-48a6-8547-6c052e523354 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:10.320093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfcf22-104b-4ae5-a403-1e78afde9496 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:10.356252 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea352cb8-1b4f-412e-b0ca-59716394500f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:10.357058 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea352cb8-1b4f-412e-b0ca-59716394500f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:10.357335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea352cb8-1b4f-412e-b0ca-59716394500f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:10.357601 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea352cb8-1b4f-412e-b0ca-59716394500f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:10.360627 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98925806-f3ac-48a6-8547-6c052e523354 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:10.363945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:10.364526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea352cb8-1b4f-412e-b0ca-59716394500f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:10.366082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea352cb8-1b4f-412e-b0ca-59716394500f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:10.380599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-ea352cb8-1b4f-412e-b0ca-59716394500f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:10.380599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:10.380599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:10.380599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:10.380599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:10.380599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:10.380599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:10.380599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:10.380599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:10.380599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:10.380599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:10.380599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:10.380599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:10.380599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:10.380599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:10.381545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:10.381545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:10.381545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:10.381545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:10.381545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:10.381545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:10.381545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:10.381545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:10.381545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:10.381545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:10.381545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:10.381545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:10.381545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:10.381545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:10.381545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:10.381545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:10.381545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:10.382487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:10.382487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:10.382487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:10.382487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:10.382487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:10.382487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:10.382487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:10.382487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:10.382487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 306/601] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:10.383543 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea352cb8-1b4f-412e-b0ca-59716394500f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:10.403584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc8d7a-30fb-43a9-b273-e3484ff86b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:10.405028 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc8d7a-30fb-43a9-b273-e3484ff86b1e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:10.405514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc8d7a-30fb-43a9-b273-e3484ff86b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:10.406280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc8d7a-30fb-43a9-b273-e3484ff86b1e None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:10.407428 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc8d7a-30fb-43a9-b273-e3484ff86b1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:10.408234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc8d7a-30fb-43a9-b273-e3484ff86b1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:10.410368 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc8d7a-30fb-43a9-b273-e3484ff86b1e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:10.422257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:10.432427 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 296/602] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:10.432427 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc8d7a-30fb-43a9-b273-e3484ff86b1e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:10.482786 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea352cb8-1b4f-412e-b0ca-59716394500f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:10.524014 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060099d-6011-4c5d-883e-2e19cb054ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:10.524841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060099d-6011-4c5d-883e-2e19cb054ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:10.525119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060099d-6011-4c5d-883e-2e19cb054ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:10.525387 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060099d-6011-4c5d-883e-2e19cb054ed7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:10.539239 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060099d-6011-4c5d-883e-2e19cb054ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:10.547202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-f060099d-6011-4c5d-883e-2e19cb054ed7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:10.547202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:10.547202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:10.547202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:10.547202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:10.547202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:10.547202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:10.547202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:10.547202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:10.547202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:10.547202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:10.547202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:10.547202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:10.547202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:10.547202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:10.547202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:10.548114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:10.548114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:10.548114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:10.548114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:10.548114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:10.548114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:10.548114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:10.548114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:10.548114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:10.548114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:10.548114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:10.548114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:10.548114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:10.548114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:10.548114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:10.548114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:10.548947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:10.548947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:10.548947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:10.548947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:10.548947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:10.548947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:10.548947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:10.548947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:10.548947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:10.548947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:10.548947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:10.548947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:10.552033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc8d7a-30fb-43a9-b273-e3484ff86b1e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:10.553295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 307/603] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:48:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:10.554145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060099d-6011-4c5d-883e-2e19cb054ed7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:10.588363 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931f6b1-3073-4174-8da6-b25b93c8666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:10.588958 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931f6b1-3073-4174-8da6-b25b93c8666a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:10.589237 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931f6b1-3073-4174-8da6-b25b93c8666a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:10.589501 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931f6b1-3073-4174-8da6-b25b93c8666a None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:10.590556 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931f6b1-3073-4174-8da6-b25b93c8666a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:10.590556 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931f6b1-3073-4174-8da6-b25b93c8666a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:10.591942 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931f6b1-3073-4174-8da6-b25b93c8666a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:10.605333 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 297/604] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:10.606792 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931f6b1-3073-4174-8da6-b25b93c8666a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:10.637901 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:10.655191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:10.659503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060099d-6011-4c5d-883e-2e19cb054ed7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:10.695522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db4c3b-0873-4bf8-b633-951fe434a755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:10.696182 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db4c3b-0873-4bf8-b633-951fe434a755 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:10.696458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db4c3b-0873-4bf8-b633-951fe434a755 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:10.696726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db4c3b-0873-4bf8-b633-951fe434a755 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:10.697507 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db4c3b-0873-4bf8-b633-951fe434a755 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:10.697827 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db4c3b-0873-4bf8-b633-951fe434a755 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:10.699256 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db4c3b-0873-4bf8-b633-951fe434a755 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:10.712257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 308/605] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:10.712975 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db4c3b-0873-4bf8-b633-951fe434a755 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:10.722360 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931f6b1-3073-4174-8da6-b25b93c8666a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:10.756848 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e41a0-1526-494e-a762-4fd4f0c32ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:10.757740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e41a0-1526-494e-a762-4fd4f0c32ce5 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:10.758048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e41a0-1526-494e-a762-4fd4f0c32ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:10.758316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e41a0-1526-494e-a762-4fd4f0c32ce5 None admin] PATH_INFO: `/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/6b8ff9f5032e498db3c70c79cc11989b/roles/d3525fac5dcc418cbf1bc53ab83dbec6` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:10.773474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e41a0-1526-494e-a762-4fd4f0c32ce5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a3d8f5b51ff4201b3968c9173ae06a7, user_id=6b8ff9f5032e498db3c70c79cc11989b, role_id=d3525fac5dcc418cbf1bc53ab83dbec6)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:10.774985 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e41a0-1526-494e-a762-4fd4f0c32ce5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:10.789723 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 298/606] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:48:10 2022] PUT /identity/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/6b8ff9f5032e498db3c70c79cc11989b/roles/d3525fac5dcc418cbf1bc53ab83dbec6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:48:10.790850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e41a0-1526-494e-a762-4fd4f0c32ce5 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:10.837490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db4c3b-0873-4bf8-b633-951fe434a755 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:10.880051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a89b0-dd1b-410d-b879-7fe8a909a337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:10.881178 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a89b0-dd1b-410d-b879-7fe8a909a337 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:10.881773 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a89b0-dd1b-410d-b879-7fe8a909a337 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:10.882411 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a89b0-dd1b-410d-b879-7fe8a909a337 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:10.883477 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a89b0-dd1b-410d-b879-7fe8a909a337 None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:10.883993 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a89b0-dd1b-410d-b879-7fe8a909a337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:10.885941 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a89b0-dd1b-410d-b879-7fe8a909a337 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:10.896509 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 309/607] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:48:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:10.897836 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a89b0-dd1b-410d-b879-7fe8a909a337 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:10.901625 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:10.930261 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:10.942519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e41a0-1526-494e-a762-4fd4f0c32ce5 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:10.981915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5826f-4688-4ab6-8525-ff3a9d6db9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:10.982733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5826f-4688-4ab6-8525-ff3a9d6db9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:10.983015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5826f-4688-4ab6-8525-ff3a9d6db9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:10.983287 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5826f-4688-4ab6-8525-ff3a9d6db9c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:10.991126 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5826f-4688-4ab6-8525-ff3a9d6db9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:10.992968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5826f-4688-4ab6-8525-ff3a9d6db9c0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:11.015081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-94e5826f-4688-4ab6-8525-ff3a9d6db9c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:11.015081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:11.015081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:11.015081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:11.015081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:11.015081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:11.015081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:11.015081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:11.015081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:11.015081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:11.015081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:11.015081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:11.015081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:11.015081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:11.015081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:11.016040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:11.016040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:11.016040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:11.016040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:11.016040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:11.016040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:11.016040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:11.016040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:11.016040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:11.016040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:11.016040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:11.016040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:11.016040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:11.016040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:11.016040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:11.016040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:11.016040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:11.016924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:11.016924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:11.016924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:11.016924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:11.016924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:11.016924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:11.016924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:11.016924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:11.016924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 299/608] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:11.018362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5826f-4688-4ab6-8525-ff3a9d6db9c0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:11.043657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a89b0-dd1b-410d-b879-7fe8a909a337 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:11.089692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf549c3-254e-428e-b121-4c01b5f12169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:11.091088 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf549c3-254e-428e-b121-4c01b5f12169 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:11.091366 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf549c3-254e-428e-b121-4c01b5f12169 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:11.091636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf549c3-254e-428e-b121-4c01b5f12169 None admin] PATH_INFO: `/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/e0141329b2cd4f668803a192d2b6cedb/roles/d3525fac5dcc418cbf1bc53ab83dbec6` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:11.112052 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf549c3-254e-428e-b121-4c01b5f12169 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a3d8f5b51ff4201b3968c9173ae06a7, user_id=e0141329b2cd4f668803a192d2b6cedb, role_id=d3525fac5dcc418cbf1bc53ab83dbec6)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:11.114003 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf549c3-254e-428e-b121-4c01b5f12169 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:11.136514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 310/609] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:48:10 2022] PUT /identity/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/e0141329b2cd4f668803a192d2b6cedb/roles/d3525fac5dcc418cbf1bc53ab83dbec6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:48:11.141499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf549c3-254e-428e-b121-4c01b5f12169 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:11.150496 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5826f-4688-4ab6-8525-ff3a9d6db9c0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:11.228576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:11.270626 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf549c3-254e-428e-b121-4c01b5f12169 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:11.271704 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ec03f-3474-43c8-99ae-799c693bc0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:11.272750 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ec03f-3474-43c8-99ae-799c693bc0ce None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:11.273243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ec03f-3474-43c8-99ae-799c693bc0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:11.273715 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ec03f-3474-43c8-99ae-799c693bc0ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:11.280282 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:11.299759 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ec03f-3474-43c8-99ae-799c693bc0ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:11.301399 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ec03f-3474-43c8-99ae-799c693bc0ce None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:11.313684 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b551c7-b6b9-465c-9360-906487c13234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:11.314673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b551c7-b6b9-465c-9360-906487c13234 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:11.315096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b551c7-b6b9-465c-9360-906487c13234 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:11.315512 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b551c7-b6b9-465c-9360-906487c13234 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:11.316949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b551c7-b6b9-465c-9360-906487c13234 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:11.317405 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b551c7-b6b9-465c-9360-906487c13234 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:11.319258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b551c7-b6b9-465c-9360-906487c13234 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:11.334828 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 311/610] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:11.343588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-fb5ec03f-3474-43c8-99ae-799c693bc0ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:11.343588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:11.343588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:11.343588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:11.343588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:11.343588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:11.343588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:11.343588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:11.343588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:11.343588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:11.343588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:11.343588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:11.343588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:11.343588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:11.343588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:11.344572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:11.344572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:11.344572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:11.344572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:11.344572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:11.344572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:11.344572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:11.344572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:11.344572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:11.344572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:11.344572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:11.344572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:11.344572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:11.344572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:11.344572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:11.344572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:11.344572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:11.345444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:11.345444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:11.345444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:11.345444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:11.345444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 300/611] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:11.346659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b551c7-b6b9-465c-9360-906487c13234 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:11.350437 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ec03f-3474-43c8-99ae-799c693bc0ce None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:11.503692 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ec03f-3474-43c8-99ae-799c693bc0ce None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:11.504000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b551c7-b6b9-465c-9360-906487c13234 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:11.548051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:11.551838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1465277-501b-4118-874c-20179d5819da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:11.553625 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1465277-501b-4118-874c-20179d5819da None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:11.554110 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1465277-501b-4118-874c-20179d5819da None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:11.554759 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1465277-501b-4118-874c-20179d5819da None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:11.555635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1465277-501b-4118-874c-20179d5819da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:11.556015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1465277-501b-4118-874c-20179d5819da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:11.556627 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371f617-c94d-4aae-ac41-53e3818f2500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:11.557603 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1465277-501b-4118-874c-20179d5819da None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:11.557971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371f617-c94d-4aae-ac41-53e3818f2500 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:11.558420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371f617-c94d-4aae-ac41-53e3818f2500 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:11.558976 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371f617-c94d-4aae-ac41-53e3818f2500 None admin] PATH_INFO: `/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/e7714d3ad1d849f5a398fc1843f22e4b/roles/d3525fac5dcc418cbf1bc53ab83dbec6` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:11.572987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 301/612] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:11.578156 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1465277-501b-4118-874c-20179d5819da None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:11.579177 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371f617-c94d-4aae-ac41-53e3818f2500 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a3d8f5b51ff4201b3968c9173ae06a7, user_id=e7714d3ad1d849f5a398fc1843f22e4b, role_id=d3525fac5dcc418cbf1bc53ab83dbec6)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:11.580793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371f617-c94d-4aae-ac41-53e3818f2500 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:11.600459 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 312/613] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:48:11 2022] PUT /identity/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/e7714d3ad1d849f5a398fc1843f22e4b/roles/d3525fac5dcc418cbf1bc53ab83dbec6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:48:11.640827 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:11.702803 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1465277-501b-4118-874c-20179d5819da None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:11.742175 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3c926-404f-4f7b-a4aa-e41c29489b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:11.743044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3c926-404f-4f7b-a4aa-e41c29489b3f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:11.743318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3c926-404f-4f7b-a4aa-e41c29489b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:11.743589 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3c926-404f-4f7b-a4aa-e41c29489b3f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:11.751847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3c926-404f-4f7b-a4aa-e41c29489b3f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:11.753356 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3c926-404f-4f7b-a4aa-e41c29489b3f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:11.769976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-68a3c926-404f-4f7b-a4aa-e41c29489b3f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 18:48:11.769976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:11.769976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:11.769976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:11.769976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:11.769976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:11.769976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:11.769976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:11.769976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:11.769976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:11.769976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:11.769976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:11.769976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:11.769976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:11.769976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:11.769976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:11.770938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:11.770938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:11.770938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:11.770938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:11.770938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:11.770938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:11.770938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:11.770938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:11.770938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:11.770938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:11.770938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:11.770938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:11.770938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:11.770938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:11.770938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:11.770938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:11.770938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:11.770938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:11.771857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:11.771857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:11.771857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:11.771857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:11.771857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:11.771857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:11.771857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:11.771857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:11.771857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 18:48:11.771857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:11.771857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 302/614] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:48:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:11.777451 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371f617-c94d-4aae-ac41-53e3818f2500 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:11.932519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371f617-c94d-4aae-ac41-53e3818f2500 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:11.978911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e16592-2e02-4c77-9b61-f2df9f5f7e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:11.979601 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e16592-2e02-4c77-9b61-f2df9f5f7e6f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:11.979877 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e16592-2e02-4c77-9b61-f2df9f5f7e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:11.980145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e16592-2e02-4c77-9b61-f2df9f5f7e6f None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:11.981334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e16592-2e02-4c77-9b61-f2df9f5f7e6f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:11.981642 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e16592-2e02-4c77-9b61-f2df9f5f7e6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:11.983109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e16592-2e02-4c77-9b61-f2df9f5f7e6f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:12.001177 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 313/615] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Jun 2 18:48:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:12.006656 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3c926-404f-4f7b-a4aa-e41c29489b3f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:12.129331 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3c926-404f-4f7b-a4aa-e41c29489b3f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:12.137965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:12.175578 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14400b-f387-417a-bcb5-febdecab66db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:12.176480 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14400b-f387-417a-bcb5-febdecab66db None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:12.176818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14400b-f387-417a-bcb5-febdecab66db None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:12.177146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14400b-f387-417a-bcb5-febdecab66db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:12.199866 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14400b-f387-417a-bcb5-febdecab66db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:12.201605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14400b-f387-417a-bcb5-febdecab66db None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:12.226247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-cb14400b-f387-417a-bcb5-febdecab66db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:12.226247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:12.226247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:12.226247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:12.226247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:12.226247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:12.226247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:12.226247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:12.226247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:12.226247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:12.226247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:12.226247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:12.226247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:12.226247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:12.226247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:12.227540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:12.227540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:12.227540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:12.227540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:12.227540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:12.227540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:12.227540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:12.227540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:12.227540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:12.227540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:12.227540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:12.227540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:12.227540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:12.227540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:12.227540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:12.227540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:12.227540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:12.228766 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:12.228766 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:12.228766 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:12.228766 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:12.229628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 303/616] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:12.235253 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e16592-2e02-4c77-9b61-f2df9f5f7e6f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:12.286977 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f5907-a7bd-4499-b62d-3e60ed44f285 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:12.287425 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f5907-a7bd-4499-b62d-3e60ed44f285 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:12.287799 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f5907-a7bd-4499-b62d-3e60ed44f285 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:12.289520 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 304/617] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:48:12.294974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c7b16-b4a9-43e1-8254-df6b7a6cd679 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:12.295363 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c7b16-b4a9-43e1-8254-df6b7a6cd679 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:12.295729 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c7b16-b4a9-43e1-8254-df6b7a6cd679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:12.299356 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:12.329124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e15c7b16-b4a9-43e1-8254-df6b7a6cd679 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:12.330327 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e15c7b16-b4a9-43e1-8254-df6b7a6cd679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:12.417587 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e16592-2e02-4c77-9b61-f2df9f5f7e6f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:12.453364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e8257-e6a2-4c4d-8dda-a0bb10c81e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:12.454068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e8257-e6a2-4c4d-8dda-a0bb10c81e09 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:12.454345 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e8257-e6a2-4c4d-8dda-a0bb10c81e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:12.454603 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e8257-e6a2-4c4d-8dda-a0bb10c81e09 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:12.455331 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e8257-e6a2-4c4d-8dda-a0bb10c81e09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:12.455638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e8257-e6a2-4c4d-8dda-a0bb10c81e09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:12.457024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e8257-e6a2-4c4d-8dda-a0bb10c81e09 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:12.458861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 305/618] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:48:12.469673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 314/619] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:12.474775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c7b16-b4a9-43e1-8254-df6b7a6cd679 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:12.498984 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e8257-e6a2-4c4d-8dda-a0bb10c81e09 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:12.630267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:12.636036 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e8257-e6a2-4c4d-8dda-a0bb10c81e09 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:12.641332 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:12.654599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c7b16-b4a9-43e1-8254-df6b7a6cd679 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:12.690785 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff61598-f135-4c44-a910-2d1dd2e830c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:12.691675 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff61598-f135-4c44-a910-2d1dd2e830c6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:12.692081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff61598-f135-4c44-a910-2d1dd2e830c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:12.692451 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff61598-f135-4c44-a910-2d1dd2e830c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:12.700085 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff61598-f135-4c44-a910-2d1dd2e830c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:12.701686 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff61598-f135-4c44-a910-2d1dd2e830c6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:12.703473 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e4fcc-cb58-4296-bd15-d5303fea1dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:12.704300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e4fcc-cb58-4296-bd15-d5303fea1dda None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:12.704571 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e4fcc-cb58-4296-bd15-d5303fea1dda None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:12.704839 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e4fcc-cb58-4296-bd15-d5303fea1dda None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:12.716657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-7ff61598-f135-4c44-a910-2d1dd2e830c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:12.716657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:12.716657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:12.716657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:12.716657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:12.716657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:12.716657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:12.716657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:12.716657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:12.716657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:12.716657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:12.716657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:12.716657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:12.716657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:12.716657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:12.717820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:12.717820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:12.717820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:12.717820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:12.717820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:12.717820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:12.717820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:12.717820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:12.717820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:12.717820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:12.717820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:12.717820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:12.717820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:12.717820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:12.717820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:12.717820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:12.717820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:12.718898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:12.718898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:12.718898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:12.718898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:12.718898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:12.718898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:12.718898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:12.718898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:12.720654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 306/620] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:12.724735 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e4fcc-cb58-4296-bd15-d5303fea1dda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:12.726214 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff61598-f135-4c44-a910-2d1dd2e830c6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:12.734466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-f73e4fcc-cb58-4296-bd15-d5303fea1dda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:12.734466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:12.734466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:12.734466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:12.734466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:12.734466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:12.734466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:12.734466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:12.734466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:12.734466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:12.734466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:12.734466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:12.734466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:12.734466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:12.734466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:12.734466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:12.735566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:12.735566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:12.735566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:12.735566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:12.735566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:12.735566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:12.735566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:12.735566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:12.735566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:12.735566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:12.735566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:12.735566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:12.735566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:12.735566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:12.735566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:12.735566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:12.736599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:12.736599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:12.736599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:12.736599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:12.736599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:12.736599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:12.736599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:12.736599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:12.736599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:12.736599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:12.736599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:12.736599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:12.749753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 315/621] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:48:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:12.755997 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e4fcc-cb58-4296-bd15-d5303fea1dda None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:12.917356 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff61598-f135-4c44-a910-2d1dd2e830c6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:12.939964 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e4fcc-cb58-4296-bd15-d5303fea1dda None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:12.952831 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066d271-0031-4e59-b9ae-304c7b54bc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:12.953447 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066d271-0031-4e59-b9ae-304c7b54bc0c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:12.953738 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066d271-0031-4e59-b9ae-304c7b54bc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:12.954054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066d271-0031-4e59-b9ae-304c7b54bc0c None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:12.954848 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066d271-0031-4e59-b9ae-304c7b54bc0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:12.955159 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066d271-0031-4e59-b9ae-304c7b54bc0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:12.956611 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066d271-0031-4e59-b9ae-304c7b54bc0c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:12.970105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 307/622] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:12.975788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066d271-0031-4e59-b9ae-304c7b54bc0c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:12.986918 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:13.007829 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab775d9a-5847-4034-b89d-51efbeb8af80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:13.008784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab775d9a-5847-4034-b89d-51efbeb8af80 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:13.009046 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab775d9a-5847-4034-b89d-51efbeb8af80 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:13.009318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab775d9a-5847-4034-b89d-51efbeb8af80 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:13.010099 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab775d9a-5847-4034-b89d-51efbeb8af80 None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:13.010402 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab775d9a-5847-4034-b89d-51efbeb8af80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:13.011775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab775d9a-5847-4034-b89d-51efbeb8af80 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:13.028162 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 316/623] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:48:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:13.033334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab775d9a-5847-4034-b89d-51efbeb8af80 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:13.074195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:13.085483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066d271-0031-4e59-b9ae-304c7b54bc0c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:13.127026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2b2cd-f2a8-4823-81a3-73b6a3ccbf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:13.128117 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2b2cd-f2a8-4823-81a3-73b6a3ccbf61 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:13.128405 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2b2cd-f2a8-4823-81a3-73b6a3ccbf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:13.128681 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2b2cd-f2a8-4823-81a3-73b6a3ccbf61 None admin] PATH_INFO: `/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/b4faac48f82244bebf039aab92898617/roles/d3525fac5dcc418cbf1bc53ab83dbec6` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:13.145604 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2b2cd-f2a8-4823-81a3-73b6a3ccbf61 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a3d8f5b51ff4201b3968c9173ae06a7, user_id=b4faac48f82244bebf039aab92898617, role_id=d3525fac5dcc418cbf1bc53ab83dbec6)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:13.147130 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2b2cd-f2a8-4823-81a3-73b6a3ccbf61 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:13.170394 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 308/624] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:48:12 2022] PUT /identity/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/b4faac48f82244bebf039aab92898617/roles/d3525fac5dcc418cbf1bc53ab83dbec6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 18:48:13.206662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab775d9a-5847-4034-b89d-51efbeb8af80 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:13.262222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0f606-902d-4d0a-8e60-ca715250c69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:13.263240 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0f606-902d-4d0a-8e60-ca715250c69b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:13.263530 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0f606-902d-4d0a-8e60-ca715250c69b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:13.263812 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0f606-902d-4d0a-8e60-ca715250c69b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:13.283118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0f606-902d-4d0a-8e60-ca715250c69b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:13.284625 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0f606-902d-4d0a-8e60-ca715250c69b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:13.308749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-a2b0f606-902d-4d0a-8e60-ca715250c69b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:13.308749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:13.308749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:13.308749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:13.308749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:13.308749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:13.308749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:13.308749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:13.308749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:13.308749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:13.308749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:13.308749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:13.308749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:13.308749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:13.308749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:13.310990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:13.310990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:13.310990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:13.310990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:13.310990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:13.310990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:13.310990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:13.310990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:13.310990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:13.310990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:13.310990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:13.310990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:13.310990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:13.310990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:13.310990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:13.310990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:13.310990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:13.313043 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:13.313043 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:13.313043 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:13.313043 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:13.313043 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 317/625] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:13.319009 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2b2cd-f2a8-4823-81a3-73b6a3ccbf61 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:13.417206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:13.483002 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2b2cd-f2a8-4823-81a3-73b6a3ccbf61 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:13.531993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b7d92-c67a-4419-bb91-e74ba2cbd595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:13.532674 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b7d92-c67a-4419-bb91-e74ba2cbd595 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:13.532952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b7d92-c67a-4419-bb91-e74ba2cbd595 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:13.533571 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b7d92-c67a-4419-bb91-e74ba2cbd595 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:13.534001 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b7d92-c67a-4419-bb91-e74ba2cbd595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:13.534303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b7d92-c67a-4419-bb91-e74ba2cbd595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:13.535694 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b7d92-c67a-4419-bb91-e74ba2cbd595 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:13.550379 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 309/626] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:13.555955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0f606-902d-4d0a-8e60-ca715250c69b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:13.672517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:13.719074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0f606-902d-4d0a-8e60-ca715250c69b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:13.762234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aa860-010d-4c51-adaa-b5e9cf00b3b9 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:13.762579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aa860-010d-4c51-adaa-b5e9cf00b3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:13.762918 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aa860-010d-4c51-adaa-b5e9cf00b3b9 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:13.764838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 310/627] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:13.769286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff872d90-2646-4b30-aa84-499371d7b4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:13.770101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea974fd4-8ad4-4105-a35d-bb3d3f6af640 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:13.770234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff872d90-2646-4b30-aa84-499371d7b4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:13.770401 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea974fd4-8ad4-4105-a35d-bb3d3f6af640 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:13.770497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff872d90-2646-4b30-aa84-499371d7b4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:13.770645 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff872d90-2646-4b30-aa84-499371d7b4a2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:13.770736 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea974fd4-8ad4-4105-a35d-bb3d3f6af640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:13.786971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff872d90-2646-4b30-aa84-499371d7b4a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:13.788138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ea974fd4-8ad4-4105-a35d-bb3d3f6af640 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:13.788439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff872d90-2646-4b30-aa84-499371d7b4a2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:13.789429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ea974fd4-8ad4-4105-a35d-bb3d3f6af640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:13.814609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-ff872d90-2646-4b30-aa84-499371d7b4a2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 18:48:13.814609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:13.814609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:13.814609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:13.814609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:13.814609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:13.814609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:13.814609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:13.814609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:13.814609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:13.814609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:13.814609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:13.814609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:13.814609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:13.814609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:13.814609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:13.815616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:13.815616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:13.815616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:13.815616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:13.815616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:13.815616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:13.815616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:13.815616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:13.815616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:13.815616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:13.815616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:13.815616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:13.815616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:13.815616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:13.815616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:13.815616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:13.815616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:13.815616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:13.816633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:13.816633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:13.816633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:13.816633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:13.816633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:13.816633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:13.816633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:13.816633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:13.816633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 18:48:13.816633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:13.825990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 318/628] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:48:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:13.827318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff872d90-2646-4b30-aa84-499371d7b4a2 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:13.880837 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 311/629] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:48:13.887763 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12be01-0f58-4c7a-967b-0ad441a92937 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:13.888052 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12be01-0f58-4c7a-967b-0ad441a92937 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:13.888327 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12be01-0f58-4c7a-967b-0ad441a92937 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:13.889681 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 312/630] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:13.895790 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e39e6-a095-43c0-9025-fd03c7294e40 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:13.896067 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e39e6-a095-43c0-9025-fd03c7294e40 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:13.896334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e39e6-a095-43c0-9025-fd03c7294e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:13.923812 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-716e39e6-a095-43c0-9025-fd03c7294e40 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:13.925263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-716e39e6-a095-43c0-9025-fd03c7294e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:13.961066 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff872d90-2646-4b30-aa84-499371d7b4a2 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:13.981615 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:13.995071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:14.003415 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740ee61-b919-42df-8012-c1dc8e2e6885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:14.004862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740ee61-b919-42df-8012-c1dc8e2e6885 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:14.005283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740ee61-b919-42df-8012-c1dc8e2e6885 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:14.005692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740ee61-b919-42df-8012-c1dc8e2e6885 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:14.006716 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740ee61-b919-42df-8012-c1dc8e2e6885 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:14.007199 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740ee61-b919-42df-8012-c1dc8e2e6885 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:14.008817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740ee61-b919-42df-8012-c1dc8e2e6885 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:14.017897 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 313/631] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:48:14.017897 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e39e6-a095-43c0-9025-fd03c7294e40 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:14.049375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 319/632] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Jun 2 18:48:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:14.050619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740ee61-b919-42df-8012-c1dc8e2e6885 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:14.129966 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e39e6-a095-43c0-9025-fd03c7294e40 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:14.172083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512e55b-93f7-4ce1-8134-07c75769f1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:14.173115 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512e55b-93f7-4ce1-8134-07c75769f1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:14.173830 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512e55b-93f7-4ce1-8134-07c75769f1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:14.174107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512e55b-93f7-4ce1-8134-07c75769f1e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:14.182640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740ee61-b919-42df-8012-c1dc8e2e6885 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:14.188254 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512e55b-93f7-4ce1-8134-07c75769f1e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:14.196279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-c512e55b-93f7-4ce1-8134-07c75769f1e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:14.196279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:14.196279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:14.196279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:14.196279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:14.196279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:14.196279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:14.196279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:14.196279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:14.196279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:14.196279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:14.196279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:14.196279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:14.196279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:14.196279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:14.196279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:14.197191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:14.197191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:14.197191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:14.197191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:14.197191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:14.197191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:14.197191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:14.197191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:14.197191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:14.197191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:14.197191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:14.197191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:14.197191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:14.197191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:14.197191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:14.197191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:14.198121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:14.198121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:14.198121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:14.198121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:14.198121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:14.198121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:14.198121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:14.198121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:14.198121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:14.198121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:14.198121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:14.198121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:14.200483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 314/633] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:48:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:14.201412 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512e55b-93f7-4ce1-8134-07c75769f1e3 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:14.228794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f0ed0-2b6a-41c2-b30f-343d5e1ce5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:14.230186 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f0ed0-2b6a-41c2-b30f-343d5e1ce5cd None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:14.230462 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f0ed0-2b6a-41c2-b30f-343d5e1ce5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:14.230792 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f0ed0-2b6a-41c2-b30f-343d5e1ce5cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:14.245748 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f0ed0-2b6a-41c2-b30f-343d5e1ce5cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:14.249744 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:14.257490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-051f0ed0-2b6a-41c2-b30f-343d5e1ce5cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:14.257490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:14.257490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:14.257490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:14.257490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:14.257490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:14.257490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:14.257490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:14.257490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:14.257490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:14.257490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:14.257490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:14.257490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:14.257490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:14.257490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:14.257490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:14.258539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:14.258539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:14.258539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:14.258539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:14.258539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:14.258539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:14.258539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:14.258539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:14.258539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:14.258539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:14.258539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:14.258539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:14.258539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:14.258539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:14.258539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:14.258539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:14.259353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:14.259353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:14.259353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:14.259353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:14.259353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:14.259353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:14.259353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:14.259353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:14.259353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:14.259353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:14.259353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:14.259353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:14.262031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 320/634] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:48:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:14.264036 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f0ed0-2b6a-41c2-b30f-343d5e1ce5cd None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:14.320657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512e55b-93f7-4ce1-8134-07c75769f1e3 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:14.330636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:14.362018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a1645-a580-483d-8b9d-76e544e1bfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:14.363074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a1645-a580-483d-8b9d-76e544e1bfb6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:14.363546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a1645-a580-483d-8b9d-76e544e1bfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:14.364027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a1645-a580-483d-8b9d-76e544e1bfb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:14.396563 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f0ed0-2b6a-41c2-b30f-343d5e1ce5cd None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:14.432455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c09e9-12b6-4b1c-83d5-a2f5d8efded8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:14.433632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c09e9-12b6-4b1c-83d5-a2f5d8efded8 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:14.434275 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c09e9-12b6-4b1c-83d5-a2f5d8efded8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:14.435242 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c09e9-12b6-4b1c-83d5-a2f5d8efded8 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:14.436453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c09e9-12b6-4b1c-83d5-a2f5d8efded8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:14.436953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c09e9-12b6-4b1c-83d5-a2f5d8efded8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:14.437124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a1645-a580-483d-8b9d-76e544e1bfb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:14.438600 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a1645-a580-483d-8b9d-76e544e1bfb6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:14.438918 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c09e9-12b6-4b1c-83d5-a2f5d8efded8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:14.449225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 321/635] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:48:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:14.450934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c09e9-12b6-4b1c-83d5-a2f5d8efded8 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:14.477204 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:14.540692 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 315/636] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:48:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:48:14.542269 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029421c9-6858-4886-9342-2c4c7ee90b68 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:14.542715 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029421c9-6858-4886-9342-2c4c7ee90b68 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:14.543179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029421c9-6858-4886-9342-2c4c7ee90b68 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:14.544870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 316/637] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:14.545850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029421c9-6858-4886-9342-2c4c7ee90b68 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:14.580489 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c09e9-12b6-4b1c-83d5-a2f5d8efded8 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:14.596038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:14.618638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ee99a-c972-42c1-9855-57b1e5c6899f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:14.619311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ee99a-c972-42c1-9855-57b1e5c6899f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:14.619587 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ee99a-c972-42c1-9855-57b1e5c6899f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:14.619853 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ee99a-c972-42c1-9855-57b1e5c6899f None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:14.620699 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ee99a-c972-42c1-9855-57b1e5c6899f None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:14.620897 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ee99a-c972-42c1-9855-57b1e5c6899f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:14.622485 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ee99a-c972-42c1-9855-57b1e5c6899f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:14.636145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 322/638] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:48:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:14.636145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ee99a-c972-42c1-9855-57b1e5c6899f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:14.658425 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029421c9-6858-4886-9342-2c4c7ee90b68 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:14.696636 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065edf91-1c76-438d-86b8-ec8860bfcf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:14.697700 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065edf91-1c76-438d-86b8-ec8860bfcf43 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:14.698007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065edf91-1c76-438d-86b8-ec8860bfcf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:14.698280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065edf91-1c76-438d-86b8-ec8860bfcf43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:14.705833 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:14.710531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065edf91-1c76-438d-86b8-ec8860bfcf43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:14.712559 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065edf91-1c76-438d-86b8-ec8860bfcf43 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:14.731628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-065edf91-1c76-438d-86b8-ec8860bfcf43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:14.731628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:14.731628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:14.731628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:14.731628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:14.731628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:14.731628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:14.731628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:14.731628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:14.731628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:14.731628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:14.731628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:14.731628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:14.731628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:14.731628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:14.732631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:14.732631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:14.732631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:14.732631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:14.732631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:14.732631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:14.732631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:14.732631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:14.732631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:14.732631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:14.732631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:14.732631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:14.732631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:14.732631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:14.732631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:14.732631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:14.732631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:14.733499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:14.733499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:14.733499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:14.733499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:14.737504 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 317/639] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:14.738897 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c721f9-0e4a-4f9f-bbf1-ca25afeaab76 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:14.739131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c721f9-0e4a-4f9f-bbf1-ca25afeaab76 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:14.739406 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c721f9-0e4a-4f9f-bbf1-ca25afeaab76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:14.743638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ee99a-c972-42c1-9855-57b1e5c6899f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:14.757296 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d8c721f9-0e4a-4f9f-bbf1-ca25afeaab76 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:14.758533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d8c721f9-0e4a-4f9f-bbf1-ca25afeaab76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:14.780763 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb4d1a-3671-435d-a2b2-d62fb137b778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:14.781674 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb4d1a-3671-435d-a2b2-d62fb137b778 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:14.782085 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb4d1a-3671-435d-a2b2-d62fb137b778 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:14.782362 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb4d1a-3671-435d-a2b2-d62fb137b778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:14.794538 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb4d1a-3671-435d-a2b2-d62fb137b778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:14.795986 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb4d1a-3671-435d-a2b2-d62fb137b778 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:14.814886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-3aeb4d1a-3671-435d-a2b2-d62fb137b778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:14.814886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:14.814886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:14.814886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:14.814886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:14.814886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:14.814886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:14.814886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:14.814886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:14.814886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:14.814886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:14.814886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:14.814886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:14.814886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:14.814886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:14.815983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:14.815983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:14.815983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:14.815983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:14.815983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:14.815983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:14.815983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:14.815983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:14.815983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:14.815983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:14.815983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:14.815983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:14.815983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:14.815983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:14.815983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:14.815983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:14.815983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:14.816861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:14.816861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:14.816861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:14.816861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:14.816861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 323/640] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:14.816861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb4d1a-3671-435d-a2b2-d62fb137b778 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:14.830455 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 318/641] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:48:14.831213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c721f9-0e4a-4f9f-bbf1-ca25afeaab76 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:14.861913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:14.940271 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb4d1a-3671-435d-a2b2-d62fb137b778 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:14.944082 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c721f9-0e4a-4f9f-bbf1-ca25afeaab76 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:14.966409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:14.976911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b029e-8ca5-48b0-a8e5-e22955129e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:14.977723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b029e-8ca5-48b0-a8e5-e22955129e7e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:14.978069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b029e-8ca5-48b0-a8e5-e22955129e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:14.978338 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b029e-8ca5-48b0-a8e5-e22955129e7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:14.983591 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d203ca6-c8d5-4727-8a4d-6f15bac61a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:14.984470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d203ca6-c8d5-4727-8a4d-6f15bac61a49 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:14.985310 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d203ca6-c8d5-4727-8a4d-6f15bac61a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:14.985771 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d203ca6-c8d5-4727-8a4d-6f15bac61a49 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:14.986718 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d203ca6-c8d5-4727-8a4d-6f15bac61a49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:14.987585 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d203ca6-c8d5-4727-8a4d-6f15bac61a49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:14.989151 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b029e-8ca5-48b0-a8e5-e22955129e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:14.989606 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d203ca6-c8d5-4727-8a4d-6f15bac61a49 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:14.990620 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b029e-8ca5-48b0-a8e5-e22955129e7e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:15.003240 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 319/642] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:15.004271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d203ca6-c8d5-4727-8a4d-6f15bac61a49 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:15.007671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-5c3b029e-8ca5-48b0-a8e5-e22955129e7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:15.007671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:15.007671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:15.007671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:15.007671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:15.007671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:15.007671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:15.007671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:15.007671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:15.007671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:15.007671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:15.007671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:15.007671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:15.007671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:15.007671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:15.008646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:15.008646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:15.008646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:15.008646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:15.008646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:15.008646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:15.008646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:15.008646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:15.008646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:15.008646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:15.008646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:15.008646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:15.008646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:15.008646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:15.008646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:15.008646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:15.008646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:15.014787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:15.014787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:15.014787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:15.014787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:15.014787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 324/643] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:15.014787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b029e-8ca5-48b0-a8e5-e22955129e7e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:15.098973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:15.116157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d203ca6-c8d5-4727-8a4d-6f15bac61a49 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:15.123523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b029e-8ca5-48b0-a8e5-e22955129e7e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:15.151934 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0de452-e6ec-4748-82d5-86eb3cccb707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:15.152741 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0de452-e6ec-4748-82d5-86eb3cccb707 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:15.152934 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0de452-e6ec-4748-82d5-86eb3cccb707 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:15.153213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0de452-e6ec-4748-82d5-86eb3cccb707 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:15.153966 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0de452-e6ec-4748-82d5-86eb3cccb707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:15.154275 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0de452-e6ec-4748-82d5-86eb3cccb707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:15.155657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0de452-e6ec-4748-82d5-86eb3cccb707 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:15.158629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42ec05-dc55-4084-b00c-154c869524f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:15.159427 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42ec05-dc55-4084-b00c-154c869524f1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:15.159701 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42ec05-dc55-4084-b00c-154c869524f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:15.159965 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42ec05-dc55-4084-b00c-154c869524f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:15.172106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 320/644] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:15.172106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0de452-e6ec-4748-82d5-86eb3cccb707 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:15.176244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42ec05-dc55-4084-b00c-154c869524f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:15.184082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-8e42ec05-dc55-4084-b00c-154c869524f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:15.184082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:15.184082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:15.184082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:15.184082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:15.184082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:15.184082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:15.184082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:15.184082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:15.184082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:15.184082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:15.184082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:15.184082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:15.184082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:15.184082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:15.184082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:15.185055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:15.185055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:15.185055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:15.185055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:15.185055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:15.185055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:15.185055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:15.185055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:15.185055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:15.185055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:15.185055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:15.185055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:15.185055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:15.185055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:15.185055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:15.185055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:15.186367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:15.186367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:15.186367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:15.186367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:15.186367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:15.186367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:15.186367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:15.186367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:15.186367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:15.186367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:15.186367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:15.186367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:15.186367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 325/645] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:48:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:15.186367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42ec05-dc55-4084-b00c-154c869524f1 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:15.221591 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:15.288390 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0de452-e6ec-4748-82d5-86eb3cccb707 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:15.304188 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42ec05-dc55-4084-b00c-154c869524f1 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:15.328015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fd634-88e4-4628-beee-c3ddc1631847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:15.328828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fd634-88e4-4628-beee-c3ddc1631847 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:15.329107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fd634-88e4-4628-beee-c3ddc1631847 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:15.329412 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fd634-88e4-4628-beee-c3ddc1631847 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:15.337972 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fd634-88e4-4628-beee-c3ddc1631847 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:15.339413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fd634-88e4-4628-beee-c3ddc1631847 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:15.339519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab9177-f1ce-45d4-b1c3-78e39f674312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:15.340316 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab9177-f1ce-45d4-b1c3-78e39f674312 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:15.340598 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab9177-f1ce-45d4-b1c3-78e39f674312 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:15.340864 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab9177-f1ce-45d4-b1c3-78e39f674312 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:15.341573 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab9177-f1ce-45d4-b1c3-78e39f674312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:15.341899 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab9177-f1ce-45d4-b1c3-78e39f674312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:15.343253 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab9177-f1ce-45d4-b1c3-78e39f674312 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:15.351378 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:15.354824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-034fd634-88e4-4628-beee-c3ddc1631847 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 18:48:15.354824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:15.354824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:15.354824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:15.354824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:15.354824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:15.354824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:15.354824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:15.354824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:15.354824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:15.354824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:15.354824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:15.354824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:15.354824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:15.354824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:15.354824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:15.355850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:15.355850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:15.355850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:15.355850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:15.355850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:15.355850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:15.355850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:15.355850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:15.355850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:15.355850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:15.355850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:15.355850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:15.355850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:15.355850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:15.355850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:15.355850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:15.355850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:15.355850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:15.357160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:15.357160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:15.357160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:15.357160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:15.357160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:15.357160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:15.357160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:15.357160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:15.357160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 18:48:15.357160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:15.357160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 321/646] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:48:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:15.357816 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fd634-88e4-4628-beee-c3ddc1631847 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:15.370122 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 326/647] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:15.371588 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab9177-f1ce-45d4-b1c3-78e39f674312 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:15.469008 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:15.472664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fd634-88e4-4628-beee-c3ddc1631847 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:15.479764 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab9177-f1ce-45d4-b1c3-78e39f674312 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:15.510526 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ab12f-c6d9-4933-949d-1585c01834ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:15.511339 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ab12f-c6d9-4933-949d-1585c01834ad None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:15.511622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ab12f-c6d9-4933-949d-1585c01834ad None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:15.511975 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ab12f-c6d9-4933-949d-1585c01834ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:15.514244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bd0cc-0497-4f8e-8212-b534b1b021cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:15.514913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bd0cc-0497-4f8e-8212-b534b1b021cb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:15.515187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bd0cc-0497-4f8e-8212-b534b1b021cb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:15.515454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bd0cc-0497-4f8e-8212-b534b1b021cb None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:15.516189 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bd0cc-0497-4f8e-8212-b534b1b021cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:15.516491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bd0cc-0497-4f8e-8212-b534b1b021cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:15.517914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bd0cc-0497-4f8e-8212-b534b1b021cb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:15.519035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ab12f-c6d9-4933-949d-1585c01834ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:15.521113 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ab12f-c6d9-4933-949d-1585c01834ad None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:15.526502 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 327/648] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:48:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:15.527315 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bd0cc-0497-4f8e-8212-b534b1b021cb None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:15.541515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-630ab12f-c6d9-4933-949d-1585c01834ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:15.541515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:15.541515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:15.541515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:15.541515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:15.541515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:15.541515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:15.541515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:15.541515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:15.541515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:15.541515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:15.541515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:15.541515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:15.541515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:15.541515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:15.542545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:15.542545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:15.542545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:15.542545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:15.542545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:15.542545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:15.542545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:15.542545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:15.542545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:15.542545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:15.542545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:15.542545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:15.542545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:15.542545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:15.542545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:15.542545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:15.542545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:15.543499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:15.543499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:15.543499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:15.543499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:15.543499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:15.543499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:15.543499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:15.543499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:15.544507 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 322/649] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:15.545372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ab12f-c6d9-4933-949d-1585c01834ad None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:15.597775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:15.640190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bd0cc-0497-4f8e-8212-b534b1b021cb None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:15.649856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ab12f-c6d9-4933-949d-1585c01834ad None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:15.679961 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8ad76-778a-4084-9a9d-ffa85ba7ebfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:15.680644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8ad76-778a-4084-9a9d-ffa85ba7ebfd None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:15.680924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8ad76-778a-4084-9a9d-ffa85ba7ebfd None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:15.681196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8ad76-778a-4084-9a9d-ffa85ba7ebfd None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:15.682058 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8ad76-778a-4084-9a9d-ffa85ba7ebfd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:15.682363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8ad76-778a-4084-9a9d-ffa85ba7ebfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:15.683859 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8ad76-778a-4084-9a9d-ffa85ba7ebfd None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:15.684473 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226d1dd-fab0-4e8e-9879-c1df4aba740d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:15.685278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226d1dd-fab0-4e8e-9879-c1df4aba740d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:15.685582 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226d1dd-fab0-4e8e-9879-c1df4aba740d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:15.685845 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226d1dd-fab0-4e8e-9879-c1df4aba740d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:15.694743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226d1dd-fab0-4e8e-9879-c1df4aba740d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:15.696186 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226d1dd-fab0-4e8e-9879-c1df4aba740d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:15.706652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 328/650] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Jun 2 18:48:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:15.706652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8ad76-778a-4084-9a9d-ffa85ba7ebfd None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:15.711450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-7226d1dd-fab0-4e8e-9879-c1df4aba740d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 18:48:15.711450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:15.711450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:15.711450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:15.711450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:15.711450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:15.711450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:15.711450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:15.711450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:15.711450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:15.711450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:15.711450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:15.711450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:15.711450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:15.711450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:15.711450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:15.712374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:15.712374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:15.712374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:15.712374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:15.712374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:15.712374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:15.712374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:15.712374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:15.712374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:15.712374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:15.712374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:15.712374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:15.712374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:15.712374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:15.712374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:15.712374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:15.712374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:15.712374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:15.713298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:15.713298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:15.713298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:15.713298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:15.713298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:15.713298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:15.713298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:15.713298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:15.713298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 18:48:15.713298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:15.713298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 323/651] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jun 2 18:48:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:15.713908 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226d1dd-fab0-4e8e-9879-c1df4aba740d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:15.742081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:15.815057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8ad76-778a-4084-9a9d-ffa85ba7ebfd None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:15.822593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226d1dd-fab0-4e8e-9879-c1df4aba740d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:15.832938 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:15.850188 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f34b1-947b-4bf9-be32-2bf4f4884762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:15.851017 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f34b1-947b-4bf9-be32-2bf4f4884762 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:15.851298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f34b1-947b-4bf9-be32-2bf4f4884762 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:15.851566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f34b1-947b-4bf9-be32-2bf4f4884762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:15.855744 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0a131-1d3d-4c3a-b95f-126f77b36b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:15.856649 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0a131-1d3d-4c3a-b95f-126f77b36b93 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:15.856921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0a131-1d3d-4c3a-b95f-126f77b36b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:15.857192 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0a131-1d3d-4c3a-b95f-126f77b36b93 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:15.858012 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0a131-1d3d-4c3a-b95f-126f77b36b93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:15.858318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0a131-1d3d-4c3a-b95f-126f77b36b93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:15.859744 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0a131-1d3d-4c3a-b95f-126f77b36b93 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:15.862263 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f34b1-947b-4bf9-be32-2bf4f4884762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:15.863436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f34b1-947b-4bf9-be32-2bf4f4884762 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:15.871347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 324/652] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:15.872188 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0a131-1d3d-4c3a-b95f-126f77b36b93 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:15.881913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-463f34b1-947b-4bf9-be32-2bf4f4884762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:15.881913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:15.881913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:15.881913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:15.881913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:15.881913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:15.881913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:15.881913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:15.881913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:15.881913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:15.881913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:15.881913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:15.881913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:15.881913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:15.881913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:15.883087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:15.883087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:15.883087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:15.883087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:15.883087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:15.883087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:15.883087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:15.883087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:15.883087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:15.883087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:15.883087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:15.883087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:15.883087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:15.883087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:15.883087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:15.883087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:15.883087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:15.884080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:15.884080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:15.884080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:15.884080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:15.886107 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 329/653] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:15.886813 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f34b1-947b-4bf9-be32-2bf4f4884762 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:15.955634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:15.974811 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0a131-1d3d-4c3a-b95f-126f77b36b93 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:15.986812 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f34b1-947b-4bf9-be32-2bf4f4884762 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:16.008146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18528487-21fc-411e-bb59-241d13709e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:16.008801 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18528487-21fc-411e-bb59-241d13709e98 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:16.009082 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18528487-21fc-411e-bb59-241d13709e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:16.009362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18528487-21fc-411e-bb59-241d13709e98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:16.019498 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec8999-b5f8-4820-9186-13ad5f29f269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:16.020162 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec8999-b5f8-4820-9186-13ad5f29f269 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:16.020439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec8999-b5f8-4820-9186-13ad5f29f269 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:16.020707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec8999-b5f8-4820-9186-13ad5f29f269 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:16.021532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec8999-b5f8-4820-9186-13ad5f29f269 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:16.021858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec8999-b5f8-4820-9186-13ad5f29f269 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:16.023287 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec8999-b5f8-4820-9186-13ad5f29f269 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:16.040135 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 330/654] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jun 2 18:48:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:16.041360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f1648-c3a6-4f40-90b8-86be729fca82 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:16.041638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f1648-c3a6-4f40-90b8-86be729fca82 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:16.041935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f1648-c3a6-4f40-90b8-86be729fca82 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:16.043180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 331/655] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:16.044006 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f1648-c3a6-4f40-90b8-86be729fca82 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:16.072837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:16.079001 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18528487-21fc-411e-bb59-241d13709e98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:16.080509 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18528487-21fc-411e-bb59-241d13709e98 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:16.146701 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f1648-c3a6-4f40-90b8-86be729fca82 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:16.157909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:16.179342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 325/656] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:48:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:48:16.179956 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a71dc4-bcd2-4342-b9ca-4d9ef747b128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:16.180080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18528487-21fc-411e-bb59-241d13709e98 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:16.180607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a71dc4-bcd2-4342-b9ca-4d9ef747b128 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:16.180881 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a71dc4-bcd2-4342-b9ca-4d9ef747b128 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:16.181150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a71dc4-bcd2-4342-b9ca-4d9ef747b128 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:16.181992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a71dc4-bcd2-4342-b9ca-4d9ef747b128 None admin] RBAC: Adding query filter params (role.id=d3525fac5dcc418cbf1bc53ab83dbec6, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=8a1b010003c44dc19643558167424d13) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:16.182301 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a71dc4-bcd2-4342-b9ca-4d9ef747b128 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:16.183815 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a71dc4-bcd2-4342-b9ca-4d9ef747b128 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:16.189667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 332/657] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:48:16 2022] GET /identity/v3/role_assignments?user.id=8a1b010003c44dc19643558167424d13&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=d3525fac5dcc418cbf1bc53ab83dbec6 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:16.190469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a71dc4-bcd2-4342-b9ca-4d9ef747b128 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:16.302510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18528487-21fc-411e-bb59-241d13709e98 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:16.316404 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:16.329115 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a71dc4-bcd2-4342-b9ca-4d9ef747b128 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:16.344864 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7f823-25b3-47fd-b2af-02478f30dd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:16.345583 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7f823-25b3-47fd-b2af-02478f30dd97 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:16.345906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7f823-25b3-47fd-b2af-02478f30dd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:16.346133 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7f823-25b3-47fd-b2af-02478f30dd97 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:16.346883 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7f823-25b3-47fd-b2af-02478f30dd97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:16.347279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7f823-25b3-47fd-b2af-02478f30dd97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:16.348595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7f823-25b3-47fd-b2af-02478f30dd97 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:16.366676 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 326/658] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:16.366676 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242c17a-32f4-42a2-880f-91a5ec9ff270 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:16.366676 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242c17a-32f4-42a2-880f-91a5ec9ff270 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:16.366676 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242c17a-32f4-42a2-880f-91a5ec9ff270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:16.377944 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60894891-9e14-48a5-8ce9-86ed86693a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:16.378704 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60894891-9e14-48a5-8ce9-86ed86693a51 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:16.379042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60894891-9e14-48a5-8ce9-86ed86693a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:16.379380 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60894891-9e14-48a5-8ce9-86ed86693a51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:16.383628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-7242c17a-32f4-42a2-880f-91a5ec9ff270 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:16.384847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7242c17a-32f4-42a2-880f-91a5ec9ff270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:16.426903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:16.466654 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60894891-9e14-48a5-8ce9-86ed86693a51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:16.468169 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60894891-9e14-48a5-8ce9-86ed86693a51 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:16.470812 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 327/659] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:48:16.471743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242c17a-32f4-42a2-880f-91a5ec9ff270 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:16.568605 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:16.579609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 333/660] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:48:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:48:16.580528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60894891-9e14-48a5-8ce9-86ed86693a51 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:16.589725 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242c17a-32f4-42a2-880f-91a5ec9ff270 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:16.627764 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a6e93-7d67-4286-ae4f-3b9285cd2378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:16.628577 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a6e93-7d67-4286-ae4f-3b9285cd2378 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:16.628857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a6e93-7d67-4286-ae4f-3b9285cd2378 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:16.629128 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a6e93-7d67-4286-ae4f-3b9285cd2378 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:16.639734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a6e93-7d67-4286-ae4f-3b9285cd2378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:16.641194 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a6e93-7d67-4286-ae4f-3b9285cd2378 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:16.658838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-483a6e93-7d67-4286-ae4f-3b9285cd2378 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:16.658838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:16.658838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:16.658838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:16.658838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:16.658838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:16.658838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:16.658838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:16.658838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:16.658838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:16.658838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:16.658838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:16.658838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:16.658838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:16.658838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:16.659788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:16.659788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:16.659788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:16.659788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:16.659788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:16.659788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:16.659788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:16.659788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:16.659788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:16.659788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:16.659788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:16.659788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:16.659788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:16.659788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:16.659788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:16.659788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:16.659788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:16.660670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:16.660670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:16.660670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:16.660670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:16.664740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 328/661] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:16.665430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a6e93-7d67-4286-ae4f-3b9285cd2378 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:16.689400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60894891-9e14-48a5-8ce9-86ed86693a51 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:16.690978 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:16.724770 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6b3a0-4d22-4e1e-ac34-625fce84aa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:16.725578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6b3a0-4d22-4e1e-ac34-625fce84aa7a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:16.725878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6b3a0-4d22-4e1e-ac34-625fce84aa7a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:16.726153 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6b3a0-4d22-4e1e-ac34-625fce84aa7a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:16.733612 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6b3a0-4d22-4e1e-ac34-625fce84aa7a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:16.735129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6b3a0-4d22-4e1e-ac34-625fce84aa7a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:16.750077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-20e6b3a0-4d22-4e1e-ac34-625fce84aa7a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 18:48:16.750077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:16.750077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:16.750077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:16.750077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:16.750077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:16.750077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:16.750077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:16.750077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:16.750077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:16.750077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:16.750077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:16.750077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:16.750077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:16.750077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:16.750077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:16.751244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:16.751244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:16.751244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:16.751244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:16.751244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:16.751244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:16.751244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:16.751244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:16.751244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:16.751244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:16.751244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:16.751244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:16.751244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:16.751244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:16.751244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:16.751244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:16.751244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:16.751244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:16.757053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:16.757053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:16.757053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:16.757053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:16.757053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:16.757053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:16.757053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:16.757053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:16.757053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 18:48:16.757053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:16.757053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 334/662] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:48:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:16.757053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6b3a0-4d22-4e1e-ac34-625fce84aa7a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:16.780457 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a6e93-7d67-4286-ae4f-3b9285cd2378 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:16.811716 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:16.821493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702549c-231f-4a27-819a-f06fed83031b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:16.822584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702549c-231f-4a27-819a-f06fed83031b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:16.822868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702549c-231f-4a27-819a-f06fed83031b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:16.823145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702549c-231f-4a27-819a-f06fed83031b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:16.834769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702549c-231f-4a27-819a-f06fed83031b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:16.842767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-0702549c-231f-4a27-819a-f06fed83031b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:16.842767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:16.842767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:16.842767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:16.842767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:16.842767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:16.842767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:16.842767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:16.842767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:16.842767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:16.842767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:16.842767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:16.842767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:16.842767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:16.842767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:16.842767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:16.843740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:16.843740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:16.843740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:16.843740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:16.843740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:16.843740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:16.843740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:16.843740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:16.843740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:16.843740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:16.843740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:16.843740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:16.843740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:16.843740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:16.843740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:16.843740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:16.844579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:16.844579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:16.844579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:16.844579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:16.844579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:16.844579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:16.844579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:16.844579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:16.844579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:16.844579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:16.844579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:16.844579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:16.844579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 329/663] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:48:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:16.845388 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702549c-231f-4a27-819a-f06fed83031b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:16.866613 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6b3a0-4d22-4e1e-ac34-625fce84aa7a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:16.902549 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8f8c-0f53-440f-bdd0-b70211fdcb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:16.903268 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8f8c-0f53-440f-bdd0-b70211fdcb3c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:16.903552 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8f8c-0f53-440f-bdd0-b70211fdcb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:16.903827 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8f8c-0f53-440f-bdd0-b70211fdcb3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:16.914223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a8f8c-0f53-440f-bdd0-b70211fdcb3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:16.915680 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a8f8c-0f53-440f-bdd0-b70211fdcb3c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:16.933295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-319a8f8c-0f53-440f-bdd0-b70211fdcb3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:16.933295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:16.933295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:16.933295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:16.933295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:16.933295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:16.933295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:16.933295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:16.933295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:16.933295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:16.933295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:16.933295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:16.933295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:16.933295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:16.933295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:16.934518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:16.934518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:16.934518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:16.934518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:16.934518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:16.934518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:16.934518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:16.934518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:16.934518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:16.934518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:16.934518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:16.934518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:16.934518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:16.934518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:16.934518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:16.934518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:16.934518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:16.938643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:16.938643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:16.938643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:16.938643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:16.938643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 335/664] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:16.938643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8f8c-0f53-440f-bdd0-b70211fdcb3c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:16.942521 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:16.963560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702549c-231f-4a27-819a-f06fed83031b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:16.999537 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518124a4-4800-49be-9054-022d2a8dadd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:17.000218 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518124a4-4800-49be-9054-022d2a8dadd6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:17.000500 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518124a4-4800-49be-9054-022d2a8dadd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:17.000766 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518124a4-4800-49be-9054-022d2a8dadd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:17.001491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518124a4-4800-49be-9054-022d2a8dadd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:17.001812 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518124a4-4800-49be-9054-022d2a8dadd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:17.003222 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518124a4-4800-49be-9054-022d2a8dadd6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:17.015730 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 330/665] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:17.020866 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518124a4-4800-49be-9054-022d2a8dadd6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:17.043938 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8f8c-0f53-440f-bdd0-b70211fdcb3c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:17.047279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:17.080930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1add9f-426f-4fa6-a2c9-927c2907a8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:17.081522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1add9f-426f-4fa6-a2c9-927c2907a8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:17.081826 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1add9f-426f-4fa6-a2c9-927c2907a8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:17.082096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1add9f-426f-4fa6-a2c9-927c2907a8f6 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:17.083278 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1add9f-426f-4fa6-a2c9-927c2907a8f6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:17.083582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1add9f-426f-4fa6-a2c9-927c2907a8f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:17.085023 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1add9f-426f-4fa6-a2c9-927c2907a8f6 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:17.103371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 336/666] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Jun 2 18:48:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:17.104415 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1add9f-426f-4fa6-a2c9-927c2907a8f6 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:17.134811 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518124a4-4800-49be-9054-022d2a8dadd6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:17.169461 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d73e54-3797-4097-b561-381546b44e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:17.170160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d73e54-3797-4097-b561-381546b44e7b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:17.170436 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d73e54-3797-4097-b561-381546b44e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:17.170705 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d73e54-3797-4097-b561-381546b44e7b None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:17.171446 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d73e54-3797-4097-b561-381546b44e7b None admin] RBAC: Adding query filter params (name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:17.171747 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d73e54-3797-4097-b561-381546b44e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:17.173127 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d73e54-3797-4097-b561-381546b44e7b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:17.181199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 331/667] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:48:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:17.186441 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d73e54-3797-4097-b561-381546b44e7b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:17.190827 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:17.211315 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1add9f-426f-4fa6-a2c9-927c2907a8f6 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:17.248758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cf82a-cfbf-4edb-a230-3845bcb1eb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:17.249769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cf82a-cfbf-4edb-a230-3845bcb1eb40 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:17.250153 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cf82a-cfbf-4edb-a230-3845bcb1eb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:17.250412 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cf82a-cfbf-4edb-a230-3845bcb1eb40 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:17.251049 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cf82a-cfbf-4edb-a230-3845bcb1eb40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:17.251351 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cf82a-cfbf-4edb-a230-3845bcb1eb40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:17.252751 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cf82a-cfbf-4edb-a230-3845bcb1eb40 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:17.269090 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 337/668] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:17.269090 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cf82a-cfbf-4edb-a230-3845bcb1eb40 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:17.294325 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:17.304229 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d73e54-3797-4097-b561-381546b44e7b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:17.340868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1478a6f-ec47-4fd6-a474-5984fddffb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:17.341609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1478a6f-ec47-4fd6-a474-5984fddffb93 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:17.341911 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1478a6f-ec47-4fd6-a474-5984fddffb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:17.342166 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1478a6f-ec47-4fd6-a474-5984fddffb93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:17.348929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1478a6f-ec47-4fd6-a474-5984fddffb93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:17.350411 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1478a6f-ec47-4fd6-a474-5984fddffb93 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:17.365392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-b1478a6f-ec47-4fd6-a474-5984fddffb93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:17.365392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:17.365392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:17.365392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:17.365392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:17.365392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:17.365392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:17.365392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:17.365392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:17.365392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:17.365392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:17.365392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:17.365392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:17.365392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:17.365392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:17.366350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:17.366350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:17.366350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:17.366350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:17.366350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:17.366350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:17.366350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:17.366350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:17.366350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:17.366350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:17.366350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:17.366350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:17.366350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:17.366350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:17.366350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:17.366350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:17.366350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:17.367224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:17.367224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:17.367224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:17.367224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:17.367224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:17.367224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:17.367224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:17.367224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:17.367224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 332/669] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:17.368342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1478a6f-ec47-4fd6-a474-5984fddffb93 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:17.382669 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cf82a-cfbf-4edb-a230-3845bcb1eb40 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:17.420906 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80e289-369e-4a0e-a3e4-b6ba54801d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:17.421569 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80e289-369e-4a0e-a3e4-b6ba54801d92 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:17.421874 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80e289-369e-4a0e-a3e4-b6ba54801d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:17.422147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80e289-369e-4a0e-a3e4-b6ba54801d92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:17.437151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:17.478659 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1478a6f-ec47-4fd6-a474-5984fddffb93 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:17.495365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80e289-369e-4a0e-a3e4-b6ba54801d92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:17.496908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80e289-369e-4a0e-a3e4-b6ba54801d92 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:17.515238 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d476ce-f1a0-4645-a975-c53f454abe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:17.516390 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d476ce-f1a0-4645-a975-c53f454abe82 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:17.516888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d476ce-f1a0-4645-a975-c53f454abe82 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:17.517338 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d476ce-f1a0-4645-a975-c53f454abe82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:17.524920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:17.532443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d476ce-f1a0-4645-a975-c53f454abe82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:17.533956 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d476ce-f1a0-4645-a975-c53f454abe82 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:17.552516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-70d476ce-f1a0-4645-a975-c53f454abe82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:17.552516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:17.552516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:17.552516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:17.552516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:17.552516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:17.552516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:17.552516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:17.552516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:17.552516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:17.552516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:17.552516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:17.552516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:17.552516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:17.552516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:17.553432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:17.553432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:17.553432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:17.553432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:17.553432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:17.553432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:17.553432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:17.553432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:17.553432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:17.553432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:17.553432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:17.553432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:17.553432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:17.553432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:17.553432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:17.553432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:17.553432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:17.554680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:17.554680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:17.554680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:17.554680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:17.554680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 333/670] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:17.554680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d476ce-f1a0-4645-a975-c53f454abe82 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:17.607821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 338/671] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:48:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:48:17.608756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80e289-369e-4a0e-a3e4-b6ba54801d92 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:17.671794 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d476ce-f1a0-4645-a975-c53f454abe82 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:17.691103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:17.709922 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d84396-40b9-4942-8992-988d4fda53d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:17.710849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d84396-40b9-4942-8992-988d4fda53d0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:17.711226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d84396-40b9-4942-8992-988d4fda53d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:17.711599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d84396-40b9-4942-8992-988d4fda53d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:17.712077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80e289-369e-4a0e-a3e4-b6ba54801d92 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:17.719143 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d84396-40b9-4942-8992-988d4fda53d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:17.720742 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d84396-40b9-4942-8992-988d4fda53d0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:17.734841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-28d84396-40b9-4942-8992-988d4fda53d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:17.734841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:17.734841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:17.734841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:17.734841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:17.734841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:17.734841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:17.734841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:17.734841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:17.734841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:17.734841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:17.734841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:17.734841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:17.734841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:17.734841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:17.735929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:17.735929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:17.735929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:17.735929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:17.735929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:17.735929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:17.735929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:17.735929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:17.735929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:17.735929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:17.735929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:17.735929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:17.735929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:17.735929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:17.735929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:17.735929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:17.735929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:17.737056 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:17.737056 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:17.737056 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:17.737056 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:17.737056 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:17.737056 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:17.737056 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:17.737056 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:17.737658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:17.743506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 334/672] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:17.743506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d84396-40b9-4942-8992-988d4fda53d0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:17.756054 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771379c4-d99f-40fd-8d59-164d6dc9d5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:17.756725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771379c4-d99f-40fd-8d59-164d6dc9d5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:17.757010 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771379c4-d99f-40fd-8d59-164d6dc9d5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:17.757283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771379c4-d99f-40fd-8d59-164d6dc9d5c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:17.758120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771379c4-d99f-40fd-8d59-164d6dc9d5c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:17.758521 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771379c4-d99f-40fd-8d59-164d6dc9d5c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:17.759979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771379c4-d99f-40fd-8d59-164d6dc9d5c8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:17.776648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 339/673] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:17.776648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771379c4-d99f-40fd-8d59-164d6dc9d5c8 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:17.858323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d84396-40b9-4942-8992-988d4fda53d0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:17.875118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771379c4-d99f-40fd-8d59-164d6dc9d5c8 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:17.893705 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e79fe0-87f8-4ee5-9d50-9600d4b94673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:17.894610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e79fe0-87f8-4ee5-9d50-9600d4b94673 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:17.895173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e79fe0-87f8-4ee5-9d50-9600d4b94673 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:17.895457 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e79fe0-87f8-4ee5-9d50-9600d4b94673 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:17.896185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e79fe0-87f8-4ee5-9d50-9600d4b94673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:17.896492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e79fe0-87f8-4ee5-9d50-9600d4b94673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:17.898003 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e79fe0-87f8-4ee5-9d50-9600d4b94673 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:17.908891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9b359-f0af-4068-9ccd-5bd0c6613ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:17.909695 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9b359-f0af-4068-9ccd-5bd0c6613ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:17.910008 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9b359-f0af-4068-9ccd-5bd0c6613ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:17.910283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9b359-f0af-4068-9ccd-5bd0c6613ac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:17.910862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 335/674] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:17.911682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e79fe0-87f8-4ee5-9d50-9600d4b94673 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:17.926154 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9b359-f0af-4068-9ccd-5bd0c6613ac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:17.927628 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9b359-f0af-4068-9ccd-5bd0c6613ac5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:17.944914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-72f9b359-f0af-4068-9ccd-5bd0c6613ac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:17.944914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:17.944914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:17.944914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:17.944914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:17.944914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:17.944914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:17.944914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:17.944914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:17.944914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:17.944914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:17.944914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:17.944914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:17.944914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:17.944914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:17.945854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:17.945854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:17.945854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:17.945854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:17.945854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:17.945854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:17.945854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:17.945854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:17.945854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:17.945854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:17.945854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:17.945854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:17.945854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:17.945854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:17.945854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:17.945854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:17.945854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:17.946758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:17.946758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:17.946758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:17.946758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:17.946758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 340/675] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:17.947510 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9b359-f0af-4068-9ccd-5bd0c6613ac5 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:17.953105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:17.993135 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:18.024565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e79fe0-87f8-4ee5-9d50-9600d4b94673 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:18.058668 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4852e5-01b0-459f-8b7e-009e5821e71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:18.059412 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4852e5-01b0-459f-8b7e-009e5821e71f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:18.059665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4852e5-01b0-459f-8b7e-009e5821e71f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:18.059941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4852e5-01b0-459f-8b7e-009e5821e71f None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:18.060729 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4852e5-01b0-459f-8b7e-009e5821e71f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:18.061036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4852e5-01b0-459f-8b7e-009e5821e71f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:18.062571 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4852e5-01b0-459f-8b7e-009e5821e71f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:18.065526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9b359-f0af-4068-9ccd-5bd0c6613ac5 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:18.074518 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 336/676] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:18.075425 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4852e5-01b0-459f-8b7e-009e5821e71f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:18.107109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2998ebd-7f0c-4fd0-bc25-fd7684504fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:18.107792 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2998ebd-7f0c-4fd0-bc25-fd7684504fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:18.108073 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2998ebd-7f0c-4fd0-bc25-fd7684504fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:18.108398 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2998ebd-7f0c-4fd0-bc25-fd7684504fb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:18.109187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2998ebd-7f0c-4fd0-bc25-fd7684504fb5 None admin] RBAC: Adding query filter params (role.id=d3525fac5dcc418cbf1bc53ab83dbec6, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=e0141329b2cd4f668803a192d2b6cedb) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:18.109501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2998ebd-7f0c-4fd0-bc25-fd7684504fb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:18.111005 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2998ebd-7f0c-4fd0-bc25-fd7684504fb5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:18.117498 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 341/677] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:48:17 2022] GET /identity/v3/role_assignments?user.id=e0141329b2cd4f668803a192d2b6cedb&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=d3525fac5dcc418cbf1bc53ab83dbec6 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:18.118250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2998ebd-7f0c-4fd0-bc25-fd7684504fb5 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:18.188355 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:18.196288 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4852e5-01b0-459f-8b7e-009e5821e71f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:18.238781 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bac6d-05a1-4038-855e-66f2f3e264c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:18.239724 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bac6d-05a1-4038-855e-66f2f3e264c6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:18.240010 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bac6d-05a1-4038-855e-66f2f3e264c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:18.240282 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bac6d-05a1-4038-855e-66f2f3e264c6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:18.244399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:18.249405 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2998ebd-7f0c-4fd0-bc25-fd7684504fb5 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:18.250535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7bac6d-05a1-4038-855e-66f2f3e264c6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:18.252797 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7bac6d-05a1-4038-855e-66f2f3e264c6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:18.269885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-6a7bac6d-05a1-4038-855e-66f2f3e264c6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 18:48:18.269885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:18.269885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:18.269885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:18.269885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:18.269885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:18.269885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:18.269885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:18.269885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:18.269885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:18.269885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:18.269885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:18.269885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:18.269885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:18.269885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:18.269885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:18.270916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:18.270916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:18.270916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:18.270916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:18.270916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:18.270916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:18.270916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:18.270916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:18.270916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:18.270916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:18.270916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:18.270916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:18.270916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:18.270916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:18.270916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:18.270916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:18.270916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:18.270916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:18.272483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:18.272483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:18.272483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:18.272483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:18.272483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:18.272483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:18.272483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:18.272483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:18.272483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 18:48:18.272483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:18.272483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 337/678] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:48:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:18.272483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bac6d-05a1-4038-855e-66f2f3e264c6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:18.294286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef44c9-b901-4f28-9f24-39414d7919a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:18.295380 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef44c9-b901-4f28-9f24-39414d7919a9 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:18.295863 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef44c9-b901-4f28-9f24-39414d7919a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:18.296338 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef44c9-b901-4f28-9f24-39414d7919a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:18.297299 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef44c9-b901-4f28-9f24-39414d7919a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:18.297851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef44c9-b901-4f28-9f24-39414d7919a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:18.299507 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef44c9-b901-4f28-9f24-39414d7919a9 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:18.313444 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 342/679] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:18.314746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef44c9-b901-4f28-9f24-39414d7919a9 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:18.398689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bac6d-05a1-4038-855e-66f2f3e264c6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:18.446666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef44c9-b901-4f28-9f24-39414d7919a9 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:18.447691 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc27728-90c6-4cdf-8524-526b007c5d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:18.449102 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc27728-90c6-4cdf-8524-526b007c5d51 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:18.449476 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc27728-90c6-4cdf-8524-526b007c5d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:18.449999 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc27728-90c6-4cdf-8524-526b007c5d51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:18.450857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc27728-90c6-4cdf-8524-526b007c5d51 None admin] RBAC: Adding query filter params (role.id=d3525fac5dcc418cbf1bc53ab83dbec6, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=6b8ff9f5032e498db3c70c79cc11989b) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:18.451172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc27728-90c6-4cdf-8524-526b007c5d51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:18.452636 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc27728-90c6-4cdf-8524-526b007c5d51 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:18.460418 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 338/680] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:48:18 2022] GET /identity/v3/role_assignments?user.id=6b8ff9f5032e498db3c70c79cc11989b&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=d3525fac5dcc418cbf1bc53ab83dbec6 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:18.461251 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc27728-90c6-4cdf-8524-526b007c5d51 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:18.502454 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:18.514180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50049ff4-3cff-405d-ba4f-e5d19669e7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:18.514928 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50049ff4-3cff-405d-ba4f-e5d19669e7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:18.515210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50049ff4-3cff-405d-ba4f-e5d19669e7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:18.515483 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50049ff4-3cff-405d-ba4f-e5d19669e7c1 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:18.516337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50049ff4-3cff-405d-ba4f-e5d19669e7c1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:18.516649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50049ff4-3cff-405d-ba4f-e5d19669e7c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:18.519551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50049ff4-3cff-405d-ba4f-e5d19669e7c1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:18.549985 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 343/681] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Jun 2 18:48:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:18.551985 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b55c6-64b0-4d8b-ab2f-cd37fc2ac267 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:18.552494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b55c6-64b0-4d8b-ab2f-cd37fc2ac267 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:18.553030 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b55c6-64b0-4d8b-ab2f-cd37fc2ac267 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:18.555390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 344/682] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:18.559807 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b55c6-64b0-4d8b-ab2f-cd37fc2ac267 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:18.584891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:18.628318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc27728-90c6-4cdf-8524-526b007c5d51 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:18.668089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75983a-ac94-4935-adb4-77e37e604829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:18.668901 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75983a-ac94-4935-adb4-77e37e604829 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:18.669465 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75983a-ac94-4935-adb4-77e37e604829 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:18.669591 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75983a-ac94-4935-adb4-77e37e604829 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:18.677563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75983a-ac94-4935-adb4-77e37e604829 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:18.679146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75983a-ac94-4935-adb4-77e37e604829 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:18.688428 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b55c6-64b0-4d8b-ab2f-cd37fc2ac267 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:18.696358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-de75983a-ac94-4935-adb4-77e37e604829 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:18.696358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:18.696358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:18.696358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:18.696358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:18.696358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:18.696358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:18.696358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:18.696358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:18.696358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:18.696358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:18.696358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:18.696358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:18.696358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:18.696358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:18.697323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:18.697323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:18.697323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:18.697323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:18.697323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:18.697323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:18.697323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:18.697323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:18.697323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:18.697323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:18.697323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:18.697323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:18.697323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:18.697323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:18.697323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:18.697323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:18.697323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:18.698255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:18.698255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:18.698255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:18.698255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:18.698255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:18.698255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:18.698255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:18.698255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:18.698255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 339/683] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:18.699392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49858bef-589a-4f64-ae14-5d73c98206bc None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:18.699392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49858bef-589a-4f64-ae14-5d73c98206bc None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:18.699643 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49858bef-589a-4f64-ae14-5d73c98206bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:18.721642 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-49858bef-589a-4f64-ae14-5d73c98206bc None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:18.722903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-49858bef-589a-4f64-ae14-5d73c98206bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:18.737905 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fd9a7-ef72-4f69-8a90-c3dc1b6e9da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:18.738688 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fd9a7-ef72-4f69-8a90-c3dc1b6e9da0 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:18.738962 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fd9a7-ef72-4f69-8a90-c3dc1b6e9da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:18.739234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fd9a7-ef72-4f69-8a90-c3dc1b6e9da0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:18.806009 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 340/684] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:48:18.806753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49858bef-589a-4f64-ae14-5d73c98206bc None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:18.822900 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:18.825879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fd9a7-ef72-4f69-8a90-c3dc1b6e9da0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:18.827775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fd9a7-ef72-4f69-8a90-c3dc1b6e9da0 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:18.849453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:18.933650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49858bef-589a-4f64-ae14-5d73c98206bc None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:18.945922 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 345/685] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:48:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:48:18.946899 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fd9a7-ef72-4f69-8a90-c3dc1b6e9da0 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:18.976981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6200ab0-cb26-462a-8dd2-eb034021161d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:18.978155 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6200ab0-cb26-462a-8dd2-eb034021161d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:18.978906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6200ab0-cb26-462a-8dd2-eb034021161d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:18.979616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6200ab0-cb26-462a-8dd2-eb034021161d None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:18.980612 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6200ab0-cb26-462a-8dd2-eb034021161d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:18.981230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6200ab0-cb26-462a-8dd2-eb034021161d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:18.983460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6200ab0-cb26-462a-8dd2-eb034021161d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:18.998604 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 341/686] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:19.000403 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6200ab0-cb26-462a-8dd2-eb034021161d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:19.062505 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fd9a7-ef72-4f69-8a90-c3dc1b6e9da0 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:19.083139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:19.095751 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:19.106010 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53497de4-d9b9-4d57-9349-cf772834f248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:19.106985 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53497de4-d9b9-4d57-9349-cf772834f248 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:19.107329 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53497de4-d9b9-4d57-9349-cf772834f248 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:19.107688 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53497de4-d9b9-4d57-9349-cf772834f248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:19.118533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53497de4-d9b9-4d57-9349-cf772834f248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:19.120072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53497de4-d9b9-4d57-9349-cf772834f248 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:19.135038 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6200ab0-cb26-462a-8dd2-eb034021161d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:19.139311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-53497de4-d9b9-4d57-9349-cf772834f248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:19.139311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:19.139311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:19.139311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:19.139311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:19.139311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:19.139311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:19.139311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:19.139311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:19.139311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:19.139311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:19.139311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:19.139311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:19.139311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:19.139311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:19.140236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:19.140236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:19.140236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:19.140236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:19.140236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:19.140236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:19.140236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:19.140236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:19.140236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:19.140236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:19.140236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:19.140236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:19.140236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:19.140236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:19.140236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:19.140236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:19.140236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:19.141133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:19.141133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:19.141133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:19.141133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:19.145768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 346/687] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:19.146508 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53497de4-d9b9-4d57-9349-cf772834f248 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:19.177905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1571400-0855-46e9-b27b-32c225cd28b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:19.179044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1571400-0855-46e9-b27b-32c225cd28b8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:19.179514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1571400-0855-46e9-b27b-32c225cd28b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:19.179961 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1571400-0855-46e9-b27b-32c225cd28b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:19.190981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1571400-0855-46e9-b27b-32c225cd28b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:19.192676 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1571400-0855-46e9-b27b-32c225cd28b8 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:19.210647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-b1571400-0855-46e9-b27b-32c225cd28b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:19.210647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:19.210647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:19.210647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:19.210647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:19.210647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:19.210647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:19.210647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:19.210647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:19.210647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:19.210647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:19.210647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:19.210647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:19.210647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:19.210647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:19.211601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:19.211601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:19.211601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:19.211601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:19.211601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:19.211601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:19.211601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:19.211601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:19.211601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:19.211601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:19.211601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:19.211601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:19.211601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:19.211601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:19.211601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:19.211601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:19.211601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:19.212478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:19.212478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:19.212478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:19.212478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:19.214844 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 342/688] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:19.215895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1571400-0855-46e9-b27b-32c225cd28b8 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:19.276643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53497de4-d9b9-4d57-9349-cf772834f248 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:19.319507 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1571400-0855-46e9-b27b-32c225cd28b8 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:19.319735 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14cf1e-962e-45ac-a335-856f8718332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:19.320390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14cf1e-962e-45ac-a335-856f8718332b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:19.320732 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14cf1e-962e-45ac-a335-856f8718332b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:19.321067 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14cf1e-962e-45ac-a335-856f8718332b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:19.322120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14cf1e-962e-45ac-a335-856f8718332b None admin] RBAC: Adding query filter params (role.id=d3525fac5dcc418cbf1bc53ab83dbec6, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=e7714d3ad1d849f5a398fc1843f22e4b) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:19.322521 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14cf1e-962e-45ac-a335-856f8718332b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:19.324872 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14cf1e-962e-45ac-a335-856f8718332b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:19.332910 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 347/689] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:48:19 2022] GET /identity/v3/role_assignments?user.id=e7714d3ad1d849f5a398fc1843f22e4b&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=d3525fac5dcc418cbf1bc53ab83dbec6 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:19.333998 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14cf1e-962e-45ac-a335-856f8718332b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:19.348161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:19.362340 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340d3d9-fdaa-4407-94ab-1ae1c1f07dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:19.363035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340d3d9-fdaa-4407-94ab-1ae1c1f07dae None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:19.363362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340d3d9-fdaa-4407-94ab-1ae1c1f07dae None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:19.363616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340d3d9-fdaa-4407-94ab-1ae1c1f07dae None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:19.364351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340d3d9-fdaa-4407-94ab-1ae1c1f07dae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:19.364626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340d3d9-fdaa-4407-94ab-1ae1c1f07dae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:19.366237 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340d3d9-fdaa-4407-94ab-1ae1c1f07dae None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:19.384987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 343/690] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:19.387893 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340d3d9-fdaa-4407-94ab-1ae1c1f07dae None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:19.388796 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:19.538189 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14cf1e-962e-45ac-a335-856f8718332b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:19.589362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340d3d9-fdaa-4407-94ab-1ae1c1f07dae None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:19.596481 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df1fb9-9c5d-461a-94f1-9da632708fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:19.597163 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df1fb9-9c5d-461a-94f1-9da632708fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:19.597442 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df1fb9-9c5d-461a-94f1-9da632708fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:19.597715 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df1fb9-9c5d-461a-94f1-9da632708fa9 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:19.599049 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df1fb9-9c5d-461a-94f1-9da632708fa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:19.599356 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df1fb9-9c5d-461a-94f1-9da632708fa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:19.601233 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df1fb9-9c5d-461a-94f1-9da632708fa9 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:19.617016 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 348/691] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:19.623185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df1fb9-9c5d-461a-94f1-9da632708fa9 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:19.629669 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bdcd6-8eca-483d-a7ae-e41cf23fba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:19.630383 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bdcd6-8eca-483d-a7ae-e41cf23fba16 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:19.630660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bdcd6-8eca-483d-a7ae-e41cf23fba16 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:19.630934 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bdcd6-8eca-483d-a7ae-e41cf23fba16 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:19.631640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bdcd6-8eca-483d-a7ae-e41cf23fba16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:19.633094 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bdcd6-8eca-483d-a7ae-e41cf23fba16 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:19.660693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 344/692] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 2 18:48:19 2022] POST /identity/v3/users => generated 254 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:48:19.743781 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:19.755396 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df1fb9-9c5d-461a-94f1-9da632708fa9 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:19.800557 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956a99e-3bba-4c60-9105-47a018d61a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:19.801317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956a99e-3bba-4c60-9105-47a018d61a7e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:19.801593 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956a99e-3bba-4c60-9105-47a018d61a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:19.801898 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956a99e-3bba-4c60-9105-47a018d61a7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:19.812323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956a99e-3bba-4c60-9105-47a018d61a7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:19.813819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956a99e-3bba-4c60-9105-47a018d61a7e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:19.829147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-5956a99e-3bba-4c60-9105-47a018d61a7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:19.829147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:19.829147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:19.829147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:19.829147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:19.829147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:19.829147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:19.829147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:19.829147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:19.829147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:19.829147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:19.829147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:19.829147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:19.829147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:19.829147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:19.830217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:19.830217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:19.830217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:19.830217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:19.830217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:19.830217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:19.830217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:19.830217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:19.830217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:19.830217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:19.830217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:19.830217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:19.830217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:19.830217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:19.830217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:19.830217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:19.830217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:19.831364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:19.831364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:19.831364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:19.831364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:19.831364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:19.831364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:19.831364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:19.831364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:19.831364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 349/693] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:19.838479 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bdcd6-8eca-483d-a7ae-e41cf23fba16 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:19.886952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:19.957860 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bdcd6-8eca-483d-a7ae-e41cf23fba16 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:19.995331 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbd6cf-15fc-4451-8790-34f26a3b5ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:19.997087 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbd6cf-15fc-4451-8790-34f26a3b5ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:19.997573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbd6cf-15fc-4451-8790-34f26a3b5ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:19.998075 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbd6cf-15fc-4451-8790-34f26a3b5ae0 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:19.999066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbd6cf-15fc-4451-8790-34f26a3b5ae0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:19.999592 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbd6cf-15fc-4451-8790-34f26a3b5ae0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:20.001230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbd6cf-15fc-4451-8790-34f26a3b5ae0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:20.019540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 345/694] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:20.023208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956a99e-3bba-4c60-9105-47a018d61a7e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:20.141153 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956a99e-3bba-4c60-9105-47a018d61a7e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:20.177518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f22ca-4026-46d2-a138-6ea562a72331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:20.178211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f22ca-4026-46d2-a138-6ea562a72331 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:20.178488 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f22ca-4026-46d2-a138-6ea562a72331 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:20.178763 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f22ca-4026-46d2-a138-6ea562a72331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:20.179654 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f22ca-4026-46d2-a138-6ea562a72331 None admin] RBAC: Adding query filter params (role.id=d3525fac5dcc418cbf1bc53ab83dbec6, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=b4faac48f82244bebf039aab92898617) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:20.179961 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f22ca-4026-46d2-a138-6ea562a72331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:20.181452 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f22ca-4026-46d2-a138-6ea562a72331 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:20.188668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 350/695] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:48:20 2022] GET /identity/v3/role_assignments?user.id=b4faac48f82244bebf039aab92898617&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=d3525fac5dcc418cbf1bc53ab83dbec6 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:20.778117 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b605bb0-1c46-4bf7-8359-51033bc80b91 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:20.778909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b605bb0-1c46-4bf7-8359-51033bc80b91 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:20.778909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b605bb0-1c46-4bf7-8359-51033bc80b91 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:20.780170 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 346/696] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:20.785276 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e3b0c-71d1-45a2-ac5c-eb5c92eab822 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:20.785549 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e3b0c-71d1-45a2-ac5c-eb5c92eab822 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:20.785787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e3b0c-71d1-45a2-ac5c-eb5c92eab822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:20.810499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-235e3b0c-71d1-45a2-ac5c-eb5c92eab822 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:20.812157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-235e3b0c-71d1-45a2-ac5c-eb5c92eab822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:20.825406 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:20.895789 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 351/697] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:48:20.918278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b605bb0-1c46-4bf7-8359-51033bc80b91 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:20.991258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631462a-74b0-44e3-a566-7669b731b701 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:20.991591 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631462a-74b0-44e3-a566-7669b731b701 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:20.991821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631462a-74b0-44e3-a566-7669b731b701 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:20.993473 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 352/698] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:48:20.999026 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67406860-b30d-4328-965d-60eb116905b0 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:20.999311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67406860-b30d-4328-965d-60eb116905b0 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:20.999589 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67406860-b30d-4328-965d-60eb116905b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:21.017247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-67406860-b30d-4328-965d-60eb116905b0 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:21.018753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-67406860-b30d-4328-965d-60eb116905b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:21.112815 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 353/699] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:48:21.123540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:21.133772 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b605bb0-1c46-4bf7-8359-51033bc80b91 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:21.182133 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca656b0b-6a09-4132-ad50-f2f353e04d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:21.182956 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca656b0b-6a09-4132-ad50-f2f353e04d0b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:21.183401 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca656b0b-6a09-4132-ad50-f2f353e04d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:21.183992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca656b0b-6a09-4132-ad50-f2f353e04d0b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:21.185014 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca656b0b-6a09-4132-ad50-f2f353e04d0b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:21.186632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca656b0b-6a09-4132-ad50-f2f353e04d0b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:21.191389 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67406860-b30d-4328-965d-60eb116905b0 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:21.222635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-ca656b0b-6a09-4132-ad50-f2f353e04d0b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 18:48:21.222635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:21.222635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:21.222635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:21.222635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:21.222635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:21.222635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:21.222635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:21.222635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 18:48:21.222635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:21.222635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:21.222635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:21.222635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:21.222635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:21.222635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:21.222635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:21.223856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:21.223856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:21.223856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:21.223856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:21.223856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:21.223856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:21.223856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:21.223856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:21.223856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:21.223856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:21.223856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:21.223856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:21.223856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:21.223856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:21.223856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:21.223856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:21.224887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:21.224887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:21.224887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:21.224887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:21.224887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:21.224887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:21.224887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:21.224887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:21.224887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:21.224887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:21.224887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:21.224887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:21.224887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:21.224887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 18:48:21.224887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:21.231389 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 347/700] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Jun 2 18:48:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:21.237243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca656b0b-6a09-4132-ad50-f2f353e04d0b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:21.344309 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:21.392801 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca656b0b-6a09-4132-ad50-f2f353e04d0b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:21.404069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67406860-b30d-4328-965d-60eb116905b0 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:21.460232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36ad92-ed2a-4e78-9eb6-3dd1988ebb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:21.461333 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36ad92-ed2a-4e78-9eb6-3dd1988ebb81 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:21.462309 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36ad92-ed2a-4e78-9eb6-3dd1988ebb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:21.463241 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36ad92-ed2a-4e78-9eb6-3dd1988ebb81 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:21.464563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36ad92-ed2a-4e78-9eb6-3dd1988ebb81 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:21.465496 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36ad92-ed2a-4e78-9eb6-3dd1988ebb81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:21.467415 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b7ad0-5780-454d-a77d-48b8e8ff481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:21.468567 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36ad92-ed2a-4e78-9eb6-3dd1988ebb81 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:21.469599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b7ad0-5780-454d-a77d-48b8e8ff481b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:21.470153 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b7ad0-5780-454d-a77d-48b8e8ff481b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:21.472069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b7ad0-5780-454d-a77d-48b8e8ff481b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:21.481040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 348/701] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Jun 2 18:48:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:21.484238 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36ad92-ed2a-4e78-9eb6-3dd1988ebb81 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:21.498588 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b7ad0-5780-454d-a77d-48b8e8ff481b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:21.506664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-ca8b7ad0-5780-454d-a77d-48b8e8ff481b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:48:21.506664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:21.506664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:21.506664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:21.506664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:21.506664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:21.506664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:21.506664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:21.506664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:21.506664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:21.506664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:21.506664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:21.506664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:21.506664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:21.506664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:21.506664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:21.507586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:21.507586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:21.507586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:21.507586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:21.507586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:21.507586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:21.507586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:21.507586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:21.507586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:21.507586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:21.507586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:21.507586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:21.507586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:21.507586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:21.507586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:21.507586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:21.508425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:21.508425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:21.508425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:21.508425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:21.508425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:21.508425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:21.508425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:21.508425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:21.508425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:21.508425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:21.508425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:48:21.508425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:21.520827 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 354/702] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:48:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:21.533350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b7ad0-5780-454d-a77d-48b8e8ff481b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:21.542207 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:21.644216 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36ad92-ed2a-4e78-9eb6-3dd1988ebb81 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:21.678599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555ac30-0622-4582-894d-110e24107078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:21.679453 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555ac30-0622-4582-894d-110e24107078 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:21.679837 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555ac30-0622-4582-894d-110e24107078 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:21.680209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555ac30-0622-4582-894d-110e24107078 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:21.681110 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555ac30-0622-4582-894d-110e24107078 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:21.681532 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555ac30-0622-4582-894d-110e24107078 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:21.683059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555ac30-0622-4582-894d-110e24107078 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:21.689569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 349/703] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Jun 2 18:48:21 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:21.701589 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b7ad0-5780-454d-a77d-48b8e8ff481b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:21.753631 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c07f58-a2d4-4989-8697-b9cd8cf3d590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:21.754358 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c07f58-a2d4-4989-8697-b9cd8cf3d590 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:21.754688 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c07f58-a2d4-4989-8697-b9cd8cf3d590 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:21.754902 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c07f58-a2d4-4989-8697-b9cd8cf3d590 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:21.755657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c07f58-a2d4-4989-8697-b9cd8cf3d590 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:21.755960 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c07f58-a2d4-4989-8697-b9cd8cf3d590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:21.757405 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c07f58-a2d4-4989-8697-b9cd8cf3d590 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:21.766213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:21.772715 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 355/704] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:48:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:21.778918 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555ac30-0622-4582-894d-110e24107078 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:21.901097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:21.911579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555ac30-0622-4582-894d-110e24107078 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:21.950987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d153791-747e-4486-bca2-bf7315df80df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:21.951807 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153791-747e-4486-bca2-bf7315df80df None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:21.952083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153791-747e-4486-bca2-bf7315df80df None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:21.952359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153791-747e-4486-bca2-bf7315df80df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:21.964428 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d153791-747e-4486-bca2-bf7315df80df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:21.966254 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d153791-747e-4486-bca2-bf7315df80df None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:21.984027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-3d153791-747e-4486-bca2-bf7315df80df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:21.984027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:21.984027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:21.984027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:21.984027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:21.984027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:21.984027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:21.984027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:21.984027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:21.984027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:21.984027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:21.984027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:21.984027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:21.984027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:21.984027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:21.986163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:21.986163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:21.986163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:21.986163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:21.986163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:21.986163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:21.986163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:21.986163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:21.986163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:21.986163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:21.986163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:21.986163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:21.986163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:21.986163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:21.986163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:21.986163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:21.986163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:21.988205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:21.988205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:21.988205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:21.988205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:21.988205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 350/705] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:21.994573 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c07f58-a2d4-4989-8697-b9cd8cf3d590 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:22.125704 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c07f58-a2d4-4989-8697-b9cd8cf3d590 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:22.179517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46e3be-43e7-47ff-afb6-99df3358e441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:22.180111 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46e3be-43e7-47ff-afb6-99df3358e441 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:22.180398 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46e3be-43e7-47ff-afb6-99df3358e441 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:22.180636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46e3be-43e7-47ff-afb6-99df3358e441 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:22.181351 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46e3be-43e7-47ff-afb6-99df3358e441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:22.181657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46e3be-43e7-47ff-afb6-99df3358e441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:22.183064 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46e3be-43e7-47ff-afb6-99df3358e441 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:22.199266 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 356/706] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:22.205961 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d153791-747e-4486-bca2-bf7315df80df None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:22.347805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d153791-747e-4486-bca2-bf7315df80df None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:22.394710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af4af4-6c7e-4c71-9f78-60b105753159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:22.395528 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af4af4-6c7e-4c71-9f78-60b105753159 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:22.395807 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af4af4-6c7e-4c71-9f78-60b105753159 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:22.396078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af4af4-6c7e-4c71-9f78-60b105753159 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:22.410982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af4af4-6c7e-4c71-9f78-60b105753159 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:22.412468 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af4af4-6c7e-4c71-9f78-60b105753159 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:22.429626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-02af4af4-6c7e-4c71-9f78-60b105753159 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 18:48:22.429626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:22.429626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:22.429626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:22.429626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:22.429626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:22.429626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:22.429626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:22.429626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:22.429626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:22.429626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:22.429626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:22.429626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:22.429626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:22.429626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:22.429626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:22.431888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:22.431888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:22.431888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:22.431888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:22.431888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:22.431888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:22.431888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:22.431888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:22.431888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:22.431888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:22.431888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:22.431888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:22.431888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:22.431888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:22.431888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:22.431888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:22.431888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:22.431888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:22.434783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:22.434783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:22.434783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:22.434783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:22.434783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:22.434783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:22.434783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:22.434783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:22.434783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 18:48:22.434783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:22.434783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 351/707] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jun 2 18:48:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:22.439331 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46e3be-43e7-47ff-afb6-99df3358e441 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:22.525840 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:22.558526 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2157b-958c-464c-ab33-110b10b666a5 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:22.559531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2157b-958c-464c-ab33-110b10b666a5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:22.559531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2157b-958c-464c-ab33-110b10b666a5 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:22.561123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 352/708] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:48:22.571785 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef186215-62d7-4372-90d3-ff5761594766 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:22.572146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef186215-62d7-4372-90d3-ff5761594766 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:22.572422 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef186215-62d7-4372-90d3-ff5761594766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:22.576191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46e3be-43e7-47ff-afb6-99df3358e441 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:22.587800 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:22.607782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ef186215-62d7-4372-90d3-ff5761594766 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:22.609376 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ef186215-62d7-4372-90d3-ff5761594766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:22.621283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f56fe7-21d2-4065-aaca-a6a294b123db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:22.621973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f56fe7-21d2-4065-aaca-a6a294b123db None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:22.622218 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f56fe7-21d2-4065-aaca-a6a294b123db None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:22.622425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f56fe7-21d2-4065-aaca-a6a294b123db None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:22.623324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f56fe7-21d2-4065-aaca-a6a294b123db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:22.623564 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f56fe7-21d2-4065-aaca-a6a294b123db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:22.624988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f56fe7-21d2-4065-aaca-a6a294b123db None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:22.656549 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 357/709] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jun 2 18:48:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:22.658269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825f854-765f-44bb-8a2c-90e5fb6a477d None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:22.658800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825f854-765f-44bb-8a2c-90e5fb6a477d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:22.659267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825f854-765f-44bb-8a2c-90e5fb6a477d None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:22.661000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 358/710] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:22.662966 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825f854-765f-44bb-8a2c-90e5fb6a477d None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:22.705910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 353/711] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 18:48:22.705910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691406a3-f85b-44bb-9527-286cb83155fc None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:22.705910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691406a3-f85b-44bb-9527-286cb83155fc None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:22.705910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691406a3-f85b-44bb-9527-286cb83155fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:22.734863 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-691406a3-f85b-44bb-9527-286cb83155fc None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:22.736416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-691406a3-f85b-44bb-9527-286cb83155fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:22.789402 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825f854-765f-44bb-8a2c-90e5fb6a477d None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:22.806224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:22.814744 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 354/712] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:48:22.816429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691406a3-f85b-44bb-9527-286cb83155fc None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:22.837168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93b4af-4dd0-464d-a55c-d3bbc402e73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:22.837888 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93b4af-4dd0-464d-a55c-d3bbc402e73d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:22.838166 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93b4af-4dd0-464d-a55c-d3bbc402e73d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:22.838436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93b4af-4dd0-464d-a55c-d3bbc402e73d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:22.886844 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:22.918061 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93b4af-4dd0-464d-a55c-d3bbc402e73d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:22.919519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93b4af-4dd0-464d-a55c-d3bbc402e73d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:22.932279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691406a3-f85b-44bb-9527-286cb83155fc None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:22.972044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5eaae3-26c1-4ecc-9fd2-17ce9ec666bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:22.973230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5eaae3-26c1-4ecc-9fd2-17ce9ec666bc None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:22.973821 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5eaae3-26c1-4ecc-9fd2-17ce9ec666bc None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:22.974304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5eaae3-26c1-4ecc-9fd2-17ce9ec666bc None admin] PATH_INFO: `/v3/services/network` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:22.975228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5eaae3-26c1-4ecc-9fd2-17ce9ec666bc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:22.976902 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5eaae3-26c1-4ecc-9fd2-17ce9ec666bc None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:22.990424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-dc5eaae3-26c1-4ecc-9fd2-17ce9ec666bc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 18:48:22.990424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:22.990424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:22.990424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:22.990424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:22.990424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:22.990424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:22.990424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:22.990424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 18:48:22.990424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:22.990424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:22.990424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:22.990424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:22.990424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:22.990424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:22.990424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:22.990424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:22.991546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:22.991546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:22.991546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:22.991546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:22.991546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:22.991546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:22.991546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:22.991546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:22.991546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:22.991546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:22.991546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:22.991546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:22.991546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:22.991546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:22.991546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:22.991546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:22.992409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:22.992409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:22.992409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:22.992409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:22.992409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:22.992409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:22.992409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:22.992409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:22.992409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:22.992409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:22.992409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:22.992409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:22.992409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 18:48:22.992409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:23.000574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 355/713] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:22 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:23.001980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5eaae3-26c1-4ecc-9fd2-17ce9ec666bc None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:23.019825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 359/714] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:48:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 18:48:23.020679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93b4af-4dd0-464d-a55c-d3bbc402e73d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:23.043962 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:23.126994 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5eaae3-26c1-4ecc-9fd2-17ce9ec666bc None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:23.131865 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93b4af-4dd0-464d-a55c-d3bbc402e73d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:23.157931 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:23.166857 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa4ef0-d74b-4835-a525-f9e7b48dde53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:23.167542 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa4ef0-d74b-4835-a525-f9e7b48dde53 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:23.167935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa4ef0-d74b-4835-a525-f9e7b48dde53 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:23.168692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa4ef0-d74b-4835-a525-f9e7b48dde53 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:23.169173 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa4ef0-d74b-4835-a525-f9e7b48dde53 None admin] RBAC: Adding query filter params (name=network) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:23.169365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa4ef0-d74b-4835-a525-f9e7b48dde53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:23.170761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa4ef0-d74b-4835-a525-f9e7b48dde53 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:23.171098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b691a0-4838-440c-945b-d580fb0d3c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:23.172247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b691a0-4838-440c-945b-d580fb0d3c1d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:23.172812 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b691a0-4838-440c-945b-d580fb0d3c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:23.173282 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b691a0-4838-440c-945b-d580fb0d3c1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:23.180118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 360/715] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 2 18:48:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:23.180118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa4ef0-d74b-4835-a525-f9e7b48dde53 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:23.191320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b691a0-4838-440c-945b-d580fb0d3c1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:23.200492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-e6b691a0-4838-440c-945b-d580fb0d3c1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:23.200492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:23.200492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:23.200492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:23.200492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:23.200492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:23.200492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:23.200492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:23.200492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:23.200492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:23.200492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:23.200492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:23.200492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:23.200492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:23.200492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:23.200492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:23.201554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:23.201554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:23.201554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:23.201554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:23.201554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:23.201554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:23.201554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:23.201554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:23.201554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:23.201554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:23.201554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:23.201554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:23.201554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:23.201554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:23.201554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:23.201554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:23.202429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:23.202429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:23.202429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:23.202429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:23.202429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:23.202429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:23.202429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:23.202429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:23.202429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:23.202429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:23.202429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:23.202429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:23.205326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 356/716] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:48:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:23.206436 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b691a0-4838-440c-945b-d580fb0d3c1d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:23.267749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:23.287617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa4ef0-d74b-4835-a525-f9e7b48dde53 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:23.322425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f95fec-19ab-45e6-a379-12d2fdf434ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:23.323375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f95fec-19ab-45e6-a379-12d2fdf434ec None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:23.323758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f95fec-19ab-45e6-a379-12d2fdf434ec None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:23.324311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f95fec-19ab-45e6-a379-12d2fdf434ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:23.326252 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b691a0-4838-440c-945b-d580fb0d3c1d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:23.335178 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f95fec-19ab-45e6-a379-12d2fdf434ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:23.336813 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f95fec-19ab-45e6-a379-12d2fdf434ec None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:23.354723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-c3f95fec-19ab-45e6-a379-12d2fdf434ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:23.354723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:23.354723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:23.354723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:23.354723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:23.354723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:23.354723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:23.354723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:23.354723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:23.354723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:23.354723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:23.354723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:23.354723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:23.354723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:23.354723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:23.356467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:23.356467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:23.356467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:23.356467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:23.356467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:23.356467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:23.356467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:23.356467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:23.356467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:23.356467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:23.356467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:23.356467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:23.356467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:23.356467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:23.356467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:23.356467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:23.356467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:23.357352 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:23.357352 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:23.357352 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:23.357352 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:23.361163 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 361/717] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:23.362131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f95fec-19ab-45e6-a379-12d2fdf434ec None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:23.367914 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b00e83-f24b-4744-b2a8-0d3bf05098f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:23.368834 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b00e83-f24b-4744-b2a8-0d3bf05098f2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:23.369288 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b00e83-f24b-4744-b2a8-0d3bf05098f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:23.369728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b00e83-f24b-4744-b2a8-0d3bf05098f2 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:23.370626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b00e83-f24b-4744-b2a8-0d3bf05098f2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:23.371889 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b00e83-f24b-4744-b2a8-0d3bf05098f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:23.373633 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b00e83-f24b-4744-b2a8-0d3bf05098f2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:23.386010 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 357/718] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 2 18:48:23 2022] GET /identity/v3/services?type=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:23.387747 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b00e83-f24b-4744-b2a8-0d3bf05098f2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:23.454997 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:23.470815 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f95fec-19ab-45e6-a379-12d2fdf434ec None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:23.504850 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:23.510111 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35f87e-ef33-4232-8416-e45fa3486e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:23.510899 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35f87e-ef33-4232-8416-e45fa3486e55 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:23.511248 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35f87e-ef33-4232-8416-e45fa3486e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:23.511631 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35f87e-ef33-4232-8416-e45fa3486e55 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:23.512779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35f87e-ef33-4232-8416-e45fa3486e55 None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:23.513647 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35f87e-ef33-4232-8416-e45fa3486e55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:23.515199 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35f87e-ef33-4232-8416-e45fa3486e55 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:23.531797 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 362/719] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:48:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:23.531797 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d41c07-87b4-483c-8766-4b9226ae97d0 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:23.531797 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d41c07-87b4-483c-8766-4b9226ae97d0 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:23.532143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d41c07-87b4-483c-8766-4b9226ae97d0 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:23.533894 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 363/720] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:23.534836 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d41c07-87b4-483c-8766-4b9226ae97d0 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:23.544121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b00e83-f24b-4744-b2a8-0d3bf05098f2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:23.586467 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfe4d5-59ce-468a-b888-445168ae0077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:23.587539 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfe4d5-59ce-468a-b888-445168ae0077 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:23.588063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfe4d5-59ce-468a-b888-445168ae0077 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:23.588515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfe4d5-59ce-468a-b888-445168ae0077 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:23.589454 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfe4d5-59ce-468a-b888-445168ae0077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:23.590472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfe4d5-59ce-468a-b888-445168ae0077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:23.592480 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfe4d5-59ce-468a-b888-445168ae0077 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:23.607635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 358/721] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:23.609328 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a3fef-e772-4158-9ca6-8a8f22a160b2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:23.609772 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a3fef-e772-4158-9ca6-8a8f22a160b2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:23.610226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a3fef-e772-4158-9ca6-8a8f22a160b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:23.629306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b48a3fef-e772-4158-9ca6-8a8f22a160b2 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:23.630877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b48a3fef-e772-4158-9ca6-8a8f22a160b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:23.649049 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d41c07-87b4-483c-8766-4b9226ae97d0 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:23.685704 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285c10f-504d-4f29-a533-85f3ba05b9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:23.686647 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285c10f-504d-4f29-a533-85f3ba05b9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:23.686988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285c10f-504d-4f29-a533-85f3ba05b9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:23.687331 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285c10f-504d-4f29-a533-85f3ba05b9d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:23.699222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285c10f-504d-4f29-a533-85f3ba05b9d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:23.700940 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285c10f-504d-4f29-a533-85f3ba05b9d5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:23.707839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 359/722] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:48:23.709222 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a3fef-e772-4158-9ca6-8a8f22a160b2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:23.720579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-3285c10f-504d-4f29-a533-85f3ba05b9d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:23.720579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:23.720579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:23.720579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:23.720579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:23.720579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:23.720579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:23.720579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:23.720579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:23.720579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:23.720579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:23.720579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:23.720579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:23.720579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:23.720579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:23.721497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:23.721497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:23.721497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:23.721497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:23.721497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:23.721497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:23.721497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:23.721497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:23.721497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:23.721497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:23.721497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:23.721497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:23.721497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:23.721497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:23.721497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:23.721497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:23.721497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:23.722837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:23.722837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:23.722837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:23.722837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:23.722837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 364/723] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:23.727694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285c10f-504d-4f29-a533-85f3ba05b9d5 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:23.758638 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:23.780624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:23.827142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a3fef-e772-4158-9ca6-8a8f22a160b2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:23.837783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285c10f-504d-4f29-a533-85f3ba05b9d5 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:23.874572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd635e1a-22e4-4457-aee7-106d5e9db513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:23.875889 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd635e1a-22e4-4457-aee7-106d5e9db513 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:23.876369 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd635e1a-22e4-4457-aee7-106d5e9db513 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:23.876848 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd635e1a-22e4-4457-aee7-106d5e9db513 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:23.884955 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd635e1a-22e4-4457-aee7-106d5e9db513 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:23.887078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd635e1a-22e4-4457-aee7-106d5e9db513 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:23.887700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0221dc-6855-4f9a-9a19-d0824358900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:23.887814 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0221dc-6855-4f9a-9a19-d0824358900b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:23.888084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0221dc-6855-4f9a-9a19-d0824358900b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:23.888359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0221dc-6855-4f9a-9a19-d0824358900b None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:23.890870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0221dc-6855-4f9a-9a19-d0824358900b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:23.891205 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0221dc-6855-4f9a-9a19-d0824358900b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:23.896491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0221dc-6855-4f9a-9a19-d0824358900b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:23.904888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-bd635e1a-22e4-4457-aee7-106d5e9db513 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:23.904888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:23.904888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:23.904888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:23.904888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:23.904888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:23.904888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:23.904888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:23.904888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:23.904888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:23.904888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:23.904888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:23.904888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:23.904888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:23.904888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:23.905782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:23.905782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:23.905782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:23.905782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:23.905782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:23.905782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:23.905782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:23.905782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:23.905782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:23.905782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:23.905782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:23.905782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:23.905782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:23.905782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:23.905782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:23.905782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:23.905782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:23.906689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:23.906689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:23.906689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:23.906689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:23.906689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:23.906689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:23.906689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:23.906689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:23.909210 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 360/724] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:23.910354 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd635e1a-22e4-4457-aee7-106d5e9db513 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:23.931048 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 365/725] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:23.932070 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0221dc-6855-4f9a-9a19-d0824358900b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:24.033623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd635e1a-22e4-4457-aee7-106d5e9db513 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:24.039814 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:24.102758 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d599c8d-9c25-4187-9840-73c675a0502b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:24.103609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d599c8d-9c25-4187-9840-73c675a0502b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:24.103901 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d599c8d-9c25-4187-9840-73c675a0502b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:24.104172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d599c8d-9c25-4187-9840-73c675a0502b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:24.115391 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0221dc-6855-4f9a-9a19-d0824358900b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:24.116182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d599c8d-9c25-4187-9840-73c675a0502b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:24.124858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:24.128048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-2d599c8d-9c25-4187-9840-73c675a0502b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:48:24.128048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:24.128048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:24.128048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:24.128048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:24.128048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:24.128048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:24.128048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:24.128048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:24.128048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:24.128048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:24.128048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:24.128048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:24.128048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:24.128048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:24.128048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:24.131138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:24.131138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:24.131138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:24.131138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:24.131138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:24.131138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:24.131138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:24.131138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:24.131138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:24.131138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:24.131138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:24.131138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:24.131138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:24.131138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:24.131138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:24.131138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:24.132239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:24.132239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:24.132239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:24.132239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:24.132239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:24.132239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:24.132239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:24.132239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:24.132239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:24.132239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:24.132239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:48:24.132239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:24.132239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 361/726] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:48:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:24.133968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d599c8d-9c25-4187-9840-73c675a0502b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:24.172600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430295a-d75c-4d54-a4a7-edc8f60d0466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:24.173324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430295a-d75c-4d54-a4a7-edc8f60d0466 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:24.173548 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430295a-d75c-4d54-a4a7-edc8f60d0466 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:24.173827 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430295a-d75c-4d54-a4a7-edc8f60d0466 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:24.174625 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430295a-d75c-4d54-a4a7-edc8f60d0466 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:24.174929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430295a-d75c-4d54-a4a7-edc8f60d0466 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:24.181040 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430295a-d75c-4d54-a4a7-edc8f60d0466 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:24.208462 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 366/727] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:24.209186 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430295a-d75c-4d54-a4a7-edc8f60d0466 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:24.252704 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d599c8d-9c25-4187-9840-73c675a0502b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:24.289633 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59423bcf-313b-4b98-94b3-98b1e20b3d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:24.290903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59423bcf-313b-4b98-94b3-98b1e20b3d42 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:24.291183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59423bcf-313b-4b98-94b3-98b1e20b3d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:24.291452 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59423bcf-313b-4b98-94b3-98b1e20b3d42 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:24.300276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59423bcf-313b-4b98-94b3-98b1e20b3d42 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:24.301829 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59423bcf-313b-4b98-94b3-98b1e20b3d42 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:24.317151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-59423bcf-313b-4b98-94b3-98b1e20b3d42 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 18:48:24.317151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:24.317151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:24.317151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:24.317151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:24.317151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:24.317151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:24.317151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:24.317151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:24.317151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:24.317151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:24.317151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:24.317151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:24.317151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:24.317151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:24.317151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:24.318655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:24.318655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:24.318655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:24.318655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:24.318655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:24.318655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:24.318655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:24.318655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:24.318655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:24.318655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:24.318655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:24.318655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:24.318655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:24.318655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:24.318655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:24.318655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:24.318655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:24.318655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:24.319640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:24.319640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:24.319640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:24.319640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:24.319640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:24.319640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:24.319640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:24.319640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:24.319640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 18:48:24.319640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:24.319640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 362/728] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 2 18:48:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:24.319640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59423bcf-313b-4b98-94b3-98b1e20b3d42 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:24.348280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:24.372727 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430295a-d75c-4d54-a4a7-edc8f60d0466 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:24.416971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d07f0-45dc-4ab9-bbd2-be4a5e3f06ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:24.417651 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d07f0-45dc-4ab9-bbd2-be4a5e3f06ba None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:24.418851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d07f0-45dc-4ab9-bbd2-be4a5e3f06ba None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:24.419570 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d07f0-45dc-4ab9-bbd2-be4a5e3f06ba None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:24.420708 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d07f0-45dc-4ab9-bbd2-be4a5e3f06ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:24.421444 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d07f0-45dc-4ab9-bbd2-be4a5e3f06ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:24.423563 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d07f0-45dc-4ab9-bbd2-be4a5e3f06ba None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:24.442843 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 367/729] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:48:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:24.444973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f434bb-6204-44a0-b756-470b6bf78196 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:24.444973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f434bb-6204-44a0-b756-470b6bf78196 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:24.445264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f434bb-6204-44a0-b756-470b6bf78196 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:24.447379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 368/730] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:24.448081 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f434bb-6204-44a0-b756-470b6bf78196 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:24.459553 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59423bcf-313b-4b98-94b3-98b1e20b3d42 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:24.482858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:24.499237 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd75d0-407b-4a1b-bf01-2e63d014429d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:24.500149 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd75d0-407b-4a1b-bf01-2e63d014429d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:24.500654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd75d0-407b-4a1b-bf01-2e63d014429d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:24.500997 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd75d0-407b-4a1b-bf01-2e63d014429d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:24.501910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd75d0-407b-4a1b-bf01-2e63d014429d None admin] RBAC: Adding query filter params (role.id=8560bac1acf74dce81ea6a76f751b641, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=6b8ff9f5032e498db3c70c79cc11989b) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:24.502223 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd75d0-407b-4a1b-bf01-2e63d014429d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:24.503660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd75d0-407b-4a1b-bf01-2e63d014429d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:24.516464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 363/731] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:48:24 2022] GET /identity/v3/role_assignments?user.id=6b8ff9f5032e498db3c70c79cc11989b&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:24.516464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd75d0-407b-4a1b-bf01-2e63d014429d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:24.605988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f434bb-6204-44a0-b756-470b6bf78196 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:24.622562 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:24.642224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd75d0-407b-4a1b-bf01-2e63d014429d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:24.655752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455aba3-f16a-4a80-a99d-38bad0c0a0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:24.657151 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455aba3-f16a-4a80-a99d-38bad0c0a0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:24.657599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455aba3-f16a-4a80-a99d-38bad0c0a0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:24.658291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455aba3-f16a-4a80-a99d-38bad0c0a0d0 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:24.659296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455aba3-f16a-4a80-a99d-38bad0c0a0d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:24.660025 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455aba3-f16a-4a80-a99d-38bad0c0a0d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:24.662498 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455aba3-f16a-4a80-a99d-38bad0c0a0d0 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:24.684474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd105e-ef77-4de2-b22f-67a13619ea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:24.685460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd105e-ef77-4de2-b22f-67a13619ea07 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:24.685920 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd105e-ef77-4de2-b22f-67a13619ea07 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:24.686292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd105e-ef77-4de2-b22f-67a13619ea07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:24.692489 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 369/732] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Jun 2 18:48:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:24.692489 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843d5e8-93ed-4c65-8232-3bef7430210d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:24.692489 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843d5e8-93ed-4c65-8232-3bef7430210d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:24.692489 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843d5e8-93ed-4c65-8232-3bef7430210d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:24.704549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd105e-ef77-4de2-b22f-67a13619ea07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:24.706202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd105e-ef77-4de2-b22f-67a13619ea07 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:24.720081 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-8843d5e8-93ed-4c65-8232-3bef7430210d None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:24.721652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8843d5e8-93ed-4c65-8232-3bef7430210d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:24.727913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-95fd105e-ef77-4de2-b22f-67a13619ea07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:24.727913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:24.727913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:24.727913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:24.727913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:24.727913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:24.727913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:24.727913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:24.727913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:24.727913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:24.727913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:24.727913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:24.727913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:24.727913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:24.727913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:24.728884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:24.728884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:24.728884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:24.728884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:24.728884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:24.728884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:24.728884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:24.728884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:24.728884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:24.728884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:24.728884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:24.728884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:24.728884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:24.728884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:24.728884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:24.728884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:24.728884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:24.729776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:24.729776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:24.729776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:24.729776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:24.730029 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 364/733] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:24.730936 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd105e-ef77-4de2-b22f-67a13619ea07 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:24.814129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 370/734] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:48:24.815393 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843d5e8-93ed-4c65-8232-3bef7430210d None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:24.845786 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:24.866317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd105e-ef77-4de2-b22f-67a13619ea07 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:24.913054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c673a9-a8b4-4fe7-85a3-9194d9bc74ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:24.914023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c673a9-a8b4-4fe7-85a3-9194d9bc74ee None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:24.914326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c673a9-a8b4-4fe7-85a3-9194d9bc74ee None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:24.914609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c673a9-a8b4-4fe7-85a3-9194d9bc74ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:24.919618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:24.938772 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843d5e8-93ed-4c65-8232-3bef7430210d None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:24.976849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfc3d6-71c5-473d-af11-1b4372facbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:24.977915 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfc3d6-71c5-473d-af11-1b4372facbbe None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:24.978412 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfc3d6-71c5-473d-af11-1b4372facbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:24.978872 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfc3d6-71c5-473d-af11-1b4372facbbe None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:24.979790 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfc3d6-71c5-473d-af11-1b4372facbbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:24.980375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfc3d6-71c5-473d-af11-1b4372facbbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:24.982105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfc3d6-71c5-473d-af11-1b4372facbbe None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:24.994453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 371/735] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:24.995609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfc3d6-71c5-473d-af11-1b4372facbbe None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:25.005843 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c673a9-a8b4-4fe7-85a3-9194d9bc74ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:25.007329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c673a9-a8b4-4fe7-85a3-9194d9bc74ee None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:25.075480 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:25.108339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfc3d6-71c5-473d-af11-1b4372facbbe None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:25.132843 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 365/736] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:48:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 18:48:25.133862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c673a9-a8b4-4fe7-85a3-9194d9bc74ee None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:25.152056 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd022344-63b6-4055-a732-8dd1b1e88610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:25.152810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd022344-63b6-4055-a732-8dd1b1e88610 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:25.153320 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd022344-63b6-4055-a732-8dd1b1e88610 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:25.153607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd022344-63b6-4055-a732-8dd1b1e88610 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:25.154819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd022344-63b6-4055-a732-8dd1b1e88610 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:25.156451 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd022344-63b6-4055-a732-8dd1b1e88610 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:25.180121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:25.182205 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 372/737] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 2 18:48:24 2022] POST /identity/v3/services => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:48:25.183916 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd022344-63b6-4055-a732-8dd1b1e88610 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:25.266557 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c673a9-a8b4-4fe7-85a3-9194d9bc74ee None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:25.313755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95a28f-4c04-4eb5-9baf-810f4858c018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:25.314707 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95a28f-4c04-4eb5-9baf-810f4858c018 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:25.315030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95a28f-4c04-4eb5-9baf-810f4858c018 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:25.315364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95a28f-4c04-4eb5-9baf-810f4858c018 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:25.323482 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95a28f-4c04-4eb5-9baf-810f4858c018 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:25.326059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95a28f-4c04-4eb5-9baf-810f4858c018 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:25.333301 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd022344-63b6-4055-a732-8dd1b1e88610 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:25.358118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-7b95a28f-4c04-4eb5-9baf-810f4858c018 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 18:48:25.358118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:25.358118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:25.358118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:25.358118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:25.358118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:25.358118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:25.358118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:25.358118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:25.358118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:25.358118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:25.358118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:25.358118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:25.358118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:25.358118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:25.358118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:25.359290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:25.359290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:25.359290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:25.359290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:25.359290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:25.359290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:25.359290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:25.359290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:25.359290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:25.359290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:25.359290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:25.359290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:25.359290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:25.359290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:25.359290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:25.359290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:25.359290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:25.359290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:25.360271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:25.360271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:25.360271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:25.360271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:25.360271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:25.360271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:25.360271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:25.360271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:25.360271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 18:48:25.360271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:25.360271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 366/738] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:48:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:25.366800 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95a28f-4c04-4eb5-9baf-810f4858c018 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:25.415283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d830b75-2bf0-4519-9beb-8d47101a2c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:25.416139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d830b75-2bf0-4519-9beb-8d47101a2c10 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:25.416421 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d830b75-2bf0-4519-9beb-8d47101a2c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:25.416694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d830b75-2bf0-4519-9beb-8d47101a2c10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:25.425679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:25.441414 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d830b75-2bf0-4519-9beb-8d47101a2c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:25.442861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d830b75-2bf0-4519-9beb-8d47101a2c10 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:25.475551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-1d830b75-2bf0-4519-9beb-8d47101a2c10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:25.475551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:25.475551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:25.475551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:25.475551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:25.475551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:25.475551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:25.475551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:25.475551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:25.475551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:25.475551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:25.475551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:25.475551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:25.475551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:25.475551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:25.476696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:25.476696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:25.476696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:25.476696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:25.476696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:25.476696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:25.476696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:25.476696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:25.476696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:25.476696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:25.476696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:25.476696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:25.476696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:25.476696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:25.476696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:25.476696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:25.476696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:25.477778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:25.477778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:25.477778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:25.477778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:25.478417 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 373/739] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:25.483857 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d830b75-2bf0-4519-9beb-8d47101a2c10 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:25.533426 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:25.542619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95a28f-4c04-4eb5-9baf-810f4858c018 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:25.582853 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0bc3e-bc65-4835-b54f-0b470cd9f2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:25.583545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0bc3e-bc65-4835-b54f-0b470cd9f2fe None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:25.583824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0bc3e-bc65-4835-b54f-0b470cd9f2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:25.584099 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0bc3e-bc65-4835-b54f-0b470cd9f2fe None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:25.585043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0bc3e-bc65-4835-b54f-0b470cd9f2fe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:25.585355 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0bc3e-bc65-4835-b54f-0b470cd9f2fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:25.586981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0bc3e-bc65-4835-b54f-0b470cd9f2fe None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:25.607340 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 367/740] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Jun 2 18:48:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:25.609044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d830b75-2bf0-4519-9beb-8d47101a2c10 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:25.612856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0bc3e-bc65-4835-b54f-0b470cd9f2fe None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:25.645510 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dfcd8-326a-475d-a4e3-962ff001893d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:25.646300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dfcd8-326a-475d-a4e3-962ff001893d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:25.646645 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dfcd8-326a-475d-a4e3-962ff001893d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:25.646919 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dfcd8-326a-475d-a4e3-962ff001893d None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:25.647688 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dfcd8-326a-475d-a4e3-962ff001893d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:25.647991 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dfcd8-326a-475d-a4e3-962ff001893d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:25.649555 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dfcd8-326a-475d-a4e3-962ff001893d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:25.662837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 374/741] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:25.668494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dfcd8-326a-475d-a4e3-962ff001893d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:25.722596 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:25.728761 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0bc3e-bc65-4835-b54f-0b470cd9f2fe None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:25.766185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94052bd1-b011-4fe4-a21f-93703aaa9da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:25.766850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94052bd1-b011-4fe4-a21f-93703aaa9da5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:25.767130 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94052bd1-b011-4fe4-a21f-93703aaa9da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:25.767403 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94052bd1-b011-4fe4-a21f-93703aaa9da5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:25.778115 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dfcd8-326a-475d-a4e3-962ff001893d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:25.796928 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:25.814432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef20031-aa3a-4fef-8900-ed4391511fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:25.815237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef20031-aa3a-4fef-8900-ed4391511fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:25.815508 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef20031-aa3a-4fef-8900-ed4391511fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:25.815770 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef20031-aa3a-4fef-8900-ed4391511fe1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:25.822880 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef20031-aa3a-4fef-8900-ed4391511fe1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:25.824683 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef20031-aa3a-4fef-8900-ed4391511fe1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:25.839592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-5ef20031-aa3a-4fef-8900-ed4391511fe1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:25.839592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:25.839592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:25.839592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:25.839592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:25.839592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:25.839592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:25.839592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:25.839592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:25.839592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:25.839592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:25.839592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:25.839592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:25.839592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:25.839592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:25.841979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:25.841979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:25.841979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:25.841979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:25.841979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:25.841979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:25.841979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:25.841979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:25.841979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:25.841979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:25.841979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:25.841979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:25.841979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:25.841979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:25.841979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:25.841979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:25.841979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:25.844131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:25.844131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:25.844131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:25.844131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:25.844131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:25.844131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:25.844131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:25.844131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:25.844131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 375/742] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:25.846911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c33b6-9d85-423c-8523-4a2278de318c None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:25.847151 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c33b6-9d85-423c-8523-4a2278de318c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:25.847428 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c33b6-9d85-423c-8523-4a2278de318c None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:25.849063 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 376/743] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:25.850628 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c33b6-9d85-423c-8523-4a2278de318c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:25.861542 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94052bd1-b011-4fe4-a21f-93703aaa9da5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:25.863530 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94052bd1-b011-4fe4-a21f-93703aaa9da5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:25.969887 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c33b6-9d85-423c-8523-4a2278de318c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:25.975696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 368/744] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:48:25 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 18:48:25.977043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b4916-1546-41bc-98ad-f71592007494 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:25.977327 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b4916-1546-41bc-98ad-f71592007494 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:25.977599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b4916-1546-41bc-98ad-f71592007494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:25.990195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:25.995392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a79b4916-1546-41bc-98ad-f71592007494 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:25.997042 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a79b4916-1546-41bc-98ad-f71592007494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:26.009351 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3c101-ffa0-46a4-b4ee-936f22979e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:26.010375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3c101-ffa0-46a4-b4ee-936f22979e07 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:26.010908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3c101-ffa0-46a4-b4ee-936f22979e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:26.011819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3c101-ffa0-46a4-b4ee-936f22979e07 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:26.012855 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3c101-ffa0-46a4-b4ee-936f22979e07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:26.013357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3c101-ffa0-46a4-b4ee-936f22979e07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:26.015144 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3c101-ffa0-46a4-b4ee-936f22979e07 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:26.028994 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 377/745] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:26.030242 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3c101-ffa0-46a4-b4ee-936f22979e07 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:26.049541 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:26.075125 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 369/746] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:25 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 18:48:26.076088 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b4916-1546-41bc-98ad-f71592007494 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:26.139914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3c101-ffa0-46a4-b4ee-936f22979e07 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:26.175057 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b4916-1546-41bc-98ad-f71592007494 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:26.175402 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c65fe8-5e6e-408c-8b54-b45383dac09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:26.176416 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c65fe8-5e6e-408c-8b54-b45383dac09c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:26.176884 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c65fe8-5e6e-408c-8b54-b45383dac09c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:26.177342 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c65fe8-5e6e-408c-8b54-b45383dac09c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:26.188026 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c65fe8-5e6e-408c-8b54-b45383dac09c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:26.190191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c65fe8-5e6e-408c-8b54-b45383dac09c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:26.208339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-80c65fe8-5e6e-408c-8b54-b45383dac09c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:26.208339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:26.208339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:26.208339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:26.208339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:26.208339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:26.208339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:26.208339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:26.208339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:26.208339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:26.208339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:26.208339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:26.208339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:26.208339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:26.208339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:26.209238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:26.209238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:26.209238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:26.209238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:26.209238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:26.209238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:26.209238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:26.209238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:26.209238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:26.209238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:26.209238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:26.209238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:26.209238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:26.209238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:26.209238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:26.209238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:26.209238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:26.210155 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:26.210155 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:26.210155 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:26.210155 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:26.210844 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d5077-707f-4450-af8b-25be6a956207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:26.211505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d5077-707f-4450-af8b-25be6a956207 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:26.211781 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d5077-707f-4450-af8b-25be6a956207 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:26.212052 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d5077-707f-4450-af8b-25be6a956207 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:26.212920 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d5077-707f-4450-af8b-25be6a956207 None admin] RBAC: Adding query filter params (role.id=d3525fac5dcc418cbf1bc53ab83dbec6, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=23aa142375c54b94ad276d1a4b9031e0) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:26.213185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d5077-707f-4450-af8b-25be6a956207 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:26.213561 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 378/747] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:26.214594 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c65fe8-5e6e-408c-8b54-b45383dac09c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:26.214766 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d5077-707f-4450-af8b-25be6a956207 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:26.220869 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 370/748] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:48:26 2022] GET /identity/v3/role_assignments?user.id=23aa142375c54b94ad276d1a4b9031e0&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=d3525fac5dcc418cbf1bc53ab83dbec6 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:26.221668 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d5077-707f-4450-af8b-25be6a956207 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:26.242914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:26.313016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:26.344970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c65fe8-5e6e-408c-8b54-b45383dac09c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:26.373187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d5077-707f-4450-af8b-25be6a956207 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:26.410554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc34531-2792-4e67-907a-d0ceff5b74dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:26.411644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc34531-2792-4e67-907a-d0ceff5b74dd None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:26.412061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec895c36-b0ac-4b95-8f13-4b8bc1ea1640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:26.412335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc34531-2792-4e67-907a-d0ceff5b74dd None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:26.412731 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec895c36-b0ac-4b95-8f13-4b8bc1ea1640 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:26.413011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec895c36-b0ac-4b95-8f13-4b8bc1ea1640 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:26.413112 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc34531-2792-4e67-907a-d0ceff5b74dd None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:26.413281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec895c36-b0ac-4b95-8f13-4b8bc1ea1640 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:26.414038 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec895c36-b0ac-4b95-8f13-4b8bc1ea1640 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:26.414334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec895c36-b0ac-4b95-8f13-4b8bc1ea1640 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:26.414663 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc34531-2792-4e67-907a-d0ceff5b74dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:26.415715 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec895c36-b0ac-4b95-8f13-4b8bc1ea1640 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:26.416440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc34531-2792-4e67-907a-d0ceff5b74dd None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:26.428907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 371/749] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:26.434780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec895c36-b0ac-4b95-8f13-4b8bc1ea1640 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:26.449144 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 379/750] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 2 18:48:26 2022] POST /identity/v3/services => generated 240 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:48:26.555650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec895c36-b0ac-4b95-8f13-4b8bc1ea1640 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:26.558237 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:26.600759 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765edcb-426f-4a6e-acc3-2078695a6bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:26.601573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765edcb-426f-4a6e-acc3-2078695a6bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:26.601879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765edcb-426f-4a6e-acc3-2078695a6bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:26.602149 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765edcb-426f-4a6e-acc3-2078695a6bb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:26.610334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765edcb-426f-4a6e-acc3-2078695a6bb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:26.611821 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765edcb-426f-4a6e-acc3-2078695a6bb9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:26.627392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-2765edcb-426f-4a6e-acc3-2078695a6bb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:26.627392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:26.627392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:26.627392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:26.627392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:26.627392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:26.627392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:26.627392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:26.627392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:26.627392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:26.627392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:26.627392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:26.627392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:26.627392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:26.627392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:26.628371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:26.628371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:26.628371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:26.628371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:26.628371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:26.628371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:26.628371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:26.628371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:26.628371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:26.628371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:26.628371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:26.628371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:26.628371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:26.628371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:26.628371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:26.628371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:26.628371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:26.629767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:26.629767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:26.629767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:26.629767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:26.629767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:26.629767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:26.629767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:26.629767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:26.629767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 372/751] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:26.634651 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc34531-2792-4e67-907a-d0ceff5b74dd None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:26.765227 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:26.790369 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc34531-2792-4e67-907a-d0ceff5b74dd None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:26.833447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315f451-8382-4380-a9b0-9da730dd5869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:26.834429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315f451-8382-4380-a9b0-9da730dd5869 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:26.834846 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315f451-8382-4380-a9b0-9da730dd5869 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:26.835281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315f451-8382-4380-a9b0-9da730dd5869 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:26.836272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4315f451-8382-4380-a9b0-9da730dd5869 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:26.836715 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4315f451-8382-4380-a9b0-9da730dd5869 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:26.838363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4315f451-8382-4380-a9b0-9da730dd5869 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:26.854790 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 380/752] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:26.860710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765edcb-426f-4a6e-acc3-2078695a6bb9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:26.980381 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765edcb-426f-4a6e-acc3-2078695a6bb9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:27.016252 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc33c4-9f0d-4a6d-a6cd-3d429f040bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:27.016924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc33c4-9f0d-4a6d-a6cd-3d429f040bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:27.017205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc33c4-9f0d-4a6d-a6cd-3d429f040bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:27.017477 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc33c4-9f0d-4a6d-a6cd-3d429f040bd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:27.018380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc33c4-9f0d-4a6d-a6cd-3d429f040bd0 None admin] RBAC: Adding query filter params (role.id=8560bac1acf74dce81ea6a76f751b641, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=b4faac48f82244bebf039aab92898617) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:27.018691 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc33c4-9f0d-4a6d-a6cd-3d429f040bd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:27.020143 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc33c4-9f0d-4a6d-a6cd-3d429f040bd0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:27.030366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 373/753] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:48:26 2022] GET /identity/v3/role_assignments?user.id=b4faac48f82244bebf039aab92898617&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:27.276068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1d56c-c363-4d04-ad77-5950b1dde32c None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:27.276616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1d56c-c363-4d04-ad77-5950b1dde32c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:27.276616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1d56c-c363-4d04-ad77-5950b1dde32c None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:27.278591 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 381/754] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:27.284230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551574b7-8373-402b-b079-863bc187dbb8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:27.284565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551574b7-8373-402b-b079-863bc187dbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:27.284791 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551574b7-8373-402b-b079-863bc187dbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:27.308205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-551574b7-8373-402b-b079-863bc187dbb8 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:27.309475 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-551574b7-8373-402b-b079-863bc187dbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:27.330824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:27.399609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 374/755] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:27.443309 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1d56c-c363-4d04-ad77-5950b1dde32c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:27.590587 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1d56c-c363-4d04-ad77-5950b1dde32c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:27.631345 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d52fe9-fd14-4ae5-b629-a1f616b2437c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:27.632151 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d52fe9-fd14-4ae5-b629-a1f616b2437c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:27.632430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d52fe9-fd14-4ae5-b629-a1f616b2437c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:27.632703 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d52fe9-fd14-4ae5-b629-a1f616b2437c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:27.644778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:27.647928 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d52fe9-fd14-4ae5-b629-a1f616b2437c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:27.658673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-b0d52fe9-fd14-4ae5-b629-a1f616b2437c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:48:27.658673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:27.658673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:27.658673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:27.658673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:27.658673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:27.658673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:27.658673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:27.658673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:27.658673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:27.658673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:27.658673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:27.658673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:27.658673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:27.658673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:27.658673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:27.659640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:27.659640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:27.659640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:27.659640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:27.659640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:27.659640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:27.659640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:27.659640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:27.659640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:27.659640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:27.659640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:27.659640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:27.659640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:27.659640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:27.659640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:27.659640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:27.661047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:27.661047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:27.661047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:27.661047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:27.661047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:27.661047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:27.661047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:27.661047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:27.661047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:27.661047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:27.661047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:48:27.661047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:27.661047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 382/756] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:48:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:27.665828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551574b7-8373-402b-b079-863bc187dbb8 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:27.815411 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551574b7-8373-402b-b079-863bc187dbb8 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:27.868335 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645b70a-a230-47e0-9a60-d5aae5be531e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:27.869410 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645b70a-a230-47e0-9a60-d5aae5be531e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:27.869971 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645b70a-a230-47e0-9a60-d5aae5be531e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:27.870435 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645b70a-a230-47e0-9a60-d5aae5be531e None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:27.871405 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645b70a-a230-47e0-9a60-d5aae5be531e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:27.871895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645b70a-a230-47e0-9a60-d5aae5be531e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:27.873504 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645b70a-a230-47e0-9a60-d5aae5be531e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:27.885557 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 375/757] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:48:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:27.891031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d52fe9-fd14-4ae5-b629-a1f616b2437c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:28.040703 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d52fe9-fd14-4ae5-b629-a1f616b2437c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:28.057301 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9284a-6e0b-44a7-a506-72e5a5789093 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:28.058406 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9284a-6e0b-44a7-a506-72e5a5789093 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:28.058909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9284a-6e0b-44a7-a506-72e5a5789093 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:28.061541 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 376/758] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:28.065777 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fddf90-3e9b-4ef2-a839-e78b7fc5b4a5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:28.066125 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fddf90-3e9b-4ef2-a839-e78b7fc5b4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:28.066493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fddf90-3e9b-4ef2-a839-e78b7fc5b4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:28.076926 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683c644-7c44-47ab-ac8c-d06f05cba3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:28.077968 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683c644-7c44-47ab-ac8c-d06f05cba3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:28.078487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683c644-7c44-47ab-ac8c-d06f05cba3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:28.078900 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683c644-7c44-47ab-ac8c-d06f05cba3f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:28.097539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683c644-7c44-47ab-ac8c-d06f05cba3f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:28.099284 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683c644-7c44-47ab-ac8c-d06f05cba3f7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:28.105831 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f5fddf90-3e9b-4ef2-a839-e78b7fc5b4a5 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:28.111105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f5fddf90-3e9b-4ef2-a839-e78b7fc5b4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:28.123949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-a683c644-7c44-47ab-ac8c-d06f05cba3f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:28.123949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:28.123949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:28.123949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:28.123949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:28.123949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:28.123949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:28.123949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:28.123949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:28.123949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:28.123949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:28.123949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:28.123949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:28.123949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:28.123949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:28.125071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:28.125071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:28.125071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:28.125071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:28.125071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:28.125071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:28.125071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:28.125071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:28.125071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:28.125071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:28.125071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:28.125071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:28.125071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:28.125071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:28.125071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:28.125071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:28.125071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:28.126020 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:28.126020 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:28.126020 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:28.126020 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:28.128916 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 383/759] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:28.133945 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683c644-7c44-47ab-ac8c-d06f05cba3f7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:28.137449 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:28.228604 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:28.246400 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 377/760] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:28.280803 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fddf90-3e9b-4ef2-a839-e78b7fc5b4a5 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:28.301810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683c644-7c44-47ab-ac8c-d06f05cba3f7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:28.365521 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5f822-a6bb-4f6e-b11d-da78e34736df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:28.367137 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5f822-a6bb-4f6e-b11d-da78e34736df None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:28.367802 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5f822-a6bb-4f6e-b11d-da78e34736df None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:28.370389 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5f822-a6bb-4f6e-b11d-da78e34736df None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:28.371358 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5f822-a6bb-4f6e-b11d-da78e34736df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:28.372044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5f822-a6bb-4f6e-b11d-da78e34736df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:28.374424 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5f822-a6bb-4f6e-b11d-da78e34736df None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:28.399410 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 384/761] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:28.405682 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5f822-a6bb-4f6e-b11d-da78e34736df None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:28.463653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fddf90-3e9b-4ef2-a839-e78b7fc5b4a5 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:28.556572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5f822-a6bb-4f6e-b11d-da78e34736df None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:28.557185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197783d-e7a1-43b3-8d22-cee1aab84836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:28.558043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197783d-e7a1-43b3-8d22-cee1aab84836 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:28.558378 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197783d-e7a1-43b3-8d22-cee1aab84836 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:28.558651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197783d-e7a1-43b3-8d22-cee1aab84836 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:28.559305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197783d-e7a1-43b3-8d22-cee1aab84836 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:28.561231 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197783d-e7a1-43b3-8d22-cee1aab84836 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:28.574054 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:28.586965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-b197783d-e7a1-43b3-8d22-cee1aab84836 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 18:48:28.586965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:28.586965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:28.586965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:28.586965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:28.586965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:28.586965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:28.586965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:28.586965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 18:48:28.586965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:28.586965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:28.586965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:28.586965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:28.586965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:28.586965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:28.586965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:28.587979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:28.587979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:28.587979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:28.587979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:28.587979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:28.587979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:28.587979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:28.587979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:28.587979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:28.587979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:28.587979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:28.587979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:28.587979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:28.587979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:28.587979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:28.587979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:28.588836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:28.588836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:28.588836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:28.588836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:28.588836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:28.588836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:28.588836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:28.588836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:28.588836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:28.588836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:28.588836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:28.588836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:28.588836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:28.588836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 18:48:28.588836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:28.590544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 378/762] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Jun 2 18:48:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:28.595175 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197783d-e7a1-43b3-8d22-cee1aab84836 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:28.602479 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96538c-98e7-46c6-8f80-f1a40ab004d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:28.603638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96538c-98e7-46c6-8f80-f1a40ab004d2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:28.604127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96538c-98e7-46c6-8f80-f1a40ab004d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:28.604606 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96538c-98e7-46c6-8f80-f1a40ab004d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:28.612807 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96538c-98e7-46c6-8f80-f1a40ab004d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:28.614614 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96538c-98e7-46c6-8f80-f1a40ab004d2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:28.620184 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:28.634212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-0d96538c-98e7-46c6-8f80-f1a40ab004d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 18:48:28.634212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:28.634212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:28.634212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:28.634212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:28.634212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:28.634212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:28.634212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:28.634212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:28.634212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:28.634212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:28.634212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:28.634212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:28.634212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:28.634212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:28.634212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:28.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:28.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:28.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:28.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:28.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:28.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:28.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:28.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:28.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:28.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:28.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:28.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:28.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:28.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:28.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:28.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:28.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:28.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:28.636147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:28.636147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:28.636147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:28.636147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:28.636147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:28.636147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:28.636147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:28.636147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:28.636147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 18:48:28.636147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:28.639009 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 385/763] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jun 2 18:48:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:28.646950 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96538c-98e7-46c6-8f80-f1a40ab004d2 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:28.817952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197783d-e7a1-43b3-8d22-cee1aab84836 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:28.821511 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96538c-98e7-46c6-8f80-f1a40ab004d2 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:28.854257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddaacd-be38-4bfb-9169-23601c8607fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:28.854934 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddaacd-be38-4bfb-9169-23601c8607fb None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:28.855581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddaacd-be38-4bfb-9169-23601c8607fb None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:28.855910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddaacd-be38-4bfb-9169-23601c8607fb None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:28.856691 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddaacd-be38-4bfb-9169-23601c8607fb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:28.856998 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddaacd-be38-4bfb-9169-23601c8607fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:28.858565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddaacd-be38-4bfb-9169-23601c8607fb None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:28.863832 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 379/764] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Jun 2 18:48:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:28.871030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddaacd-be38-4bfb-9169-23601c8607fb None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:28.910297 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7ccdf-d9ef-4278-a13a-3002da408477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:28.910982 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7ccdf-d9ef-4278-a13a-3002da408477 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:28.911261 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7ccdf-d9ef-4278-a13a-3002da408477 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:28.911532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7ccdf-d9ef-4278-a13a-3002da408477 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:28.912376 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7ccdf-d9ef-4278-a13a-3002da408477 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:28.912685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7ccdf-d9ef-4278-a13a-3002da408477 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:28.914172 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7ccdf-d9ef-4278-a13a-3002da408477 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:28.952877 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 386/765] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jun 2 18:48:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:28.960320 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7ccdf-d9ef-4278-a13a-3002da408477 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:29.018193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:29.020182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:29.046947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddaacd-be38-4bfb-9169-23601c8607fb None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:29.081753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97633a-d960-456b-a5e3-8435ec8c6770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:29.082800 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97633a-d960-456b-a5e3-8435ec8c6770 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:29.083080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97633a-d960-456b-a5e3-8435ec8c6770 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:29.083357 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97633a-d960-456b-a5e3-8435ec8c6770 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:29.084069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97633a-d960-456b-a5e3-8435ec8c6770 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:29.084374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97633a-d960-456b-a5e3-8435ec8c6770 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:29.085771 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97633a-d960-456b-a5e3-8435ec8c6770 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:29.091334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 380/766] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Jun 2 18:48:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:29.096958 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97633a-d960-456b-a5e3-8435ec8c6770 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:29.157031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7ccdf-d9ef-4278-a13a-3002da408477 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:29.195849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb42f83-aab2-4bba-aa39-1c6d39c18736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:29.196655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb42f83-aab2-4bba-aa39-1c6d39c18736 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:29.196928 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb42f83-aab2-4bba-aa39-1c6d39c18736 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:29.197193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb42f83-aab2-4bba-aa39-1c6d39c18736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:29.210850 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb42f83-aab2-4bba-aa39-1c6d39c18736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:29.212924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb42f83-aab2-4bba-aa39-1c6d39c18736 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:29.230579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97633a-d960-456b-a5e3-8435ec8c6770 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:29.237068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-8fb42f83-aab2-4bba-aa39-1c6d39c18736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:29.237068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:29.237068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:29.237068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:29.237068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:29.237068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:29.237068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:29.237068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:29.237068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:29.237068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:29.237068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:29.237068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:29.237068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:29.237068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:29.237068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:29.237987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:29.237987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:29.237987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:29.237987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:29.237987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:29.237987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:29.237987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:29.237987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:29.237987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:29.237987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:29.237987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:29.237987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:29.237987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:29.237987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:29.237987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:29.237987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:29.237987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:29.238969 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:29.238969 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:29.238969 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:29.238969 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:29.239205 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 387/767] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:29.240922 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe58409-1d03-465d-ba33-a996af966041 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:29.241208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe58409-1d03-465d-ba33-a996af966041 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:29.241483 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe58409-1d03-465d-ba33-a996af966041 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:29.243072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 388/768] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:29.245304 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe58409-1d03-465d-ba33-a996af966041 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:29.276786 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9225cd4-d289-4577-bb9c-176efccce39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:29.277625 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9225cd4-d289-4577-bb9c-176efccce39e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:29.277937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9225cd4-d289-4577-bb9c-176efccce39e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:29.278212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9225cd4-d289-4577-bb9c-176efccce39e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:29.279016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9225cd4-d289-4577-bb9c-176efccce39e None admin] RBAC: Adding query filter params (interface=public, service_id=ace69d421ed24a49b01346a593e2aa75, region_id=RegionOne) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:29.279422 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9225cd4-d289-4577-bb9c-176efccce39e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:29.280930 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9225cd4-d289-4577-bb9c-176efccce39e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:29.294257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 381/769] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jun 2 18:48:29 2022] GET /identity/v3/endpoints?service_id=ace69d421ed24a49b01346a593e2aa75&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:29.295787 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01973612-54af-46cd-969e-ee7292a54eb7 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:29.296081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01973612-54af-46cd-969e-ee7292a54eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:29.296359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01973612-54af-46cd-969e-ee7292a54eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:29.301931 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:29.315063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-01973612-54af-46cd-969e-ee7292a54eb7 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:29.316437 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-01973612-54af-46cd-969e-ee7292a54eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:29.337041 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:29.359176 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe58409-1d03-465d-ba33-a996af966041 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:29.398091 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 382/770] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:29.398091 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01973612-54af-46cd-969e-ee7292a54eb7 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:29.404397 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a0204-c0e2-4d57-9187-209f7023bb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:29.405234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a0204-c0e2-4d57-9187-209f7023bb74 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:29.405882 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a0204-c0e2-4d57-9187-209f7023bb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:29.406183 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a0204-c0e2-4d57-9187-209f7023bb74 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:29.407239 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a0204-c0e2-4d57-9187-209f7023bb74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:29.407494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a0204-c0e2-4d57-9187-209f7023bb74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:29.409301 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a0204-c0e2-4d57-9187-209f7023bb74 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:29.424665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 389/771] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:29.426701 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69180bfe-33df-4437-872b-8cd0f824bde7 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:29.426701 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69180bfe-33df-4437-872b-8cd0f824bde7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:29.426701 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69180bfe-33df-4437-872b-8cd0f824bde7 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:29.431961 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 390/772] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:29.432756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69180bfe-33df-4437-872b-8cd0f824bde7 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:29.497930 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01973612-54af-46cd-969e-ee7292a54eb7 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:29.532087 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:29.538049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81889c16-2460-4ad1-9881-06c4df9e6834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:29.538896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81889c16-2460-4ad1-9881-06c4df9e6834 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:29.539176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81889c16-2460-4ad1-9881-06c4df9e6834 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:29.539451 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81889c16-2460-4ad1-9881-06c4df9e6834 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:29.540137 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81889c16-2460-4ad1-9881-06c4df9e6834 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:29.541525 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81889c16-2460-4ad1-9881-06c4df9e6834 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:29.558129 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 383/773] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jun 2 18:48:29 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:29.558455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69180bfe-33df-4437-872b-8cd0f824bde7 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:29.558542 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81889c16-2460-4ad1-9881-06c4df9e6834 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:29.593769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfb459-8cf9-42f8-8334-4ce85349d635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:29.594899 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfb459-8cf9-42f8-8334-4ce85349d635 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:29.595637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfb459-8cf9-42f8-8334-4ce85349d635 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:29.595920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfb459-8cf9-42f8-8334-4ce85349d635 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:29.611290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfb459-8cf9-42f8-8334-4ce85349d635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:29.621920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-a3bfb459-8cf9-42f8-8334-4ce85349d635 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:29.621920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:29.621920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:29.621920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:29.621920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:29.621920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:29.621920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:29.621920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:29.621920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:29.621920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:29.621920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:29.621920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:29.621920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:29.621920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:29.621920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:29.621920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:29.622931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:29.622931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:29.622931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:29.622931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:29.622931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:29.622931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:29.622931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:29.622931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:29.622931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:29.622931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:29.622931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:29.622931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:29.622931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:29.622931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:29.622931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:29.622931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:29.623746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:29.623746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:29.623746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:29.623746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:29.623746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:29.623746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:29.623746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:29.623746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:29.623746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:29.623746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:29.623746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:29.623746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:29.624367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 391/774] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:48:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:29.628758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd8176-0c9f-45a8-86e8-062f5101b1c6 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:29.628758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd8176-0c9f-45a8-86e8-062f5101b1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:29.628758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd8176-0c9f-45a8-86e8-062f5101b1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:29.634169 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:29.651335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-50dd8176-0c9f-45a8-86e8-062f5101b1c6 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:29.652917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-50dd8176-0c9f-45a8-86e8-062f5101b1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:29.691999 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81889c16-2460-4ad1-9881-06c4df9e6834 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:29.739080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2484b9-e222-4c64-a233-83726ca9eed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:29.739080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2484b9-e222-4c64-a233-83726ca9eed5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:29.739080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2484b9-e222-4c64-a233-83726ca9eed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:29.739080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2484b9-e222-4c64-a233-83726ca9eed5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:29.743608 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2484b9-e222-4c64-a233-83726ca9eed5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:29.745482 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2484b9-e222-4c64-a233-83726ca9eed5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:29.758927 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 392/775] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:29.759151 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd8176-0c9f-45a8-86e8-062f5101b1c6 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:29.761060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-7b2484b9-e222-4c64-a233-83726ca9eed5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:29.761060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:29.761060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:29.761060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:29.761060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:29.761060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:29.761060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:29.761060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:29.761060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:29.761060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:29.761060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:29.761060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:29.761060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:29.761060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:29.761060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:29.762142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:29.762142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:29.762142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:29.762142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:29.762142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:29.762142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:29.762142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:29.762142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:29.762142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:29.762142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:29.762142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:29.762142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:29.762142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:29.762142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:29.762142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:29.762142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:29.762142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:29.763044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:29.763044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:29.763044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:29.763044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:29.763044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:29.763044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:29.763044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:29.763044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:29.765742 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 384/776] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:29.769868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2484b9-e222-4c64-a233-83726ca9eed5 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:29.831186 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:29.875243 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd8176-0c9f-45a8-86e8-062f5101b1c6 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:29.876273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2484b9-e222-4c64-a233-83726ca9eed5 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:29.908217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:29.914615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cc268-d8be-4a38-b00f-fa2a67641a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:29.914925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a47c7f-1d8f-45ff-8865-cb89929085e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:29.915300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cc268-d8be-4a38-b00f-fa2a67641a1c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:29.915584 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cc268-d8be-4a38-b00f-fa2a67641a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:29.915679 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a47c7f-1d8f-45ff-8865-cb89929085e3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:29.915854 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a47c7f-1d8f-45ff-8865-cb89929085e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:29.915946 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cc268-d8be-4a38-b00f-fa2a67641a1c None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:29.916128 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a47c7f-1d8f-45ff-8865-cb89929085e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:29.916607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cc268-d8be-4a38-b00f-fa2a67641a1c None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:29.916912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a47c7f-1d8f-45ff-8865-cb89929085e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:29.917013 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cc268-d8be-4a38-b00f-fa2a67641a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:29.917219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a47c7f-1d8f-45ff-8865-cb89929085e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:29.918416 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cc268-d8be-4a38-b00f-fa2a67641a1c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:29.918727 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a47c7f-1d8f-45ff-8865-cb89929085e3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:29.931542 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 393/777] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:48:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:29.931542 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cc268-d8be-4a38-b00f-fa2a67641a1c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:29.935874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 385/778] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:29.937075 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24042f-3a4c-45ff-a8d1-cc42a27808d8 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:29.937360 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24042f-3a4c-45ff-a8d1-cc42a27808d8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:29.937630 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24042f-3a4c-45ff-a8d1-cc42a27808d8 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:29.941914 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 386/779] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:29.941914 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24042f-3a4c-45ff-a8d1-cc42a27808d8 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:30.040150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cc268-d8be-4a38-b00f-fa2a67641a1c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:30.050908 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24042f-3a4c-45ff-a8d1-cc42a27808d8 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:30.068115 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:30.078001 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ffdc1-d812-42f5-b087-cc1515cc918e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:30.078814 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ffdc1-d812-42f5-b087-cc1515cc918e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:30.079092 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ffdc1-d812-42f5-b087-cc1515cc918e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:30.079364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ffdc1-d812-42f5-b087-cc1515cc918e None admin] PATH_INFO: `/v3/services/network` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:30.080019 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ffdc1-d812-42f5-b087-cc1515cc918e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:30.081391 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ffdc1-d812-42f5-b087-cc1515cc918e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:30.088565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f1d5f-e743-465f-9f1f-03fb79067a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:30.089518 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f1d5f-e743-465f-9f1f-03fb79067a2d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:30.089901 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f1d5f-e743-465f-9f1f-03fb79067a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:30.090242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f1d5f-e743-465f-9f1f-03fb79067a2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:30.095572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-e06ffdc1-d812-42f5-b087-cc1515cc918e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 18:48:30.095572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:30.095572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:30.095572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:30.095572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:30.095572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:30.095572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:30.095572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:30.095572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 18:48:30.095572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:30.095572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:30.095572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:30.095572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:30.095572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:30.095572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:30.095572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:30.095572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:30.096621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:30.096621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:30.096621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:30.096621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:30.096621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:30.096621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:30.096621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:30.096621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:30.096621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:30.096621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:30.096621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:30.096621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:30.096621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:30.096621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:30.096621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:30.096621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:30.099102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:30.099102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:30.099102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:30.099102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:30.099102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:30.099102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:30.099102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:30.099102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:30.099102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:30.099102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:30.099102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:30.099102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:30.099102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 18:48:30.099102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:30.101740 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 394/780] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:29 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:30.102325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f1d5f-e743-465f-9f1f-03fb79067a2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:30.102634 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ffdc1-d812-42f5-b087-cc1515cc918e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:30.103798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f1d5f-e743-465f-9f1f-03fb79067a2d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:30.124279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-8c9f1d5f-e743-465f-9f1f-03fb79067a2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:30.124279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:30.124279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:30.124279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:30.124279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:30.124279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:30.124279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:30.124279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:30.124279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:30.124279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:30.124279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:30.124279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:30.124279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:30.124279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:30.124279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:30.125212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:30.125212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:30.125212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:30.125212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:30.125212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:30.125212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:30.125212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:30.125212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:30.125212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:30.125212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:30.125212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:30.125212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:30.125212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:30.125212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:30.125212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:30.125212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:30.125212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:30.126157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:30.126157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:30.126157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:30.126157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:30.126157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 387/781] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:30.126898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb4d68-1d3c-4721-866b-50861712e32d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:30.126994 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb4d68-1d3c-4721-866b-50861712e32d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:30.127266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb4d68-1d3c-4721-866b-50861712e32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:30.143794 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-34cb4d68-1d3c-4721-866b-50861712e32d None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:30.144958 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-34cb4d68-1d3c-4721-866b-50861712e32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:30.172510 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:30.220042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ffdc1-d812-42f5-b087-cc1515cc918e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:30.229946 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 388/782] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:30.231765 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb4d68-1d3c-4721-866b-50861712e32d None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:30.256189 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9007d3e-aa22-4956-9197-8f8ea830e2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:30.257090 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9007d3e-aa22-4956-9197-8f8ea830e2ac None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:30.257365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9007d3e-aa22-4956-9197-8f8ea830e2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:30.257642 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9007d3e-aa22-4956-9197-8f8ea830e2ac None admin] PATH_INFO: `/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/6b8ff9f5032e498db3c70c79cc11989b/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:30.259762 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9007d3e-aa22-4956-9197-8f8ea830e2ac None admin] RBAC: Authorizing `identity:create_grant(project_id=3a3d8f5b51ff4201b3968c9173ae06a7, user_id=6b8ff9f5032e498db3c70c79cc11989b, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:30.261212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9007d3e-aa22-4956-9197-8f8ea830e2ac None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:30.275181 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 395/783] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:48:30 2022] PUT /identity/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/6b8ff9f5032e498db3c70c79cc11989b/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:48:30.276302 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9007d3e-aa22-4956-9197-8f8ea830e2ac None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:30.371342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:30.377124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb4d68-1d3c-4721-866b-50861712e32d None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:30.414441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9007d3e-aa22-4956-9197-8f8ea830e2ac None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:30.437887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcf7b9-02ba-42f4-bd5e-8d85a7dd4db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:30.439735 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcf7b9-02ba-42f4-bd5e-8d85a7dd4db5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:30.440228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcf7b9-02ba-42f4-bd5e-8d85a7dd4db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:30.440933 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcf7b9-02ba-42f4-bd5e-8d85a7dd4db5 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:30.442723 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcf7b9-02ba-42f4-bd5e-8d85a7dd4db5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:30.444101 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:30.445092 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcf7b9-02ba-42f4-bd5e-8d85a7dd4db5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:30.447909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcf7b9-02ba-42f4-bd5e-8d85a7dd4db5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:30.457866 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 389/784] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 2 18:48:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:30.460291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcf7b9-02ba-42f4-bd5e-8d85a7dd4db5 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:30.467554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70594ba-f18e-48df-938c-e61b7273f0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:30.468369 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70594ba-f18e-48df-938c-e61b7273f0be None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:30.468711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70594ba-f18e-48df-938c-e61b7273f0be None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:30.469044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70594ba-f18e-48df-938c-e61b7273f0be None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:30.469878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70594ba-f18e-48df-938c-e61b7273f0be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:30.470250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70594ba-f18e-48df-938c-e61b7273f0be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:30.471706 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70594ba-f18e-48df-938c-e61b7273f0be None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:30.488555 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 396/785] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:30.489545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70594ba-f18e-48df-938c-e61b7273f0be None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:30.598792 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcf7b9-02ba-42f4-bd5e-8d85a7dd4db5 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:30.627707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70594ba-f18e-48df-938c-e61b7273f0be None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:30.646735 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c3def-fab5-4e26-b0cd-8235146fc8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:30.648381 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c3def-fab5-4e26-b0cd-8235146fc8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:30.648839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c3def-fab5-4e26-b0cd-8235146fc8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:30.649283 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c3def-fab5-4e26-b0cd-8235146fc8f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:30.664294 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c3def-fab5-4e26-b0cd-8235146fc8f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:30.666131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad49214-5979-423f-b7bf-e03c1f01eb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:30.666917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad49214-5979-423f-b7bf-e03c1f01eb6e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:30.667278 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad49214-5979-423f-b7bf-e03c1f01eb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:30.667832 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad49214-5979-423f-b7bf-e03c1f01eb6e None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:30.668709 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad49214-5979-423f-b7bf-e03c1f01eb6e None admin] RBAC: Adding query filter params (type=network) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:30.669075 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad49214-5979-423f-b7bf-e03c1f01eb6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:30.670555 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad49214-5979-423f-b7bf-e03c1f01eb6e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:30.675320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-c44c3def-fab5-4e26-b0cd-8235146fc8f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:48:30.675320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:30.675320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:30.675320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:30.675320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:30.675320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:30.675320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:30.675320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:30.675320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:30.675320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:30.675320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:30.675320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:30.675320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:30.675320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:30.675320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:30.675320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:30.676281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:30.676281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:30.676281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:30.676281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:30.676281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:30.676281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:30.676281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:30.676281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:30.676281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:30.676281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:30.676281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:30.676281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:30.676281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:30.676281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:30.676281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:30.676281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:30.677098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:30.677098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:30.677098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:30.677098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:30.677098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:30.677098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:30.677098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:30.677098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:30.677098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:30.677098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:30.677098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:48:30.677098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:30.677728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 397/786] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 2 18:48:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:30.679751 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 390/787] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:48:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:30.682046 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad49214-5979-423f-b7bf-e03c1f01eb6e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:30.683553 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c3def-fab5-4e26-b0cd-8235146fc8f2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:30.720875 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:30.734045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:30.801617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad49214-5979-423f-b7bf-e03c1f01eb6e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:30.836828 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a4688-3351-4f98-9bc6-886e7c6209d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:30.837759 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a4688-3351-4f98-9bc6-886e7c6209d7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:30.838082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a4688-3351-4f98-9bc6-886e7c6209d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:30.838356 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a4688-3351-4f98-9bc6-886e7c6209d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:30.840771 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c3def-fab5-4e26-b0cd-8235146fc8f2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:30.846969 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a4688-3351-4f98-9bc6-886e7c6209d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:30.848437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a4688-3351-4f98-9bc6-886e7c6209d7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:30.864190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-123a4688-3351-4f98-9bc6-886e7c6209d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 18:48:30.864190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:30.864190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:30.864190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:30.864190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:30.864190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:30.864190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:30.864190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:30.864190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:30.864190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:30.864190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:30.864190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:30.864190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:30.864190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:30.864190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:30.864190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:30.865168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:30.865168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:30.865168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:30.865168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:30.865168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:30.865168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:30.865168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:30.865168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:30.865168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:30.865168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:30.865168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:30.865168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:30.865168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:30.865168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:30.865168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:30.865168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:30.865168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:30.865168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:30.866143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:30.866143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:30.866143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:30.866143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:30.866143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:30.866143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:30.866143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:30.866143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:30.866143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 18:48:30.866143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:30.870103 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 398/788] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 2 18:48:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:30.871085 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a4688-3351-4f98-9bc6-886e7c6209d7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:30.879747 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d51b5-98b5-420d-912b-f206b60c3536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:30.880421 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d51b5-98b5-420d-912b-f206b60c3536 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:30.880701 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d51b5-98b5-420d-912b-f206b60c3536 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:30.881567 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d51b5-98b5-420d-912b-f206b60c3536 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:30.882420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d51b5-98b5-420d-912b-f206b60c3536 None admin] RBAC: Adding query filter params (interface=public, service_id=f4785e52ee1d4ac89b7626c319203847, region_id=RegionOne) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:30.882730 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d51b5-98b5-420d-912b-f206b60c3536 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:30.884577 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d51b5-98b5-420d-912b-f206b60c3536 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:30.894081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 391/789] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jun 2 18:48:30 2022] GET /identity/v3/endpoints?service_id=f4785e52ee1d4ac89b7626c319203847&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:30.895205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d51b5-98b5-420d-912b-f206b60c3536 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:30.993882 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a4688-3351-4f98-9bc6-886e7c6209d7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:30.994296 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:30.996599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:31.014592 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d51b5-98b5-420d-912b-f206b60c3536 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:31.044414 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047b97b-0d12-4e5a-b4f6-de924c686054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:31.045317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047b97b-0d12-4e5a-b4f6-de924c686054 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:31.045741 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047b97b-0d12-4e5a-b4f6-de924c686054 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:31.046224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047b97b-0d12-4e5a-b4f6-de924c686054 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:31.047924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047b97b-0d12-4e5a-b4f6-de924c686054 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:31.048702 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047b97b-0d12-4e5a-b4f6-de924c686054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:31.050911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047b97b-0d12-4e5a-b4f6-de924c686054 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:31.052930 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294df5b-f130-40a5-80bd-4df9776ffda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:31.053938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294df5b-f130-40a5-80bd-4df9776ffda7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:31.054416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294df5b-f130-40a5-80bd-4df9776ffda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:31.054868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294df5b-f130-40a5-80bd-4df9776ffda7 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:31.055887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294df5b-f130-40a5-80bd-4df9776ffda7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:31.056494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294df5b-f130-40a5-80bd-4df9776ffda7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:31.058290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294df5b-f130-40a5-80bd-4df9776ffda7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:31.061458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 399/790] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:48:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:31.063299 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047b97b-0d12-4e5a-b4f6-de924c686054 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:31.084658 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 392/791] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Jun 2 18:48:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:31.086094 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294df5b-f130-40a5-80bd-4df9776ffda7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:31.191299 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047b97b-0d12-4e5a-b4f6-de924c686054 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:31.204315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294df5b-f130-40a5-80bd-4df9776ffda7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:31.234254 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a394b1-f510-497b-950a-359fa32f7550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:31.235302 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a394b1-f510-497b-950a-359fa32f7550 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:31.235832 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a394b1-f510-497b-950a-359fa32f7550 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:31.236396 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a394b1-f510-497b-950a-359fa32f7550 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:31.237298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a394b1-f510-497b-950a-359fa32f7550 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:31.238915 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a394b1-f510-497b-950a-359fa32f7550 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:31.241317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec2920-4a24-4187-87d6-037a5c3e1da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:31.242179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec2920-4a24-4187-87d6-037a5c3e1da1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:31.242549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec2920-4a24-4187-87d6-037a5c3e1da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:31.242742 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec2920-4a24-4187-87d6-037a5c3e1da1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:31.246277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 400/792] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jun 2 18:48:31 2022] GET /identity/v3/services => generated 772 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:31.247538 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a394b1-f510-497b-950a-359fa32f7550 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:31.254743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec2920-4a24-4187-87d6-037a5c3e1da1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:31.256236 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec2920-4a24-4187-87d6-037a5c3e1da1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:31.259436 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:31.282210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:31.295895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-23ec2920-4a24-4187-87d6-037a5c3e1da1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:31.295895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:31.295895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:31.295895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:31.295895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:31.295895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:31.295895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:31.295895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:31.295895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:31.295895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:31.295895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:31.295895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:31.295895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:31.295895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:31.295895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:31.296881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:31.296881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:31.296881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:31.296881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:31.296881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:31.296881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:31.296881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:31.296881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:31.296881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:31.296881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:31.296881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:31.296881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:31.296881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:31.296881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:31.296881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:31.296881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:31.296881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:31.298462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:31.298462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:31.298462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:31.298462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:31.298462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 393/793] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:31.303051 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec2920-4a24-4187-87d6-037a5c3e1da1 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:31.369317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a394b1-f510-497b-950a-359fa32f7550 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:31.408383 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75619c78-ee6f-4e75-b92b-7ccc30e86a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:31.409867 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75619c78-ee6f-4e75-b92b-7ccc30e86a36 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:31.410410 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75619c78-ee6f-4e75-b92b-7ccc30e86a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:31.410936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75619c78-ee6f-4e75-b92b-7ccc30e86a36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:31.424744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75619c78-ee6f-4e75-b92b-7ccc30e86a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:31.427201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75619c78-ee6f-4e75-b92b-7ccc30e86a36 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:31.446841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-75619c78-ee6f-4e75-b92b-7ccc30e86a36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:31.446841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:31.446841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:31.446841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:31.446841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:31.446841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:31.446841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:31.446841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:31.446841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:31.446841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:31.446841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:31.446841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:31.446841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:31.446841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:31.446841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:31.447800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:31.447800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:31.447800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:31.447800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:31.447800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:31.447800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:31.447800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:31.447800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:31.447800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:31.447800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:31.447800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:31.447800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:31.447800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:31.447800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:31.447800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:31.447800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:31.447800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:31.448681 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:31.448681 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:31.448681 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:31.448681 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:31.455336 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 401/794] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:31.458058 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75619c78-ee6f-4e75-b92b-7ccc30e86a36 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:31.476036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec2920-4a24-4187-87d6-037a5c3e1da1 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:31.517284 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095ba4d-45ae-4d5d-8936-cfd69029404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:31.518013 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095ba4d-45ae-4d5d-8936-cfd69029404a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:31.518292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095ba4d-45ae-4d5d-8936-cfd69029404a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:31.518564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095ba4d-45ae-4d5d-8936-cfd69029404a None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:31.519473 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095ba4d-45ae-4d5d-8936-cfd69029404a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:31.519703 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095ba4d-45ae-4d5d-8936-cfd69029404a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:31.521270 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095ba4d-45ae-4d5d-8936-cfd69029404a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:31.546046 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 394/795] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:31.551635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095ba4d-45ae-4d5d-8936-cfd69029404a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:31.559796 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:31.604047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75619c78-ee6f-4e75-b92b-7ccc30e86a36 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:31.620682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:31.664458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b151bad-a1ab-47e4-95c5-1d0c2da01f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:31.665552 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b151bad-a1ab-47e4-95c5-1d0c2da01f46 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:31.666136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b151bad-a1ab-47e4-95c5-1d0c2da01f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:31.666614 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b151bad-a1ab-47e4-95c5-1d0c2da01f46 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:31.667742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b151bad-a1ab-47e4-95c5-1d0c2da01f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:31.668254 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b151bad-a1ab-47e4-95c5-1d0c2da01f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:31.669948 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b151bad-a1ab-47e4-95c5-1d0c2da01f46 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:31.688664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 402/796] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:31.690822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b151bad-a1ab-47e4-95c5-1d0c2da01f46 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:31.697460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095ba4d-45ae-4d5d-8936-cfd69029404a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:31.746832 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06fb18-1996-4266-9ef0-dc85a3aec469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:31.748011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06fb18-1996-4266-9ef0-dc85a3aec469 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:31.748296 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06fb18-1996-4266-9ef0-dc85a3aec469 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:31.748572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06fb18-1996-4266-9ef0-dc85a3aec469 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:31.758929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06fb18-1996-4266-9ef0-dc85a3aec469 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:31.761039 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06fb18-1996-4266-9ef0-dc85a3aec469 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:31.779943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-cb06fb18-1996-4266-9ef0-dc85a3aec469 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 18:48:31.779943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:31.779943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:31.779943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:31.779943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:31.779943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:31.779943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:31.779943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:31.779943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:31.779943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:31.779943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:31.779943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:31.779943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:31.779943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:31.779943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:31.779943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:31.780927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:31.780927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:31.780927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:31.780927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:31.780927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:31.780927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:31.780927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:31.780927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:31.780927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:31.780927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:31.780927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:31.780927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:31.780927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:31.780927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:31.780927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:31.780927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:31.780927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:31.780927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:31.781862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:31.781862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:31.781862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:31.781862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:31.781862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:31.781862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:31.781862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:31.781862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:31.781862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 18:48:31.781862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:31.781862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 395/797] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:48:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:31.787300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06fb18-1996-4266-9ef0-dc85a3aec469 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:31.848219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b151bad-a1ab-47e4-95c5-1d0c2da01f46 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:31.883908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9f244-fbf3-4636-b908-a4a237e705c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:31.885101 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9f244-fbf3-4636-b908-a4a237e705c3 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:31.885573 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9f244-fbf3-4636-b908-a4a237e705c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:31.886092 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9f244-fbf3-4636-b908-a4a237e705c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:31.893399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9f244-fbf3-4636-b908-a4a237e705c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:31.895142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9f244-fbf3-4636-b908-a4a237e705c3 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:31.897902 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:31.909765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-f4f9f244-fbf3-4636-b908-a4a237e705c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:31.909765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:31.909765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:31.909765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:31.909765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:31.909765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:31.909765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:31.909765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:31.909765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:31.909765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:31.909765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:31.909765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:31.909765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:31.909765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:31.909765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:31.910862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:31.910862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:31.910862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:31.910862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:31.910862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:31.910862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:31.910862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:31.910862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:31.910862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:31.910862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:31.910862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:31.910862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:31.910862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:31.910862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:31.910862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:31.910862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:31.910862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:31.911811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:31.911811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:31.911811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:31.911811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:31.911811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:31.911811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:31.911811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:31.911811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:31.914261 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 403/798] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:31.919123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06fb18-1996-4266-9ef0-dc85a3aec469 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:31.923616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9f244-fbf3-4636-b908-a4a237e705c3 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:31.937212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:31.966059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69874a-a296-4d01-b359-a74a5315dcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:31.967755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69874a-a296-4d01-b359-a74a5315dcb7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:31.968244 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69874a-a296-4d01-b359-a74a5315dcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:31.968787 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69874a-a296-4d01-b359-a74a5315dcb7 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:31.969854 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69874a-a296-4d01-b359-a74a5315dcb7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:31.970415 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69874a-a296-4d01-b359-a74a5315dcb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:31.972180 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69874a-a296-4d01-b359-a74a5315dcb7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:31.993074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 396/799] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Jun 2 18:48:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:31.995037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8c1c9-b229-47ac-8476-9718711e0f93 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:31.995748 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8c1c9-b229-47ac-8476-9718711e0f93 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:31.996627 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8c1c9-b229-47ac-8476-9718711e0f93 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:31.998496 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 397/800] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:31.999541 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8c1c9-b229-47ac-8476-9718711e0f93 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:32.067066 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9f244-fbf3-4636-b908-a4a237e705c3 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:32.110646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d530c-18e3-4426-971f-8f09220cad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:32.111818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d530c-18e3-4426-971f-8f09220cad7a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:32.112267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d530c-18e3-4426-971f-8f09220cad7a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:32.112689 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d530c-18e3-4426-971f-8f09220cad7a None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:32.113654 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d530c-18e3-4426-971f-8f09220cad7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:32.114546 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d530c-18e3-4426-971f-8f09220cad7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:32.116444 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d530c-18e3-4426-971f-8f09220cad7a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:32.131105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8c1c9-b229-47ac-8476-9718711e0f93 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:32.141277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 404/801] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:32.141277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57550ce-e656-41a4-9dfa-574b4b191d2b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:32.141277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57550ce-e656-41a4-9dfa-574b4b191d2b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:32.141277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57550ce-e656-41a4-9dfa-574b4b191d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:32.159693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b57550ce-e656-41a4-9dfa-574b4b191d2b None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:32.161126 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b57550ce-e656-41a4-9dfa-574b4b191d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:32.188425 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669113f0-a027-4030-bd8c-fce2c2baa48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:32.190219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669113f0-a027-4030-bd8c-fce2c2baa48e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:32.191001 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669113f0-a027-4030-bd8c-fce2c2baa48e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:32.191496 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669113f0-a027-4030-bd8c-fce2c2baa48e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:32.213671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669113f0-a027-4030-bd8c-fce2c2baa48e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:32.216258 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669113f0-a027-4030-bd8c-fce2c2baa48e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:32.240228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:32.241622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-669113f0-a027-4030-bd8c-fce2c2baa48e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:32.241622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:32.241622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:32.241622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:32.241622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:32.241622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:32.241622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:32.241622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:32.241622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:32.241622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:32.241622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:32.241622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:32.241622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:32.241622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:32.241622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:32.242988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:32.242988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:32.242988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:32.242988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:32.242988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:32.242988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:32.242988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:32.242988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:32.242988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:32.242988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:32.242988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:32.242988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:32.242988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:32.242988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:32.242988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:32.242988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:32.242988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:32.244221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:32.244221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:32.244221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:32.244221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:32.246688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 398/802] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:32.247859 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669113f0-a027-4030-bd8c-fce2c2baa48e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:32.265895 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 405/803] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:32.265895 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57550ce-e656-41a4-9dfa-574b4b191d2b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:32.302900 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:32.383514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669113f0-a027-4030-bd8c-fce2c2baa48e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:32.385992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57550ce-e656-41a4-9dfa-574b4b191d2b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:32.426080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb18a8-982e-41a5-98e0-709e7a649c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:32.427431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb18a8-982e-41a5-98e0-709e7a649c50 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:32.427934 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb18a8-982e-41a5-98e0-709e7a649c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:32.428412 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb18a8-982e-41a5-98e0-709e7a649c50 None admin] PATH_INFO: `/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/23aa142375c54b94ad276d1a4b9031e0/roles/d3525fac5dcc418cbf1bc53ab83dbec6` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:32.432280 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e431cb-d263-45ba-af07-4f521f116269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:32.432975 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e431cb-d263-45ba-af07-4f521f116269 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:32.433366 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e431cb-d263-45ba-af07-4f521f116269 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:32.435087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e431cb-d263-45ba-af07-4f521f116269 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:32.435900 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e431cb-d263-45ba-af07-4f521f116269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:32.436216 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e431cb-d263-45ba-af07-4f521f116269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:32.437655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e431cb-d263-45ba-af07-4f521f116269 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:32.449108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb18a8-982e-41a5-98e0-709e7a649c50 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a3d8f5b51ff4201b3968c9173ae06a7, user_id=23aa142375c54b94ad276d1a4b9031e0, role_id=d3525fac5dcc418cbf1bc53ab83dbec6)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:32.451275 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb18a8-982e-41a5-98e0-709e7a649c50 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:32.454491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 406/804] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:32.455432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e431cb-d263-45ba-af07-4f521f116269 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:32.478141 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 399/805] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:48:32 2022] PUT /identity/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/23aa142375c54b94ad276d1a4b9031e0/roles/d3525fac5dcc418cbf1bc53ab83dbec6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:48:32.480064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb18a8-982e-41a5-98e0-709e7a649c50 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:32.515514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:32.577374 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e431cb-d263-45ba-af07-4f521f116269 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:32.615304 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a65acd-4873-4258-9f55-3f56ede705c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:32.616241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a65acd-4873-4258-9f55-3f56ede705c2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:32.616524 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a65acd-4873-4258-9f55-3f56ede705c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:32.616797 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a65acd-4873-4258-9f55-3f56ede705c2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:32.617463 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a65acd-4873-4258-9f55-3f56ede705c2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:32.618903 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a65acd-4873-4258-9f55-3f56ede705c2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:32.633094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-90a65acd-4873-4258-9f55-3f56ede705c2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 18:48:32.633094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:32.633094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:32.633094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:32.633094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:32.633094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:32.633094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:32.633094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:32.633094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 18:48:32.633094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:32.633094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:32.633094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:32.633094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:32.633094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:32.633094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:32.633094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:32.634187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:32.634187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:32.634187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:32.634187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:32.634187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:32.634187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:32.634187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:32.634187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:32.634187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:32.634187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:32.634187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:32.634187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:32.634187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:32.634187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:32.634187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:32.634187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:32.635379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:32.635379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:32.635379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:32.635379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:32.635379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:32.635379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:32.635379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:32.635379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:32.635379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:32.635379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:32.635379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:32.635379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:32.635379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:32.635379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 18:48:32.635379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:32.635379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 407/806] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Jun 2 18:48:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:32.643638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a65acd-4873-4258-9f55-3f56ede705c2 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:32.663824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:32.716521 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb18a8-982e-41a5-98e0-709e7a649c50 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:32.779725 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cc665-25e1-4e80-a95f-7937f9b35f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:32.780467 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cc665-25e1-4e80-a95f-7937f9b35f03 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:32.780746 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cc665-25e1-4e80-a95f-7937f9b35f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:32.781021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cc665-25e1-4e80-a95f-7937f9b35f03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:32.799799 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cc665-25e1-4e80-a95f-7937f9b35f03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:32.801278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cc665-25e1-4e80-a95f-7937f9b35f03 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:32.820529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-274cc665-25e1-4e80-a95f-7937f9b35f03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:32.820529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:32.820529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:32.820529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:32.820529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:32.820529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:32.820529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:32.820529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:32.820529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:32.820529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:32.820529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:32.820529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:32.820529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:32.820529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:32.820529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:32.821474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:32.821474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:32.821474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:32.821474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:32.821474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:32.821474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:32.821474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:32.821474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:32.821474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:32.821474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:32.821474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:32.821474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:32.821474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:32.821474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:32.821474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:32.821474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:32.821474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:32.822395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:32.822395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:32.822395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:32.822395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:32.822395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:32.822395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:32.822395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:32.822395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:32.822395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 400/807] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:32.830021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde9eaf-1373-48d5-bee3-b296d4ae5890 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:32.830291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde9eaf-1373-48d5-bee3-b296d4ae5890 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:32.830491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde9eaf-1373-48d5-bee3-b296d4ae5890 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:32.832138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 401/808] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:32.833149 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde9eaf-1373-48d5-bee3-b296d4ae5890 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:32.836936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a65acd-4873-4258-9f55-3f56ede705c2 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:32.854777 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:32.888144 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a3f1d-32e6-465c-a217-81b84ace35ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:32.888940 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a3f1d-32e6-465c-a217-81b84ace35ab None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:32.889217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a3f1d-32e6-465c-a217-81b84ace35ab None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:32.889488 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a3f1d-32e6-465c-a217-81b84ace35ab None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:32.890357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a3f1d-32e6-465c-a217-81b84ace35ab None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:32.890662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a3f1d-32e6-465c-a217-81b84ace35ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:32.892040 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a3f1d-32e6-465c-a217-81b84ace35ab None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:32.897766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 408/809] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Jun 2 18:48:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:32.899117 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877b3c9-8fdd-442c-b979-e60981f269f9 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:32.899402 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877b3c9-8fdd-442c-b979-e60981f269f9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:32.899673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877b3c9-8fdd-442c-b979-e60981f269f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:32.918908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e877b3c9-8fdd-442c-b979-e60981f269f9 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:32.920076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e877b3c9-8fdd-442c-b979-e60981f269f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:32.962105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde9eaf-1373-48d5-bee3-b296d4ae5890 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:33.001479 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8695df0-606b-4d71-b0d8-4c04d28bd3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:33.002437 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8695df0-606b-4d71-b0d8-4c04d28bd3ff None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:33.002717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8695df0-606b-4d71-b0d8-4c04d28bd3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:33.003235 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8695df0-606b-4d71-b0d8-4c04d28bd3ff None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:33.004439 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8695df0-606b-4d71-b0d8-4c04d28bd3ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:33.004997 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8695df0-606b-4d71-b0d8-4c04d28bd3ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:33.006485 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8695df0-606b-4d71-b0d8-4c04d28bd3ff None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:33.008556 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 409/810] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:33.009313 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:33.009441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877b3c9-8fdd-442c-b979-e60981f269f9 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:33.021298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 402/811] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:33.028712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8695df0-606b-4d71-b0d8-4c04d28bd3ff None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:33.149361 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877b3c9-8fdd-442c-b979-e60981f269f9 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:33.160228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:33.173475 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8695df0-606b-4d71-b0d8-4c04d28bd3ff None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:33.196705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767e4c1-fc0c-4c69-99b7-f7f4d0e957a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:33.198071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767e4c1-fc0c-4c69-99b7-f7f4d0e957a9 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:33.198455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767e4c1-fc0c-4c69-99b7-f7f4d0e957a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:33.199094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767e4c1-fc0c-4c69-99b7-f7f4d0e957a9 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:33.199997 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767e4c1-fc0c-4c69-99b7-f7f4d0e957a9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:33.200599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767e4c1-fc0c-4c69-99b7-f7f4d0e957a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:33.202825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767e4c1-fc0c-4c69-99b7-f7f4d0e957a9 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:33.210736 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 410/812] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Jun 2 18:48:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:33.211729 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767e4c1-fc0c-4c69-99b7-f7f4d0e957a9 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:33.212075 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebf4f2-780c-4016-bd2c-9bae4037ad22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:33.213072 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebf4f2-780c-4016-bd2c-9bae4037ad22 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:33.213346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebf4f2-780c-4016-bd2c-9bae4037ad22 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:33.213666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebf4f2-780c-4016-bd2c-9bae4037ad22 None admin] PATH_INFO: `/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/b4faac48f82244bebf039aab92898617/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:33.216181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebf4f2-780c-4016-bd2c-9bae4037ad22 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a3d8f5b51ff4201b3968c9173ae06a7, user_id=b4faac48f82244bebf039aab92898617, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:33.217685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebf4f2-780c-4016-bd2c-9bae4037ad22 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:33.237888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 403/813] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:48:33 2022] PUT /identity/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/b4faac48f82244bebf039aab92898617/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:48:33.238754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebf4f2-780c-4016-bd2c-9bae4037ad22 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:33.301843 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:33.329833 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767e4c1-fc0c-4c69-99b7-f7f4d0e957a9 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:33.348958 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebf4f2-780c-4016-bd2c-9bae4037ad22 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:33.370215 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5972ec-d133-4a53-9f63-e28d1d836670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:33.371988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5972ec-d133-4a53-9f63-e28d1d836670 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:33.372485 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5972ec-d133-4a53-9f63-e28d1d836670 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:33.372960 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5972ec-d133-4a53-9f63-e28d1d836670 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:33.393130 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5972ec-d133-4a53-9f63-e28d1d836670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:33.406299 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c8ad0-8288-4c9e-8153-d692e75a0b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:33.407319 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c8ad0-8288-4c9e-8153-d692e75a0b69 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:33.407659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-7c5972ec-d133-4a53-9f63-e28d1d836670 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:48:33.407659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:33.407659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:33.407659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:33.407659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:33.407659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:33.407659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:33.407659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:33.407659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:33.407659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:33.407659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:33.407659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:33.407659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:33.407659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:33.407659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:33.407659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:33.408602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:33.408602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:33.408602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:33.408602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:33.408602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:33.408602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:33.408602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:33.408602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:33.408602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:33.408602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:33.408602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:33.408602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:33.408602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:33.408602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:33.408602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:33.408602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:33.409433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:33.409433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:33.409433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:33.409433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:33.409433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:33.409433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:33.409433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:33.409433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:33.409433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:33.409433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:33.409433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:48:33.409433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:33.409433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 411/814] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:48:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:33.410962 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c8ad0-8288-4c9e-8153-d692e75a0b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:33.411610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c8ad0-8288-4c9e-8153-d692e75a0b69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:33.412642 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c8ad0-8288-4c9e-8153-d692e75a0b69 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:33.414363 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c8ad0-8288-4c9e-8153-d692e75a0b69 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:33.414826 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5972ec-d133-4a53-9f63-e28d1d836670 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:33.451472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 404/815] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jun 2 18:48:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:48:33.470151 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:33.561681 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5972ec-d133-4a53-9f63-e28d1d836670 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:33.617660 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c770df-9a0b-4497-a6c8-75275b3019a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:33.618807 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c770df-9a0b-4497-a6c8-75275b3019a3 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:33.619296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c770df-9a0b-4497-a6c8-75275b3019a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:33.619785 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c770df-9a0b-4497-a6c8-75275b3019a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:33.620835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c770df-9a0b-4497-a6c8-75275b3019a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:33.621359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c770df-9a0b-4497-a6c8-75275b3019a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:33.623249 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c770df-9a0b-4497-a6c8-75275b3019a3 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:33.634918 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 412/816] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:48:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:33.640668 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c8ad0-8288-4c9e-8153-d692e75a0b69 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:33.789319 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c8ad0-8288-4c9e-8153-d692e75a0b69 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:33.803227 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:33.827938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f588cb0-ff59-4e74-9022-1acfa1de4034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:33.828759 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f588cb0-ff59-4e74-9022-1acfa1de4034 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:33.829038 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f588cb0-ff59-4e74-9022-1acfa1de4034 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:33.829311 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f588cb0-ff59-4e74-9022-1acfa1de4034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:33.842364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f588cb0-ff59-4e74-9022-1acfa1de4034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:33.843860 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f588cb0-ff59-4e74-9022-1acfa1de4034 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:33.863538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-3f588cb0-ff59-4e74-9022-1acfa1de4034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:33.863538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:33.863538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:33.863538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:33.863538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:33.863538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:33.863538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:33.863538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:33.863538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:33.863538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:33.863538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:33.863538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:33.863538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:33.863538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:33.863538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:33.864488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:33.864488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:33.864488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:33.864488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:33.864488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:33.864488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:33.864488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:33.864488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:33.864488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:33.864488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:33.864488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:33.864488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:33.864488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:33.864488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:33.864488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:33.864488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:33.864488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:33.865367 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:33.865367 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:33.865367 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:33.865367 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:33.865367 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 405/817] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:33.872582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c770df-9a0b-4497-a6c8-75275b3019a3 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:33.978199 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:33.989830 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c770df-9a0b-4497-a6c8-75275b3019a3 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:34.029127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54ff8a-146d-4c6d-8e5e-398094f409c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:34.030184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54ff8a-146d-4c6d-8e5e-398094f409c1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:34.030655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54ff8a-146d-4c6d-8e5e-398094f409c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:34.031139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54ff8a-146d-4c6d-8e5e-398094f409c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:34.032051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54ff8a-146d-4c6d-8e5e-398094f409c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:34.032541 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54ff8a-146d-4c6d-8e5e-398094f409c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:34.034147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54ff8a-146d-4c6d-8e5e-398094f409c1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:34.046803 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 413/818] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:34.052551 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f588cb0-ff59-4e74-9022-1acfa1de4034 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:34.177392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f588cb0-ff59-4e74-9022-1acfa1de4034 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:34.212494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d6ae5-2fed-4744-ae6f-511e434ec908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:34.213678 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d6ae5-2fed-4744-ae6f-511e434ec908 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:34.214179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d6ae5-2fed-4744-ae6f-511e434ec908 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:34.214809 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d6ae5-2fed-4744-ae6f-511e434ec908 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:34.227174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d6ae5-2fed-4744-ae6f-511e434ec908 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:34.229410 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d6ae5-2fed-4744-ae6f-511e434ec908 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:34.247315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-057d6ae5-2fed-4744-ae6f-511e434ec908 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 18:48:34.247315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:34.247315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:34.247315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:34.247315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:34.247315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:34.247315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:34.247315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:34.247315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:34.247315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:34.247315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:34.247315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:34.247315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:34.247315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:34.247315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:34.247315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:34.248316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:34.248316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:34.248316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:34.248316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:34.248316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:34.248316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:34.248316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:34.248316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:34.248316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:34.248316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:34.248316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:34.248316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:34.248316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:34.248316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:34.248316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:34.248316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:34.248316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:34.248316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:34.249232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:34.249232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:34.249232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:34.249232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:34.249232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:34.249232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:34.249232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:34.249232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:34.249232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 18:48:34.249232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:34.255862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 406/819] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jun 2 18:48:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:34.261734 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54ff8a-146d-4c6d-8e5e-398094f409c1 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:34.367682 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54ff8a-146d-4c6d-8e5e-398094f409c1 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:34.405291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76596b-8ead-44f7-9931-7f62b73dc92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:34.406377 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76596b-8ead-44f7-9931-7f62b73dc92a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:34.406878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76596b-8ead-44f7-9931-7f62b73dc92a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:34.407338 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76596b-8ead-44f7-9931-7f62b73dc92a None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:34.408383 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76596b-8ead-44f7-9931-7f62b73dc92a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:34.408881 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76596b-8ead-44f7-9931-7f62b73dc92a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:34.410525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76596b-8ead-44f7-9931-7f62b73dc92a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:34.437743 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 414/820] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jun 2 18:48:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:34.443003 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d6ae5-2fed-4744-ae6f-511e434ec908 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:34.451655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99e7c8-d63d-4702-bdc9-e8c3419d5fbb None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:34.451934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99e7c8-d63d-4702-bdc9-e8c3419d5fbb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:34.452215 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99e7c8-d63d-4702-bdc9-e8c3419d5fbb None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:34.453892 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 415/821] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:48:34.470317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e9e4-d2e2-4a28-97a6-391ed39738a1 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:34.470903 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e9e4-d2e2-4a28-97a6-391ed39738a1 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:34.470903 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e9e4-d2e2-4a28-97a6-391ed39738a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:34.479683 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:34.490151 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-87f3e9e4-d2e2-4a28-97a6-391ed39738a1 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:34.491798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-87f3e9e4-d2e2-4a28-97a6-391ed39738a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:34.501831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:34.560595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d6ae5-2fed-4744-ae6f-511e434ec908 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:34.587448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 416/822] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:34.614729 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e444f66-bfd7-46ec-bee4-8d9ee4ff5306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:34.615144 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3e9e4-d2e2-4a28-97a6-391ed39738a1 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:34.615447 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e444f66-bfd7-46ec-bee4-8d9ee4ff5306 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:34.615723 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e444f66-bfd7-46ec-bee4-8d9ee4ff5306 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:34.615992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e444f66-bfd7-46ec-bee4-8d9ee4ff5306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:34.741683 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e444f66-bfd7-46ec-bee4-8d9ee4ff5306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:34.744217 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e444f66-bfd7-46ec-bee4-8d9ee4ff5306 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:34.799317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:34.815176 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3e9e4-d2e2-4a28-97a6-391ed39738a1 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:34.892251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75838f0-1434-447c-b46e-9574aafda503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:34.893077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75838f0-1434-447c-b46e-9574aafda503 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:34.893357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75838f0-1434-447c-b46e-9574aafda503 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:34.893633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75838f0-1434-447c-b46e-9574aafda503 None admin] PATH_INFO: `/v3/services/network` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:34.894327 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75838f0-1434-447c-b46e-9574aafda503 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:34.895722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75838f0-1434-447c-b46e-9574aafda503 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:34.917514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-c75838f0-1434-447c-b46e-9574aafda503 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 18:48:34.917514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:34.917514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:34.917514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:34.917514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:34.917514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:34.917514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:34.917514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:34.917514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 18:48:34.917514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:34.917514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:34.917514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:34.917514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:34.917514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:34.917514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:34.917514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:34.917514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:34.919015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:34.919015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:34.919015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:34.919015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:34.919015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:34.919015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:34.919015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:34.919015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:34.919015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:34.919015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:34.919015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:34.919015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:34.919015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:34.919015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:34.919015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:34.919015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:34.919931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:34.919931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:34.919931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:34.919931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:34.919931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:34.919931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:34.919931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:34.919931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:34.919931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:34.919931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:34.919931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:34.919931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:34.919931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 18:48:34.919931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:34.923140 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 407/823] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:48:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 18:48:34.927528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 417/824] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:34 2022] GET /identity/v3/services/network => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:34.929569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e444f66-bfd7-46ec-bee4-8d9ee4ff5306 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:34.935225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75838f0-1434-447c-b46e-9574aafda503 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:34.962207 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:35.047893 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75838f0-1434-447c-b46e-9574aafda503 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:35.091242 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd86bd9-4fe2-4c06-a40b-5d749759961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:35.091933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd86bd9-4fe2-4c06-a40b-5d749759961d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:35.092214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd86bd9-4fe2-4c06-a40b-5d749759961d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:35.092489 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd86bd9-4fe2-4c06-a40b-5d749759961d None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:35.093210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd86bd9-4fe2-4c06-a40b-5d749759961d None admin] RBAC: Adding query filter params (name=network) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:35.093518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd86bd9-4fe2-4c06-a40b-5d749759961d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:35.094999 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd86bd9-4fe2-4c06-a40b-5d749759961d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:35.116003 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 418/825] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 2 18:48:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:35.124101 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd86bd9-4fe2-4c06-a40b-5d749759961d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:35.129370 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e444f66-bfd7-46ec-bee4-8d9ee4ff5306 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:35.175004 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:35.195048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97f05c-f40e-4a58-912f-a56d828c8440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:35.195872 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97f05c-f40e-4a58-912f-a56d828c8440 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:35.196151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97f05c-f40e-4a58-912f-a56d828c8440 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:35.196413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97f05c-f40e-4a58-912f-a56d828c8440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:35.216890 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97f05c-f40e-4a58-912f-a56d828c8440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:35.219331 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97f05c-f40e-4a58-912f-a56d828c8440 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:35.246353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-2f97f05c-f40e-4a58-912f-a56d828c8440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:35.246353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:35.246353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:35.246353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:35.246353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:35.246353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:35.246353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:35.246353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:35.246353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:35.246353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:35.246353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:35.246353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:35.246353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:35.246353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:35.246353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:35.247756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:35.247756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:35.247756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:35.247756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:35.247756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:35.247756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:35.247756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:35.247756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:35.247756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:35.247756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:35.247756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:35.247756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:35.247756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:35.247756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:35.247756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:35.247756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:35.247756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:35.248645 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:35.248645 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:35.248645 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:35.248645 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:35.248645 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 408/826] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:35.254461 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97f05c-f40e-4a58-912f-a56d828c8440 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:35.264678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:35.341765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd86bd9-4fe2-4c06-a40b-5d749759961d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:35.375322 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97f05c-f40e-4a58-912f-a56d828c8440 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:35.395323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcd4c5-ae07-4f68-b55a-10c755e31664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:35.396418 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcd4c5-ae07-4f68-b55a-10c755e31664 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:35.396912 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcd4c5-ae07-4f68-b55a-10c755e31664 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:35.397379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcd4c5-ae07-4f68-b55a-10c755e31664 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:35.398342 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcd4c5-ae07-4f68-b55a-10c755e31664 None admin] RBAC: Adding query filter params (type=network) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:35.398824 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcd4c5-ae07-4f68-b55a-10c755e31664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:35.400409 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcd4c5-ae07-4f68-b55a-10c755e31664 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:35.406854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 419/827] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 2 18:48:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:35.408469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960894f-118e-428a-8c9d-857907195368 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:35.408926 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960894f-118e-428a-8c9d-857907195368 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:35.409366 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960894f-118e-428a-8c9d-857907195368 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:35.411050 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 420/828] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:35.411911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960894f-118e-428a-8c9d-857907195368 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:35.426469 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb29398-82bf-440b-ad77-036cbe4df796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:35.427202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb29398-82bf-440b-ad77-036cbe4df796 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:35.427569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb29398-82bf-440b-ad77-036cbe4df796 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:35.427905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb29398-82bf-440b-ad77-036cbe4df796 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:35.428691 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb29398-82bf-440b-ad77-036cbe4df796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:35.429058 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb29398-82bf-440b-ad77-036cbe4df796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:35.430730 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb29398-82bf-440b-ad77-036cbe4df796 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:35.443200 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 409/829] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:35.448470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e183231-7800-4de5-9693-d5a7d04bd3c3 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:35.448470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e183231-7800-4de5-9693-d5a7d04bd3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:35.448470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e183231-7800-4de5-9693-d5a7d04bd3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:35.462893 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4e183231-7800-4de5-9693-d5a7d04bd3c3 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:35.464254 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4e183231-7800-4de5-9693-d5a7d04bd3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:35.508473 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:35.539520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960894f-118e-428a-8c9d-857907195368 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:35.558898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 410/830] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:35.560153 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e183231-7800-4de5-9693-d5a7d04bd3c3 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:35.592832 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:35.599770 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff22142-b140-42cb-ac23-fb5a33b24d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:35.600701 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff22142-b140-42cb-ac23-fb5a33b24d65 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:35.601165 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff22142-b140-42cb-ac23-fb5a33b24d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:35.601616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff22142-b140-42cb-ac23-fb5a33b24d65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:35.602590 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff22142-b140-42cb-ac23-fb5a33b24d65 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:35.604209 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff22142-b140-42cb-ac23-fb5a33b24d65 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:35.630050 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 421/831] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jun 2 18:48:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:48:35.631354 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff22142-b140-42cb-ac23-fb5a33b24d65 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:35.755206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e183231-7800-4de5-9693-d5a7d04bd3c3 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:35.768093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff22142-b140-42cb-ac23-fb5a33b24d65 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:35.807586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc9ced-3a12-4d44-ae42-f295f70e4b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:35.808562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc9ced-3a12-4d44-ae42-f295f70e4b07 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:35.808562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc9ced-3a12-4d44-ae42-f295f70e4b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:35.809109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc9ced-3a12-4d44-ae42-f295f70e4b07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:35.821279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc9ced-3a12-4d44-ae42-f295f70e4b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:35.829678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-b7fc9ced-3a12-4d44-ae42-f295f70e4b07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:35.829678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:35.829678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:35.829678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:35.829678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:35.829678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:35.829678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:35.829678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:35.829678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:35.829678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:35.829678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:35.829678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:35.829678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:35.829678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:35.829678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:35.829678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:35.830862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:35.830862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:35.830862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:35.830862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:35.830862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:35.830862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:35.830862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:35.830862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:35.830862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:35.830862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:35.830862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:35.830862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:35.830862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:35.830862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:35.830862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:35.830862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:35.831718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:35.831718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:35.831718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:35.831718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:35.831718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:35.831718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:35.831718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:35.831718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:35.831718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:35.831718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:35.831718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:48:35.831718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:35.831718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 422/832] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:48:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:35.837099 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc9ced-3a12-4d44-ae42-f295f70e4b07 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:35.865403 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bff13-e222-4c03-aa66-ad3e4187ca3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:35.866678 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bff13-e222-4c03-aa66-ad3e4187ca3c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:35.867160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bff13-e222-4c03-aa66-ad3e4187ca3c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:35.867648 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bff13-e222-4c03-aa66-ad3e4187ca3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:35.881853 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872bff13-e222-4c03-aa66-ad3e4187ca3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:35.883950 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872bff13-e222-4c03-aa66-ad3e4187ca3c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:35.893043 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:35.916278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-872bff13-e222-4c03-aa66-ad3e4187ca3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:35.916278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:35.916278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:35.916278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:35.916278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:35.916278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:35.916278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:35.916278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:35.916278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:35.916278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:35.916278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:35.916278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:35.916278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:35.916278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:35.916278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:35.917324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:35.917324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:35.917324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:35.917324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:35.917324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:35.917324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:35.917324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:35.917324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:35.917324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:35.917324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:35.917324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:35.917324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:35.917324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:35.917324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:35.917324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:35.917324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:35.917324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:35.919460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:35.919460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:35.919460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:35.919460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:35.919460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:35.919460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:35.919460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:35.919460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:35.921886 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 411/833] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:35.927963 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bff13-e222-4c03-aa66-ad3e4187ca3c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:35.960853 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc9ced-3a12-4d44-ae42-f295f70e4b07 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:35.967484 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:36.000021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfd035-a9c7-4f86-82d8-0d880ea69e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:36.000705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfd035-a9c7-4f86-82d8-0d880ea69e58 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:36.000984 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfd035-a9c7-4f86-82d8-0d880ea69e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:36.001260 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfd035-a9c7-4f86-82d8-0d880ea69e58 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:36.002043 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfd035-a9c7-4f86-82d8-0d880ea69e58 None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:36.002350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfd035-a9c7-4f86-82d8-0d880ea69e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:36.003722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfd035-a9c7-4f86-82d8-0d880ea69e58 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:36.014537 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 423/834] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:48:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:36.015678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cec8d7-3bfd-40a3-856d-a24337076cea None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:36.016053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cec8d7-3bfd-40a3-856d-a24337076cea None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:36.016305 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cec8d7-3bfd-40a3-856d-a24337076cea None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:36.017770 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 424/835] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:36.025672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837ae65-ec08-4466-a7b6-78caa91da75a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:36.026009 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837ae65-ec08-4466-a7b6-78caa91da75a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:36.026677 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837ae65-ec08-4466-a7b6-78caa91da75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:36.047222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6837ae65-ec08-4466-a7b6-78caa91da75a None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:36.048426 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6837ae65-ec08-4466-a7b6-78caa91da75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:36.051027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bff13-e222-4c03-aa66-ad3e4187ca3c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:36.098186 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5531f-d81f-4f6b-acd3-a1f1338b4a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:36.098886 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5531f-d81f-4f6b-acd3-a1f1338b4a6d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:36.099169 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5531f-d81f-4f6b-acd3-a1f1338b4a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:36.099446 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5531f-d81f-4f6b-acd3-a1f1338b4a6d None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:36.100266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5531f-d81f-4f6b-acd3-a1f1338b4a6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:36.100586 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5531f-d81f-4f6b-acd3-a1f1338b4a6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:36.102130 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5531f-d81f-4f6b-acd3-a1f1338b4a6d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:36.116282 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 412/836] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:36.117048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5531f-d81f-4f6b-acd3-a1f1338b4a6d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:36.138790 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 425/837] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:48:36.139976 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837ae65-ec08-4466-a7b6-78caa91da75a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:36.178966 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:36.219691 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:36.239034 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5531f-d81f-4f6b-acd3-a1f1338b4a6d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:36.248834 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837ae65-ec08-4466-a7b6-78caa91da75a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:36.274451 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626633e-a917-47ba-a631-ec258cdda400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:36.275262 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626633e-a917-47ba-a631-ec258cdda400 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:36.275541 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626633e-a917-47ba-a631-ec258cdda400 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:36.275812 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626633e-a917-47ba-a631-ec258cdda400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:36.283789 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295dad9-acb0-4da3-8e89-e0c76b512791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:36.284453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295dad9-acb0-4da3-8e89-e0c76b512791 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:36.284726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295dad9-acb0-4da3-8e89-e0c76b512791 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:36.284992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295dad9-acb0-4da3-8e89-e0c76b512791 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:36.285897 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295dad9-acb0-4da3-8e89-e0c76b512791 None admin] RBAC: Adding query filter params (role.id=8560bac1acf74dce81ea6a76f751b641, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=6b8ff9f5032e498db3c70c79cc11989b) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:36.286207 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295dad9-acb0-4da3-8e89-e0c76b512791 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:36.286378 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626633e-a917-47ba-a631-ec258cdda400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:36.287663 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295dad9-acb0-4da3-8e89-e0c76b512791 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:36.287842 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626633e-a917-47ba-a631-ec258cdda400 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:36.294211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 426/838] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:48:36 2022] GET /identity/v3/role_assignments?user.id=6b8ff9f5032e498db3c70c79cc11989b&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:36.294830 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295dad9-acb0-4da3-8e89-e0c76b512791 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:36.319682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-6626633e-a917-47ba-a631-ec258cdda400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:36.319682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:36.319682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:36.319682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:36.319682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:36.319682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:36.319682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:36.319682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:36.319682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:36.319682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:36.319682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:36.319682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:36.319682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:36.319682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:36.319682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:36.320660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:36.320660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:36.320660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:36.320660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:36.320660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:36.320660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:36.320660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:36.320660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:36.320660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:36.320660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:36.320660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:36.320660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:36.320660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:36.320660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:36.320660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:36.320660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:36.320660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:36.321599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:36.321599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:36.321599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:36.321599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:36.323827 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 413/839] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:36.330023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626633e-a917-47ba-a631-ec258cdda400 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:36.420767 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:36.425614 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295dad9-acb0-4da3-8e89-e0c76b512791 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:36.458175 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626633e-a917-47ba-a631-ec258cdda400 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:36.464895 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e10538-91a2-4b98-ac95-0c0bf859ef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:36.465787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e10538-91a2-4b98-ac95-0c0bf859ef48 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:36.466101 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e10538-91a2-4b98-ac95-0c0bf859ef48 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:36.466375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e10538-91a2-4b98-ac95-0c0bf859ef48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:36.480509 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e10538-91a2-4b98-ac95-0c0bf859ef48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:36.488679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-73e10538-91a2-4b98-ac95-0c0bf859ef48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:48:36.488679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:36.488679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:36.488679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:36.488679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:36.488679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:36.488679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:36.488679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:36.488679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:36.488679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:36.488679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:36.488679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:36.488679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:36.488679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:36.488679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:36.488679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:36.490074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:36.490074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:36.490074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:36.490074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:36.490074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:36.490074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:36.490074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:36.490074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:36.490074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:36.490074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:36.490074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:36.490074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:36.490074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:36.490074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:36.490074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:36.490074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:36.490914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:36.490914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:36.490914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:36.490914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:36.490914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:36.490914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:36.490914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:36.490914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:36.490914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:36.490914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:36.490914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:48:36.490914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:36.490914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 427/840] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:48:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:36.491621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d998da-0f72-4454-a0bf-398e1439bd6c None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:36.491741 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d998da-0f72-4454-a0bf-398e1439bd6c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:36.492018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d998da-0f72-4454-a0bf-398e1439bd6c None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:36.493461 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 428/841] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:36.499253 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d998da-0f72-4454-a0bf-398e1439bd6c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:36.504605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd542fcb-2df6-44bf-bd51-483c1b42e944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:36.505279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd542fcb-2df6-44bf-bd51-483c1b42e944 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:36.506026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd542fcb-2df6-44bf-bd51-483c1b42e944 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:36.506026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd542fcb-2df6-44bf-bd51-483c1b42e944 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:36.507302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd542fcb-2df6-44bf-bd51-483c1b42e944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:36.507302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd542fcb-2df6-44bf-bd51-483c1b42e944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:36.508305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd542fcb-2df6-44bf-bd51-483c1b42e944 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:36.516102 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:36.524704 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 414/842] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:36.526273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6b0f-088c-4b68-8317-437b65f672aa None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:36.526560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6b0f-088c-4b68-8317-437b65f672aa None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:36.526873 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6b0f-088c-4b68-8317-437b65f672aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:36.549336 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e49f6b0f-088c-4b68-8317-437b65f672aa None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:36.551158 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e49f6b0f-088c-4b68-8317-437b65f672aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:36.625011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 415/843] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:36.625775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f6b0f-088c-4b68-8317-437b65f672aa None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:36.640199 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d998da-0f72-4454-a0bf-398e1439bd6c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:36.675481 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf4491-4e8b-46e3-a3ad-3b7eb402b4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:36.676072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf4491-4e8b-46e3-a3ad-3b7eb402b4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:36.676359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf4491-4e8b-46e3-a3ad-3b7eb402b4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:36.676638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf4491-4e8b-46e3-a3ad-3b7eb402b4e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:36.677389 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf4491-4e8b-46e3-a3ad-3b7eb402b4e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:36.677713 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf4491-4e8b-46e3-a3ad-3b7eb402b4e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:36.679124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf4491-4e8b-46e3-a3ad-3b7eb402b4e0 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:36.693536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 429/844] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:48:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:36.693536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf4491-4e8b-46e3-a3ad-3b7eb402b4e0 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:36.715473 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:36.741027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f6b0f-088c-4b68-8317-437b65f672aa None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:36.783206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:36.795757 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a1376-6996-4b59-a4b4-59be6e0a564c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:36.797069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a1376-6996-4b59-a4b4-59be6e0a564c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:36.797491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a1376-6996-4b59-a4b4-59be6e0a564c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:36.797932 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a1376-6996-4b59-a4b4-59be6e0a564c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:36.809488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a1376-6996-4b59-a4b4-59be6e0a564c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:36.811930 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a1376-6996-4b59-a4b4-59be6e0a564c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:36.818484 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf4491-4e8b-46e3-a3ad-3b7eb402b4e0 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:36.837256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-455a1376-6996-4b59-a4b4-59be6e0a564c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 18:48:36.837256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:36.837256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:36.837256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:36.837256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:36.837256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:36.837256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:36.837256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:36.837256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:36.837256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:36.837256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:36.837256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:36.837256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:36.837256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:36.837256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:36.837256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:36.839144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:36.839144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:36.839144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:36.839144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:36.839144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:36.839144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:36.839144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:36.839144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:36.839144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:36.839144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:36.839144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:36.839144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:36.839144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:36.839144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:36.839144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:36.839144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:36.839144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:36.839144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:36.847965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:36.847965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:36.847965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:36.847965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:36.847965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:36.847965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:36.847965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:36.847965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:36.847965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 18:48:36.847965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:36.847965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 416/845] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 2 18:48:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:36.847965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a1376-6996-4b59-a4b4-59be6e0a564c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:36.868607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f4ad9-f337-4d08-a6af-b6f72ba30cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:36.869549 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f4ad9-f337-4d08-a6af-b6f72ba30cdb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:36.869876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f4ad9-f337-4d08-a6af-b6f72ba30cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:36.870211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f4ad9-f337-4d08-a6af-b6f72ba30cdb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:36.870924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f4ad9-f337-4d08-a6af-b6f72ba30cdb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:36.872319 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f4ad9-f337-4d08-a6af-b6f72ba30cdb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:36.884031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-d71f4ad9-f337-4d08-a6af-b6f72ba30cdb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 18:48:36.884031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:36.884031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:36.884031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:36.884031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:36.884031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:36.884031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:36.884031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:36.884031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 18:48:36.884031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:36.884031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:36.884031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:36.884031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:36.884031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:36.884031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:36.884031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:36.884031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:36.885018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:36.885018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:36.885018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:36.885018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:36.885018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:36.885018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:36.885018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:36.885018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:36.885018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:36.885018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:36.885018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:36.885018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:36.885018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:36.885018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:36.885018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:36.885018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:36.886313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:36.886313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:36.886313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:36.886313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:36.886313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:36.886313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:36.886313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:36.886313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:36.886313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:36.886313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:36.886313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:36.886313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:36.886313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 18:48:36.886313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:36.886313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 430/846] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:48:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:36.887109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f4ad9-f337-4d08-a6af-b6f72ba30cdb None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:36.958344 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a1376-6996-4b59-a4b4-59be6e0a564c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:36.978692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:36.994232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9654309-9159-428f-96e4-c3d15fa20d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:36.995032 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9654309-9159-428f-96e4-c3d15fa20d66 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:36.995582 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9654309-9159-428f-96e4-c3d15fa20d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:36.995709 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9654309-9159-428f-96e4-c3d15fa20d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:36.999337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f4ad9-f337-4d08-a6af-b6f72ba30cdb None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:37.006114 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9654309-9159-428f-96e4-c3d15fa20d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:37.007582 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9654309-9159-428f-96e4-c3d15fa20d66 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:37.025195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-b9654309-9159-428f-96e4-c3d15fa20d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:37.025195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:37.025195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:37.025195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:37.025195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:37.025195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:37.025195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:37.025195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:37.025195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:37.025195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:37.025195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:37.025195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:37.025195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:37.025195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:37.025195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:37.026150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:37.026150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:37.026150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:37.026150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:37.026150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:37.026150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:37.026150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:37.026150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:37.026150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:37.026150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:37.026150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:37.026150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:37.026150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:37.026150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:37.026150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:37.026150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:37.026150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:37.027094 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:37.027094 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:37.027094 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:37.027094 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:37.027094 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 417/847] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:37.028247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9654309-9159-428f-96e4-c3d15fa20d66 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:37.038505 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bb103-2fd1-4290-8f3a-b2b170ff03f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:37.039897 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bb103-2fd1-4290-8f3a-b2b170ff03f2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:37.040747 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bb103-2fd1-4290-8f3a-b2b170ff03f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:37.041228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bb103-2fd1-4290-8f3a-b2b170ff03f2 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:37.042692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bb103-2fd1-4290-8f3a-b2b170ff03f2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:37.043549 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bb103-2fd1-4290-8f3a-b2b170ff03f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:37.045989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bb103-2fd1-4290-8f3a-b2b170ff03f2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:37.069567 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 431/848] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Jun 2 18:48:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:37.069567 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bb103-2fd1-4290-8f3a-b2b170ff03f2 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:37.072700 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:37.146525 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9654309-9159-428f-96e4-c3d15fa20d66 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:37.186677 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180840f-dcda-4d3e-9591-285043fbbc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:37.187350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180840f-dcda-4d3e-9591-285043fbbc50 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:37.187637 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180840f-dcda-4d3e-9591-285043fbbc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:37.187911 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180840f-dcda-4d3e-9591-285043fbbc50 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:37.188620 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180840f-dcda-4d3e-9591-285043fbbc50 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:37.188925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180840f-dcda-4d3e-9591-285043fbbc50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:37.190374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180840f-dcda-4d3e-9591-285043fbbc50 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:37.192076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bb103-2fd1-4290-8f3a-b2b170ff03f2 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:37.195100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 418/849] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:48:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:37.196059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180840f-dcda-4d3e-9591-285043fbbc50 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:37.231191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835a549-68ae-45a0-878a-4c9733d866e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:37.231859 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835a549-68ae-45a0-878a-4c9733d866e4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:37.232131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835a549-68ae-45a0-878a-4c9733d866e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:37.232404 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835a549-68ae-45a0-878a-4c9733d866e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:37.233121 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835a549-68ae-45a0-878a-4c9733d866e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:37.233441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835a549-68ae-45a0-878a-4c9733d866e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:37.234965 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835a549-68ae-45a0-878a-4c9733d866e4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:37.251131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 432/850] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:37.251131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835a549-68ae-45a0-878a-4c9733d866e4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:37.251873 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:37.309408 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180840f-dcda-4d3e-9591-285043fbbc50 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:37.311703 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:37.344055 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75247dc-8581-4891-8427-1c438013015f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:37.344701 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75247dc-8581-4891-8427-1c438013015f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:37.344982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75247dc-8581-4891-8427-1c438013015f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:37.345248 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75247dc-8581-4891-8427-1c438013015f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:37.354761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835a549-68ae-45a0-878a-4c9733d866e4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:37.388806 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010f25c-5200-4be3-8116-0afb1c405e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:37.389468 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f25c-5200-4be3-8116-0afb1c405e5e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:37.389743 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f25c-5200-4be3-8116-0afb1c405e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:37.390040 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f25c-5200-4be3-8116-0afb1c405e5e None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:37.390737 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010f25c-5200-4be3-8116-0afb1c405e5e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:37.391114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010f25c-5200-4be3-8116-0afb1c405e5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:37.392557 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010f25c-5200-4be3-8116-0afb1c405e5e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:37.401852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 433/851] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:48:37 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:37.401852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010f25c-5200-4be3-8116-0afb1c405e5e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:37.422586 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75247dc-8581-4891-8427-1c438013015f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:37.424441 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75247dc-8581-4891-8427-1c438013015f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:37.509252 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:37.551557 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010f25c-5200-4be3-8116-0afb1c405e5e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:37.562605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 419/852] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:48:37 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 18:48:37.564449 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75247dc-8581-4891-8427-1c438013015f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:37.567689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:37.593194 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a17e4-92b0-4da0-b7b8-6bea23b5c12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:37.594481 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a17e4-92b0-4da0-b7b8-6bea23b5c12f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:37.594977 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a17e4-92b0-4da0-b7b8-6bea23b5c12f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:37.595455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a17e4-92b0-4da0-b7b8-6bea23b5c12f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:37.604459 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a17e4-92b0-4da0-b7b8-6bea23b5c12f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:37.606699 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a17e4-92b0-4da0-b7b8-6bea23b5c12f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:37.622924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-0c4a17e4-92b0-4da0-b7b8-6bea23b5c12f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 18:48:37.622924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:37.622924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:37.622924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:37.622924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:37.622924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:37.622924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:37.622924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:37.622924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:37.622924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:37.622924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:37.622924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:37.622924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:37.622924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:37.622924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:37.622924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:37.623951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:37.623951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:37.623951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:37.623951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:37.623951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:37.623951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:37.623951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:37.623951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:37.623951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:37.623951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:37.623951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:37.623951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:37.623951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:37.623951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:37.623951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:37.623951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:37.623951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:37.623951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:37.624907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:37.624907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:37.624907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:37.624907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:37.624907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:37.624907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:37.624907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:37.624907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:37.624907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 18:48:37.624907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:37.631911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 434/853] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:48:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:37.632983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a17e4-92b0-4da0-b7b8-6bea23b5c12f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:37.675774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75247dc-8581-4891-8427-1c438013015f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:37.710850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df211d6-0c24-43e6-956e-cf7a041c2c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:37.711649 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df211d6-0c24-43e6-956e-cf7a041c2c97 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:37.711935 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df211d6-0c24-43e6-956e-cf7a041c2c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:37.712201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df211d6-0c24-43e6-956e-cf7a041c2c97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:37.722794 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df211d6-0c24-43e6-956e-cf7a041c2c97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:37.724440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df211d6-0c24-43e6-956e-cf7a041c2c97 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:37.740402 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a17e4-92b0-4da0-b7b8-6bea23b5c12f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:37.742618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-0df211d6-0c24-43e6-956e-cf7a041c2c97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:37.742618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:37.742618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:37.742618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:37.742618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:37.742618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:37.742618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:37.742618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:37.742618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:37.742618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:37.742618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:37.742618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:37.742618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:37.742618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:37.742618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:37.743671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:37.743671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:37.743671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:37.743671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:37.743671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:37.743671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:37.743671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:37.743671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:37.743671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:37.743671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:37.743671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:37.743671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:37.743671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:37.743671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:37.743671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:37.743671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:37.743671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:37.744722 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:37.744722 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:37.744722 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:37.744722 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:37.748473 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 420/854] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:37.749760 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df211d6-0c24-43e6-956e-cf7a041c2c97 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:37.777411 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:37.796590 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aac275-4dd6-43e6-970c-6ba55615bf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:37.797295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aac275-4dd6-43e6-970c-6ba55615bf3d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:37.797575 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aac275-4dd6-43e6-970c-6ba55615bf3d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:37.797900 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aac275-4dd6-43e6-970c-6ba55615bf3d None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:37.798834 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aac275-4dd6-43e6-970c-6ba55615bf3d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:37.799039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aac275-4dd6-43e6-970c-6ba55615bf3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:37.800494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aac275-4dd6-43e6-970c-6ba55615bf3d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:37.825214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 435/855] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Jun 2 18:48:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:37.826705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aac275-4dd6-43e6-970c-6ba55615bf3d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:37.831501 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:37.881519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df211d6-0c24-43e6-956e-cf7a041c2c97 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:37.919418 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904048fb-d513-4656-87ce-05bfdd6c3567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:37.920088 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904048fb-d513-4656-87ce-05bfdd6c3567 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:37.920372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904048fb-d513-4656-87ce-05bfdd6c3567 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:37.920654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904048fb-d513-4656-87ce-05bfdd6c3567 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:37.921575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904048fb-d513-4656-87ce-05bfdd6c3567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:37.921690 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904048fb-d513-4656-87ce-05bfdd6c3567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:37.923107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904048fb-d513-4656-87ce-05bfdd6c3567 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:37.940194 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 421/856] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:37.941530 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904048fb-d513-4656-87ce-05bfdd6c3567 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:37.959285 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aac275-4dd6-43e6-970c-6ba55615bf3d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:37.995727 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bc27a-4b09-401e-936d-50fea075e07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:37.996793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bc27a-4b09-401e-936d-50fea075e07a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:37.997282 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bc27a-4b09-401e-936d-50fea075e07a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:37.997785 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bc27a-4b09-401e-936d-50fea075e07a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:38.043258 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904048fb-d513-4656-87ce-05bfdd6c3567 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:38.055012 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:38.059693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:38.073681 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bc27a-4b09-401e-936d-50fea075e07a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:38.076676 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bc27a-4b09-401e-936d-50fea075e07a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:38.078390 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8dd6e-25c2-4604-a63d-ac3e41e7b0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:38.079268 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8dd6e-25c2-4604-a63d-ac3e41e7b0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:38.079616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8dd6e-25c2-4604-a63d-ac3e41e7b0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:38.079986 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8dd6e-25c2-4604-a63d-ac3e41e7b0f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:38.088021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8dd6e-25c2-4604-a63d-ac3e41e7b0f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:38.089626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8dd6e-25c2-4604-a63d-ac3e41e7b0f9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:38.104073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-9cd8dd6e-25c2-4604-a63d-ac3e41e7b0f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:38.104073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:38.104073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:38.104073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:38.104073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:38.104073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:38.104073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:38.104073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:38.104073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:38.104073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:38.104073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:38.104073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:38.104073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:38.104073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:38.104073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:38.105078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:38.105078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:38.105078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:38.105078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:38.105078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:38.105078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:38.105078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:38.105078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:38.105078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:38.105078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:38.105078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:38.105078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:38.105078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:38.105078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:38.105078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:38.105078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:38.105078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:38.105976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:38.105976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:38.105976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:38.105976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:38.105976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:38.105976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:38.105976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:38.105976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:38.105976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 422/857] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:38.111464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8dd6e-25c2-4604-a63d-ac3e41e7b0f9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:38.211666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 436/858] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:48:37 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 18:48:38.217507 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bc27a-4b09-401e-936d-50fea075e07a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:38.225160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8dd6e-25c2-4604-a63d-ac3e41e7b0f9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:38.273464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e55b02-86e3-4774-b6d4-16fdf63bc6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:38.274193 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e55b02-86e3-4774-b6d4-16fdf63bc6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:38.274478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e55b02-86e3-4774-b6d4-16fdf63bc6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:38.274756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e55b02-86e3-4774-b6d4-16fdf63bc6a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:38.275555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e55b02-86e3-4774-b6d4-16fdf63bc6a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:38.275865 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e55b02-86e3-4774-b6d4-16fdf63bc6a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:38.278135 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e55b02-86e3-4774-b6d4-16fdf63bc6a3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:38.297980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 423/859] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:38.304339 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e55b02-86e3-4774-b6d4-16fdf63bc6a3 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:38.320629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:38.340383 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bc27a-4b09-401e-936d-50fea075e07a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:38.344478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:38.377119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1b6cb-4fc2-4eb1-9355-d21c17167986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:38.378202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1b6cb-4fc2-4eb1-9355-d21c17167986 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:38.378650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1b6cb-4fc2-4eb1-9355-d21c17167986 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:38.379054 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1b6cb-4fc2-4eb1-9355-d21c17167986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:38.390022 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1b6cb-4fc2-4eb1-9355-d21c17167986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:38.391811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1b6cb-4fc2-4eb1-9355-d21c17167986 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:38.409953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-80d1b6cb-4fc2-4eb1-9355-d21c17167986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:38.409953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:38.409953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:38.409953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:38.409953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:38.409953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:38.409953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:38.409953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:38.409953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:38.409953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:38.409953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:38.409953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:38.409953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:38.409953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:38.409953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:38.410869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:38.410869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:38.410869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:38.410869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:38.410869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:38.410869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:38.410869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:38.410869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:38.410869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:38.410869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:38.410869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:38.410869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:38.410869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:38.410869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:38.410869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:38.410869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:38.410869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:38.411781 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:38.411781 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:38.411781 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:38.411781 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:38.418361 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e55b02-86e3-4774-b6d4-16fdf63bc6a3 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:38.418642 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 437/860] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:38.419669 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1b6cb-4fc2-4eb1-9355-d21c17167986 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:38.451705 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a46b5-b572-4571-99a2-3539e079dc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:38.452424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a46b5-b572-4571-99a2-3539e079dc9d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:38.452708 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a46b5-b572-4571-99a2-3539e079dc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:38.453034 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a46b5-b572-4571-99a2-3539e079dc9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:38.453905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a46b5-b572-4571-99a2-3539e079dc9d None admin] RBAC: Adding query filter params (role.id=d3525fac5dcc418cbf1bc53ab83dbec6, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=23aa142375c54b94ad276d1a4b9031e0) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:38.454272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a46b5-b572-4571-99a2-3539e079dc9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:38.455726 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a46b5-b572-4571-99a2-3539e079dc9d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:38.468446 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 424/861] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:48:38 2022] GET /identity/v3/role_assignments?user.id=23aa142375c54b94ad276d1a4b9031e0&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=d3525fac5dcc418cbf1bc53ab83dbec6 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:38.532390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1b6cb-4fc2-4eb1-9355-d21c17167986 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:38.572487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e1639-9774-4b08-a647-9c32e13a6dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:38.573089 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e1639-9774-4b08-a647-9c32e13a6dff None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:38.573366 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e1639-9774-4b08-a647-9c32e13a6dff None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:38.573677 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e1639-9774-4b08-a647-9c32e13a6dff None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:38.574455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e1639-9774-4b08-a647-9c32e13a6dff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:38.574760 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e1639-9774-4b08-a647-9c32e13a6dff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:38.576219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e1639-9774-4b08-a647-9c32e13a6dff None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:38.579359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:38.592618 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 438/862] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:38.598416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a46b5-b572-4571-99a2-3539e079dc9d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:38.632463 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d4726-c948-4153-bcca-d1d372707db3 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:38.632831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d4726-c948-4153-bcca-d1d372707db3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:38.633038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d4726-c948-4153-bcca-d1d372707db3 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:38.634972 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 439/863] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:48:38.640996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e027b20-6c65-48d6-9aa6-e29e3e1d8277 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:38.641663 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e027b20-6c65-48d6-9aa6-e29e3e1d8277 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:38.642176 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e027b20-6c65-48d6-9aa6-e29e3e1d8277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:38.661290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5e027b20-6c65-48d6-9aa6-e29e3e1d8277 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:38.662974 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5e027b20-6c65-48d6-9aa6-e29e3e1d8277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:38.725830 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:38.732161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a46b5-b572-4571-99a2-3539e079dc9d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:38.753869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 440/864] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:48:38.773644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e027b20-6c65-48d6-9aa6-e29e3e1d8277 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:38.777933 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b638f-a4c5-4907-8be9-ab8b7b174f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:38.778961 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b638f-a4c5-4907-8be9-ab8b7b174f24 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:38.779236 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b638f-a4c5-4907-8be9-ab8b7b174f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:38.779502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b638f-a4c5-4907-8be9-ab8b7b174f24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:38.787614 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b638f-a4c5-4907-8be9-ab8b7b174f24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:38.789339 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b638f-a4c5-4907-8be9-ab8b7b174f24 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:38.805839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-8c1b638f-a4c5-4907-8be9-ab8b7b174f24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:38.805839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:38.805839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:38.805839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:38.805839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:38.805839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:38.805839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:38.805839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:38.805839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:38.805839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:38.805839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:38.805839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:38.805839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:38.805839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:38.805839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:38.806784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:38.806784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:38.806784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:38.806784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:38.806784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:38.806784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:38.806784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:38.806784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:38.806784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:38.806784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:38.806784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:38.806784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:38.806784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:38.806784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:38.806784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:38.806784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:38.806784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:38.807697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:38.807697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:38.807697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:38.807697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:38.807697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:38.807697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:38.807697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:38.807697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:38.807697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 425/865] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:38.812517 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b638f-a4c5-4907-8be9-ab8b7b174f24 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:38.907776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e027b20-6c65-48d6-9aa6-e29e3e1d8277 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:38.929240 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b638f-a4c5-4907-8be9-ab8b7b174f24 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:38.941123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:38.952473 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0ac5b-07c2-4ff2-aff6-61ca9e28899c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:38.953299 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0ac5b-07c2-4ff2-aff6-61ca9e28899c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:38.953574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0ac5b-07c2-4ff2-aff6-61ca9e28899c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:38.953871 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0ac5b-07c2-4ff2-aff6-61ca9e28899c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:38.954521 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0ac5b-07c2-4ff2-aff6-61ca9e28899c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:38.956442 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0ac5b-07c2-4ff2-aff6-61ca9e28899c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:38.974286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-3bf0ac5b-07c2-4ff2-aff6-61ca9e28899c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 18:48:38.974286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:38.974286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:38.974286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:38.974286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:38.974286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:38.974286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:38.974286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:38.974286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 18:48:38.974286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:38.974286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:38.974286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:38.974286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:38.974286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:38.974286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:38.974286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:38.975272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:38.975272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:38.975272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:38.975272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:38.975272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:38.975272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:38.975272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:38.975272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:38.975272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:38.975272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:38.975272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:38.975272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:38.975272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:38.975272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:38.975272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:38.975272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:38.976140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:38.976140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:38.976140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:38.976140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:38.976140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:38.976140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:38.976140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:38.976140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:38.976140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:38.976140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:38.976140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:38.976140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:38.976140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:38.976140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 18:48:38.976140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:38.977617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba41cf6-0477-41b1-a38a-fcbd27ea8002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:38.978609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba41cf6-0477-41b1-a38a-fcbd27ea8002 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:38.979098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba41cf6-0477-41b1-a38a-fcbd27ea8002 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:38.979562 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba41cf6-0477-41b1-a38a-fcbd27ea8002 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:38.980571 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 441/866] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Jun 2 18:48:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:38.981050 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba41cf6-0477-41b1-a38a-fcbd27ea8002 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:38.981554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba41cf6-0477-41b1-a38a-fcbd27ea8002 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:38.981679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0ac5b-07c2-4ff2-aff6-61ca9e28899c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:38.983582 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba41cf6-0477-41b1-a38a-fcbd27ea8002 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:38.998385 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 426/867] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:39.004282 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba41cf6-0477-41b1-a38a-fcbd27ea8002 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:39.028971 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:39.092973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0ac5b-07c2-4ff2-aff6-61ca9e28899c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:39.114642 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba41cf6-0477-41b1-a38a-fcbd27ea8002 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:39.129974 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d39e2-ae21-4d75-b2cd-4df2fc3bb878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:39.130891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d39e2-ae21-4d75-b2cd-4df2fc3bb878 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:39.131262 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d39e2-ae21-4d75-b2cd-4df2fc3bb878 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:39.131649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d39e2-ae21-4d75-b2cd-4df2fc3bb878 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:39.132446 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d39e2-ae21-4d75-b2cd-4df2fc3bb878 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:39.132843 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d39e2-ae21-4d75-b2cd-4df2fc3bb878 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:39.134489 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d39e2-ae21-4d75-b2cd-4df2fc3bb878 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:39.144237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 442/868] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 2 18:48:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:39.145212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d39e2-ae21-4d75-b2cd-4df2fc3bb878 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:39.156383 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8575972-06c2-426d-aa88-f7bb7910d74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:39.157232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8575972-06c2-426d-aa88-f7bb7910d74b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:39.157997 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8575972-06c2-426d-aa88-f7bb7910d74b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:39.158215 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8575972-06c2-426d-aa88-f7bb7910d74b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:39.159366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8575972-06c2-426d-aa88-f7bb7910d74b None admin] RBAC: Adding query filter params (role.id=8560bac1acf74dce81ea6a76f751b641, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=b4faac48f82244bebf039aab92898617) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:39.159683 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8575972-06c2-426d-aa88-f7bb7910d74b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:39.161429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8575972-06c2-426d-aa88-f7bb7910d74b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:39.174049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 427/869] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:48:39 2022] GET /identity/v3/role_assignments?user.id=b4faac48f82244bebf039aab92898617&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:39.217940 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:39.269940 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d39e2-ae21-4d75-b2cd-4df2fc3bb878 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:39.306722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b00931-51ad-43c1-ad29-e2c565b22ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:39.307407 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b00931-51ad-43c1-ad29-e2c565b22ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:39.307680 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b00931-51ad-43c1-ad29-e2c565b22ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:39.308260 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b00931-51ad-43c1-ad29-e2c565b22ed6 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:39.308763 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b00931-51ad-43c1-ad29-e2c565b22ed6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:39.309064 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b00931-51ad-43c1-ad29-e2c565b22ed6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:39.310518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b00931-51ad-43c1-ad29-e2c565b22ed6 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:39.316105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 443/870] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 2 18:48:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:39.751761 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d9dc5-e7e4-4d17-9aca-7a79dbed6df2 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:39.752346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d9dc5-e7e4-4d17-9aca-7a79dbed6df2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:39.752346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d9dc5-e7e4-4d17-9aca-7a79dbed6df2 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:39.754052 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 428/871] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:39.760192 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a7649-0c68-4140-84e9-12720e4d9efe None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:39.760716 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a7649-0c68-4140-84e9-12720e4d9efe None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:39.760822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a7649-0c68-4140-84e9-12720e4d9efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:39.778306 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-1f7a7649-0c68-4140-84e9-12720e4d9efe None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:39.779495 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1f7a7649-0c68-4140-84e9-12720e4d9efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:39.848323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 444/872] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:48:39.871262 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d9dc5-e7e4-4d17-9aca-7a79dbed6df2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:39.964450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:39.981527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d9dc5-e7e4-4d17-9aca-7a79dbed6df2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:40.014150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f145d-f096-46b3-82d7-872854770cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:40.014830 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f145d-f096-46b3-82d7-872854770cf6 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:40.015107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f145d-f096-46b3-82d7-872854770cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:40.015378 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f145d-f096-46b3-82d7-872854770cf6 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:40.016121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f145d-f096-46b3-82d7-872854770cf6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:40.017512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f145d-f096-46b3-82d7-872854770cf6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:40.037441 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 429/873] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 2 18:48:39 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:48:40.892184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd236d-20f5-4bb5-ac7a-02530157a86f None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:40.892757 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd236d-20f5-4bb5-ac7a-02530157a86f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:40.892757 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd236d-20f5-4bb5-ac7a-02530157a86f None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:40.894392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 445/874] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:40.899984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11636d5-ce70-4030-b6fd-d8be3dd039a5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:40.900428 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11636d5-ce70-4030-b6fd-d8be3dd039a5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:40.900604 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11636d5-ce70-4030-b6fd-d8be3dd039a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:40.917521 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f11636d5-ce70-4030-b6fd-d8be3dd039a5 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:40.918760 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f11636d5-ce70-4030-b6fd-d8be3dd039a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:40.992108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 430/875] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:40 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:41.015379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd236d-20f5-4bb5-ac7a-02530157a86f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:41.068253 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:41.122710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd236d-20f5-4bb5-ac7a-02530157a86f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:41.158294 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99754a-9bbb-4a90-b26a-b9b0713dcbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:41.159044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99754a-9bbb-4a90-b26a-b9b0713dcbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:41.159326 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99754a-9bbb-4a90-b26a-b9b0713dcbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:41.159601 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99754a-9bbb-4a90-b26a-b9b0713dcbb3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:41.170605 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99754a-9bbb-4a90-b26a-b9b0713dcbb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:41.178793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-fa99754a-9bbb-4a90-b26a-b9b0713dcbb3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 18:48:41.178793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:41.178793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:41.178793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:41.178793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:41.178793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:41.178793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:41.178793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:41.178793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:41.178793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:41.178793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:41.178793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:41.178793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:41.178793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:41.178793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:41.178793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:41.179901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:41.179901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:41.179901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:41.179901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:41.179901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:41.179901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:41.179901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:41.179901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:41.179901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:41.179901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:41.179901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:41.179901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:41.179901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:41.179901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:41.179901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:41.179901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:41.180904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:41.180904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:41.180904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:41.180904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:41.180904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:41.180904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:41.180904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:41.180904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:41.180904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:41.180904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:41.180904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 18:48:41.180904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:41.180904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 446/876] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Jun 2 18:48:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:41.186595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11636d5-ce70-4030-b6fd-d8be3dd039a5 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:41.272616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:41.304585 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11636d5-ce70-4030-b6fd-d8be3dd039a5 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:41.341279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86262682-68e3-4d55-99db-e6b42582efc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:41.342020 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86262682-68e3-4d55-99db-e6b42582efc6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:41.342302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86262682-68e3-4d55-99db-e6b42582efc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:41.342577 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86262682-68e3-4d55-99db-e6b42582efc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:41.343348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86262682-68e3-4d55-99db-e6b42582efc6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:41.343654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86262682-68e3-4d55-99db-e6b42582efc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:41.345081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86262682-68e3-4d55-99db-e6b42582efc6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:41.355336 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 431/877] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jun 2 18:48:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:41.360599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99754a-9bbb-4a90-b26a-b9b0713dcbb3 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:41.466414 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99754a-9bbb-4a90-b26a-b9b0713dcbb3 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:41.475548 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:41.505789 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc5aad-d1cf-4c3b-b2c1-c5c5037f1906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:41.506617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc5aad-d1cf-4c3b-b2c1-c5c5037f1906 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:41.506896 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc5aad-d1cf-4c3b-b2c1-c5c5037f1906 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:41.507168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc5aad-d1cf-4c3b-b2c1-c5c5037f1906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:41.520149 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc5aad-d1cf-4c3b-b2c1-c5c5037f1906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:41.522471 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc5aad-d1cf-4c3b-b2c1-c5c5037f1906 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:41.539504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-45cc5aad-d1cf-4c3b-b2c1-c5c5037f1906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:41.539504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:41.539504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:41.539504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:41.539504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:41.539504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:41.539504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:41.539504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:41.539504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:41.539504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:41.539504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:41.539504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:41.539504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:41.539504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:41.539504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:41.540401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:41.540401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:41.540401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:41.540401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:41.540401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:41.540401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:41.540401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:41.540401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:41.540401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:41.540401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:41.540401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:41.540401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:41.540401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:41.540401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:41.540401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:41.540401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:41.540401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:41.541296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:41.541296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:41.541296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:41.541296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:41.541296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 447/878] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:41.546950 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86262682-68e3-4d55-99db-e6b42582efc6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:41.558755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772bdbd-3924-4a30-ac8b-1df73e95faa3 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:41.559033 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772bdbd-3924-4a30-ac8b-1df73e95faa3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:41.559313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772bdbd-3924-4a30-ac8b-1df73e95faa3 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:41.560676 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 448/879] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:48:41.565702 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023d2d4-fbd4-4391-b92d-d34c5a857997 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:41.566020 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023d2d4-fbd4-4391-b92d-d34c5a857997 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:41.566295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023d2d4-fbd4-4391-b92d-d34c5a857997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:41.587295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a023d2d4-fbd4-4391-b92d-d34c5a857997 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:41.588481 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a023d2d4-fbd4-4391-b92d-d34c5a857997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:41.655834 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86262682-68e3-4d55-99db-e6b42582efc6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:41.669887 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 449/880] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:41 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:41.691786 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:41.692327 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023d2d4-fbd4-4391-b92d-d34c5a857997 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:41.698519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c47fa-05ac-4102-8ea8-7758f76d1121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:41.699909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c47fa-05ac-4102-8ea8-7758f76d1121 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:41.700417 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c47fa-05ac-4102-8ea8-7758f76d1121 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:41.700889 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c47fa-05ac-4102-8ea8-7758f76d1121 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:41.701831 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c47fa-05ac-4102-8ea8-7758f76d1121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:41.702311 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c47fa-05ac-4102-8ea8-7758f76d1121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:41.703969 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c47fa-05ac-4102-8ea8-7758f76d1121 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:41.718634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 432/881] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:41.719947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fa2ce-db26-46ea-a194-5149d5269736 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:41.720232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fa2ce-db26-46ea-a194-5149d5269736 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:41.720502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fa2ce-db26-46ea-a194-5149d5269736 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:41.721856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 433/882] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:41.723704 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fa2ce-db26-46ea-a194-5149d5269736 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:41.797757 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:41.809857 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023d2d4-fbd4-4391-b92d-d34c5a857997 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:41.828502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fa2ce-db26-46ea-a194-5149d5269736 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:41.846339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1eb2c8-f711-4e23-be23-5cbef99c1093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:41.847457 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1eb2c8-f711-4e23-be23-5cbef99c1093 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:41.847931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1eb2c8-f711-4e23-be23-5cbef99c1093 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:41.848430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1eb2c8-f711-4e23-be23-5cbef99c1093 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:41.849281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1eb2c8-f711-4e23-be23-5cbef99c1093 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:41.850890 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1eb2c8-f711-4e23-be23-5cbef99c1093 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:41.863453 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b82d1f-5a0a-4d64-ae07-a8933283e588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:41.864196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-0f1eb2c8-f711-4e23-be23-5cbef99c1093 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 18:48:41.864196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:41.864196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:41.864196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:41.864196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:41.864196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:41.864196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:41.864196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:41.864196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 18:48:41.864196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:41.864196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:41.864196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:41.864196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:41.864196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:41.864196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:41.864196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:41.864196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:41.865152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:41.865152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:41.865152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:41.865152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:41.865152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:41.865152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:41.865152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:41.865152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:41.865152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:41.865152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:41.865152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:41.865152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:41.865152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:41.865152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:41.865152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:41.865152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:41.866141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:41.866141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:41.866141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:41.866141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:41.866141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:41.866141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:41.866141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:41.866141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:41.866141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:41.866141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:41.866141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:41.866141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:41.866141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 18:48:41.866141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:41.867003 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b82d1f-5a0a-4d64-ae07-a8933283e588 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:41.867003 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b82d1f-5a0a-4d64-ae07-a8933283e588 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:41.867003 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b82d1f-5a0a-4d64-ae07-a8933283e588 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:41.868809 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 450/883] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 2 18:48:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:41.870322 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cb836-3ba7-4bef-b5d5-5cb0b3146c27 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:41.870733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cb836-3ba7-4bef-b5d5-5cb0b3146c27 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:41.871128 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cb836-3ba7-4bef-b5d5-5cb0b3146c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:41.874712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b82d1f-5a0a-4d64-ae07-a8933283e588 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:41.876161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b82d1f-5a0a-4d64-ae07-a8933283e588 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:41.889517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d85cb836-3ba7-4bef-b5d5-5cb0b3146c27 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:41.890928 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d85cb836-3ba7-4bef-b5d5-5cb0b3146c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:41.891876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-70b82d1f-5a0a-4d64-ae07-a8933283e588 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 18:48:41.891876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:41.891876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:41.891876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:41.891876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:41.891876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:41.891876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:41.891876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:41.891876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:41.891876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:41.891876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:41.891876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:41.891876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:41.891876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:41.891876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:41.891876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:41.892959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:41.892959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:41.892959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:41.892959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:41.892959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:41.892959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:41.892959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:41.892959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:41.892959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:41.892959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:41.892959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:41.892959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:41.892959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:41.892959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:41.892959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:41.892959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:41.892959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:41.892959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:41.894036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:41.894036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:41.894036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:41.894036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:41.894036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:41.894036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:41.894036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:41.894036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:41.894036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 18:48:41.894036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:41.894036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 434/884] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 2 18:48:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:41.894610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b82d1f-5a0a-4d64-ae07-a8933283e588 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:41.950671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:41.974039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 451/885] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:41 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:41.974039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cb836-3ba7-4bef-b5d5-5cb0b3146c27 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:42.010468 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b82d1f-5a0a-4d64-ae07-a8933283e588 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:42.046809 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912b960-06fb-4430-9ba4-49ac6b204ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:42.047820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912b960-06fb-4430-9ba4-49ac6b204ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:42.048102 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912b960-06fb-4430-9ba4-49ac6b204ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:42.048370 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912b960-06fb-4430-9ba4-49ac6b204ab0 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:42.049077 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912b960-06fb-4430-9ba4-49ac6b204ab0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:42.049381 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912b960-06fb-4430-9ba4-49ac6b204ab0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:42.050807 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912b960-06fb-4430-9ba4-49ac6b204ab0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:42.055813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 435/886] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 2 18:48:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:42.056589 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912b960-06fb-4430-9ba4-49ac6b204ab0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:42.070228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:42.088751 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cb836-3ba7-4bef-b5d5-5cb0b3146c27 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:42.128209 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc1b5a-5f96-46bd-8661-0761629901b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:42.129091 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc1b5a-5f96-46bd-8661-0761629901b3 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:42.129354 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc1b5a-5f96-46bd-8661-0761629901b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:42.129624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc1b5a-5f96-46bd-8661-0761629901b3 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:42.130514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc1b5a-5f96-46bd-8661-0761629901b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:42.130888 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc1b5a-5f96-46bd-8661-0761629901b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:42.132416 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc1b5a-5f96-46bd-8661-0761629901b3 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:42.150319 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 452/887] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Jun 2 18:48:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:42.151370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc1b5a-5f96-46bd-8661-0761629901b3 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:42.168630 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912b960-06fb-4430-9ba4-49ac6b204ab0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:42.187891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:42.208662 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127bef0-9c03-4990-a2a0-15634b02d333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:42.209492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127bef0-9c03-4990-a2a0-15634b02d333 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:42.209775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127bef0-9c03-4990-a2a0-15634b02d333 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:42.210106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127bef0-9c03-4990-a2a0-15634b02d333 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:42.210838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127bef0-9c03-4990-a2a0-15634b02d333 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:42.212240 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127bef0-9c03-4990-a2a0-15634b02d333 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:42.228728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 436/888] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 2 18:48:42 2022] POST /identity/v3/services => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:48:42.239848 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127bef0-9c03-4990-a2a0-15634b02d333 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:42.262993 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc1b5a-5f96-46bd-8661-0761629901b3 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:42.312552 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a7c31-9a7a-44c2-9c08-6b7c8deb3a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:42.313911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a7c31-9a7a-44c2-9c08-6b7c8deb3a2d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:42.314903 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a7c31-9a7a-44c2-9c08-6b7c8deb3a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:42.315410 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a7c31-9a7a-44c2-9c08-6b7c8deb3a2d None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:42.316590 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a7c31-9a7a-44c2-9c08-6b7c8deb3a2d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:42.317059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a7c31-9a7a-44c2-9c08-6b7c8deb3a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:42.319464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a7c31-9a7a-44c2-9c08-6b7c8deb3a2d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:42.327208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 453/889] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 2 18:48:42 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:42.384104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127bef0-9c03-4990-a2a0-15634b02d333 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:42.426964 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70326e84-2a51-4d56-b915-7dd569131933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:42.427324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18de6c7-da51-43cb-a339-fd1e5552fb8f None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:42.427551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18de6c7-da51-43cb-a339-fd1e5552fb8f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:42.427710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70326e84-2a51-4d56-b915-7dd569131933 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:42.427827 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18de6c7-da51-43cb-a339-fd1e5552fb8f None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:42.427974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70326e84-2a51-4d56-b915-7dd569131933 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:42.428245 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70326e84-2a51-4d56-b915-7dd569131933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:42.429496 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 454/890] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:48:42.435512 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef7f66-2494-471f-bc35-0ef3cf12ae9b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:42.435849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef7f66-2494-471f-bc35-0ef3cf12ae9b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:42.436056 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef7f66-2494-471f-bc35-0ef3cf12ae9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:42.441658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:42.461421 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ddef7f66-2494-471f-bc35-0ef3cf12ae9b None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:42.463118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ddef7f66-2494-471f-bc35-0ef3cf12ae9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:42.487740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:42.517251 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70326e84-2a51-4d56-b915-7dd569131933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:42.521718 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70326e84-2a51-4d56-b915-7dd569131933 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:42.571706 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 455/891] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:42.598347 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef7f66-2494-471f-bc35-0ef3cf12ae9b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:42.648250 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 437/892] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:48:42 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 18:48:42.649764 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70326e84-2a51-4d56-b915-7dd569131933 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:42.722905 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef7f66-2494-471f-bc35-0ef3cf12ae9b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:42.728227 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:42.752714 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70326e84-2a51-4d56-b915-7dd569131933 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:42.758960 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:42.766556 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92206d6-783a-4b9e-8227-c1239adb6808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:42.767613 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92206d6-783a-4b9e-8227-c1239adb6808 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:42.767984 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92206d6-783a-4b9e-8227-c1239adb6808 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:42.768353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92206d6-783a-4b9e-8227-c1239adb6808 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:42.769199 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92206d6-783a-4b9e-8227-c1239adb6808 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:42.770730 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92206d6-783a-4b9e-8227-c1239adb6808 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:42.784577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-a92206d6-783a-4b9e-8227-c1239adb6808 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 18:48:42.784577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:42.784577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:42.784577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:42.784577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:42.784577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:42.784577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:42.784577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:42.784577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 18:48:42.784577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:42.784577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:42.784577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:42.784577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:42.784577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:42.784577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:42.784577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:42.784577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:42.785698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:42.785698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:42.785698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:42.785698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:42.785698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:42.785698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:42.785698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:42.785698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:42.785698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:42.785698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:42.785698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:42.785698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:42.785698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:42.785698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:42.785698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:42.785698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:42.786574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:42.786574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:42.786574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:42.786574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:42.786574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:42.786574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:42.786574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:42.786574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:42.786574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:42.786574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:42.786574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:42.786574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:42.786574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 18:48:42.786574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:42.791662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 456/893] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:48:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:42.793630 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92206d6-783a-4b9e-8227-c1239adb6808 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:42.795800 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39630117-02a4-4305-b49e-0aaeb82a3ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:42.796849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39630117-02a4-4305-b49e-0aaeb82a3ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:42.797314 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39630117-02a4-4305-b49e-0aaeb82a3ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:42.797752 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39630117-02a4-4305-b49e-0aaeb82a3ae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:42.808811 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39630117-02a4-4305-b49e-0aaeb82a3ae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:42.810640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39630117-02a4-4305-b49e-0aaeb82a3ae3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:42.828952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-39630117-02a4-4305-b49e-0aaeb82a3ae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:42.828952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:42.828952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:42.828952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:42.828952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:42.828952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:42.828952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:42.828952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:42.828952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:42.828952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:42.828952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:42.828952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:42.828952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:42.828952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:42.828952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:42.830011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:42.830011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:42.830011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:42.830011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:42.830011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:42.830011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:42.830011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:42.830011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:42.830011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:42.830011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:42.830011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:42.830011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:42.830011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:42.830011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:42.830011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:42.830011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:42.830011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:42.830888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:42.830888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:42.830888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:42.830888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:42.837829 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 438/894] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:42.841128 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39630117-02a4-4305-b49e-0aaeb82a3ae3 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:42.911716 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92206d6-783a-4b9e-8227-c1239adb6808 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:42.951253 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb2172-39db-4369-9948-a5424acfd293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:42.952026 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb2172-39db-4369-9948-a5424acfd293 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:42.952371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb2172-39db-4369-9948-a5424acfd293 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:42.952737 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb2172-39db-4369-9948-a5424acfd293 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:42.953516 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb2172-39db-4369-9948-a5424acfd293 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:42.953908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb2172-39db-4369-9948-a5424acfd293 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:42.954642 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39630117-02a4-4305-b49e-0aaeb82a3ae3 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:42.955434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb2172-39db-4369-9948-a5424acfd293 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:42.960960 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 457/895] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:48:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:42.967190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb2172-39db-4369-9948-a5424acfd293 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:42.984141 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:42.992922 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dcb60-eb69-4862-8ffa-78796b2143c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:42.993860 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dcb60-eb69-4862-8ffa-78796b2143c0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:42.994335 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dcb60-eb69-4862-8ffa-78796b2143c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:42.994776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dcb60-eb69-4862-8ffa-78796b2143c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:42.995752 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dcb60-eb69-4862-8ffa-78796b2143c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:42.996227 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dcb60-eb69-4862-8ffa-78796b2143c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:42.997869 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dcb60-eb69-4862-8ffa-78796b2143c0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:43.014692 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 439/896] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:43.016304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dcb60-eb69-4862-8ffa-78796b2143c0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:43.038523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:43.086102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb2172-39db-4369-9948-a5424acfd293 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:43.123231 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dcb60-eb69-4862-8ffa-78796b2143c0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:43.124610 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38388452-0cad-4f5b-8946-95fa1ab615c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:43.125865 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38388452-0cad-4f5b-8946-95fa1ab615c7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:43.126260 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38388452-0cad-4f5b-8946-95fa1ab615c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:43.127266 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38388452-0cad-4f5b-8946-95fa1ab615c7 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:43.127376 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38388452-0cad-4f5b-8946-95fa1ab615c7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:43.127734 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38388452-0cad-4f5b-8946-95fa1ab615c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:43.129189 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38388452-0cad-4f5b-8946-95fa1ab615c7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:43.140195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 458/897] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:48:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:43.141330 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38388452-0cad-4f5b-8946-95fa1ab615c7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:43.161956 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d18249-5643-4249-bbb0-fea58db6cd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:43.163230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d18249-5643-4249-bbb0-fea58db6cd2f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:43.163681 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d18249-5643-4249-bbb0-fea58db6cd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:43.164122 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d18249-5643-4249-bbb0-fea58db6cd2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:43.172271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d18249-5643-4249-bbb0-fea58db6cd2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:43.174283 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d18249-5643-4249-bbb0-fea58db6cd2f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:43.190308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-c3d18249-5643-4249-bbb0-fea58db6cd2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:43.190308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:43.190308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:43.190308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:43.190308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:43.190308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:43.190308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:43.190308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:43.190308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:43.190308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:43.190308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:43.190308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:43.190308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:43.190308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:43.190308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:43.191206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:43.191206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:43.191206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:43.191206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:43.191206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:43.191206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:43.191206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:43.191206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:43.191206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:43.191206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:43.191206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:43.191206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:43.191206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:43.191206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:43.191206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:43.191206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:43.191206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:43.192107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:43.192107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:43.192107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:43.192107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:43.192107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:43.192107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:43.192107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:43.192107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:43.199458 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 440/898] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:43.200949 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d18249-5643-4249-bbb0-fea58db6cd2f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:43.253179 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38388452-0cad-4f5b-8946-95fa1ab615c7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:43.255394 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:43.281021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:43.291917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45229ac4-4d64-491e-a467-c574d819916a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:43.293222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45229ac4-4d64-491e-a467-c574d819916a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:43.294086 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45229ac4-4d64-491e-a467-c574d819916a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:43.294385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45229ac4-4d64-491e-a467-c574d819916a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:43.295482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45229ac4-4d64-491e-a467-c574d819916a None admin] RBAC: Adding query filter params (interface=public, service_id=6daf3999516e4876a9accc349a5157a3, region_id=RegionOne) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:43.296154 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45229ac4-4d64-491e-a467-c574d819916a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:43.297884 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45229ac4-4d64-491e-a467-c574d819916a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:43.305964 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 459/899] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jun 2 18:48:43 2022] GET /identity/v3/endpoints?service_id=6daf3999516e4876a9accc349a5157a3&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:43.312077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45229ac4-4d64-491e-a467-c574d819916a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:43.314013 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d18249-5643-4249-bbb0-fea58db6cd2f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:43.350439 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1035ee-4748-4922-a412-23cc29291532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:43.351453 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1035ee-4748-4922-a412-23cc29291532 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:43.351862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1035ee-4748-4922-a412-23cc29291532 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:43.352276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1035ee-4748-4922-a412-23cc29291532 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:43.353245 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1035ee-4748-4922-a412-23cc29291532 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:43.353733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1035ee-4748-4922-a412-23cc29291532 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:43.355428 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1035ee-4748-4922-a412-23cc29291532 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:43.373334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 441/900] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:43.374867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1035ee-4748-4922-a412-23cc29291532 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:43.422578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45229ac4-4d64-491e-a467-c574d819916a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:43.462011 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585df7e-783a-4a01-9abe-459d70e11bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:43.462857 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585df7e-783a-4a01-9abe-459d70e11bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:43.463448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585df7e-783a-4a01-9abe-459d70e11bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:43.463709 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585df7e-783a-4a01-9abe-459d70e11bc7 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:43.465443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585df7e-783a-4a01-9abe-459d70e11bc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:43.467022 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585df7e-783a-4a01-9abe-459d70e11bc7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:43.482245 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 460/901] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jun 2 18:48:43 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 18:48:43.487311 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1035ee-4748-4922-a412-23cc29291532 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:43.499897 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:43.530703 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab007931-4e01-4241-9b26-dd7a09567df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:43.531444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab007931-4e01-4241-9b26-dd7a09567df4 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:43.531661 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab007931-4e01-4241-9b26-dd7a09567df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:43.531937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab007931-4e01-4241-9b26-dd7a09567df4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:43.532780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab007931-4e01-4241-9b26-dd7a09567df4 None admin] RBAC: Adding query filter params (role.id=a1ccf0afb5d6486cac2bf01dc16f56fa, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=23aa142375c54b94ad276d1a4b9031e0) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:43.533087 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab007931-4e01-4241-9b26-dd7a09567df4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:43.534613 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab007931-4e01-4241-9b26-dd7a09567df4 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:43.545951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 442/902] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:48:43 2022] GET /identity/v3/role_assignments?user.id=23aa142375c54b94ad276d1a4b9031e0&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=a1ccf0afb5d6486cac2bf01dc16f56fa => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:44.616450 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e5b7c-c77c-4618-b3e0-81ba496454b5 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:44.616973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e5b7c-c77c-4618-b3e0-81ba496454b5 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:44.616973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e5b7c-c77c-4618-b3e0-81ba496454b5 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:44.618759 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 461/903] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:44.624621 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6243597-1ccc-4be8-b308-bd6a53dd8a24 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:44.625035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6243597-1ccc-4be8-b308-bd6a53dd8a24 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:44.625239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6243597-1ccc-4be8-b308-bd6a53dd8a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:44.642547 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f6243597-1ccc-4be8-b308-bd6a53dd8a24 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:44.643746 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f6243597-1ccc-4be8-b308-bd6a53dd8a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:44.657217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0572e0d-f9ff-470c-8502-c3c1d5a7cc8b None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:44.657539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0572e0d-f9ff-470c-8502-c3c1d5a7cc8b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:44.657770 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0572e0d-f9ff-470c-8502-c3c1d5a7cc8b None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:44.660542 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 462/904] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:48:44.668768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0be8cf-8584-4e4d-a8cb-86e75f447a49 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:44.669117 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0be8cf-8584-4e4d-a8cb-86e75f447a49 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:44.669326 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0be8cf-8584-4e4d-a8cb-86e75f447a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:44.689610 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-7c0be8cf-8584-4e4d-a8cb-86e75f447a49 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:44.690952 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7c0be8cf-8584-4e4d-a8cb-86e75f447a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:44.719470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 443/905] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:44.743167 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6243597-1ccc-4be8-b308-bd6a53dd8a24 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:44.747585 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:44.775203 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 463/906] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:48:44.797471 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0be8cf-8584-4e4d-a8cb-86e75f447a49 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:44.856464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6243597-1ccc-4be8-b308-bd6a53dd8a24 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:44.858221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:44.899147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7662b-98c8-476e-8ed0-226b156a2db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:44.899983 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7662b-98c8-476e-8ed0-226b156a2db2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:44.900267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7662b-98c8-476e-8ed0-226b156a2db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:44.900542 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7662b-98c8-476e-8ed0-226b156a2db2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:44.901198 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7662b-98c8-476e-8ed0-226b156a2db2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:44.903267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7662b-98c8-476e-8ed0-226b156a2db2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:44.914781 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0be8cf-8584-4e4d-a8cb-86e75f447a49 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:44.919579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-2ad7662b-98c8-476e-8ed0-226b156a2db2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 18:48:44.919579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:44.919579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:44.919579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:44.919579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:44.919579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:44.919579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:44.919579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:44.919579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 18:48:44.919579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:44.919579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:44.919579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:44.919579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:44.919579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:44.919579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:44.919579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:44.920753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:44.920753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:44.920753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:44.920753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:44.920753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:44.920753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:44.920753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:44.920753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:44.920753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:44.920753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:44.920753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:44.920753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:44.920753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:44.920753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:44.920753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:44.920753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:44.921650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:44.921650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:44.921650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:44.921650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:44.921650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:44.921650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:44.921650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:44.921650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:44.921650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:44.921650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:44.921650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:44.921650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:44.921650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:44.921650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 18:48:44.921650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:44.921650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 444/907] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Jun 2 18:48:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:44.926821 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7662b-98c8-476e-8ed0-226b156a2db2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:44.957893 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd830747-2e74-4f1d-8cec-d8b01a76c6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:44.958579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd830747-2e74-4f1d-8cec-d8b01a76c6c8 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:44.958862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd830747-2e74-4f1d-8cec-d8b01a76c6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:44.959138 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd830747-2e74-4f1d-8cec-d8b01a76c6c8 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:44.959880 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd830747-2e74-4f1d-8cec-d8b01a76c6c8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:44.961285 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd830747-2e74-4f1d-8cec-d8b01a76c6c8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:44.979483 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 464/908] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 2 18:48:44 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:48:45.058259 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7662b-98c8-476e-8ed0-226b156a2db2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:45.103133 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a9b66-471e-465a-b56a-fdcedb3768f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:45.103815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a9b66-471e-465a-b56a-fdcedb3768f0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:45.104095 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a9b66-471e-465a-b56a-fdcedb3768f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:45.104367 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a9b66-471e-465a-b56a-fdcedb3768f0 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:45.105313 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a9b66-471e-465a-b56a-fdcedb3768f0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:45.105622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a9b66-471e-465a-b56a-fdcedb3768f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:45.107112 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a9b66-471e-465a-b56a-fdcedb3768f0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:45.113135 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 445/909] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 2 18:48:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:45.118867 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd830747-2e74-4f1d-8cec-d8b01a76c6c8 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:45.169175 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:45.233880 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd830747-2e74-4f1d-8cec-d8b01a76c6c8 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:45.276720 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e350a8-b361-43fc-b81b-ae0cde5e7815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:45.277920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e350a8-b361-43fc-b81b-ae0cde5e7815 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:45.278438 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e350a8-b361-43fc-b81b-ae0cde5e7815 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:45.278929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e350a8-b361-43fc-b81b-ae0cde5e7815 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:45.280288 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e350a8-b361-43fc-b81b-ae0cde5e7815 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:45.280821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e350a8-b361-43fc-b81b-ae0cde5e7815 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:45.282627 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e350a8-b361-43fc-b81b-ae0cde5e7815 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:45.288635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 465/910] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 2 18:48:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:45.294721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a9b66-471e-465a-b56a-fdcedb3768f0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:45.325047 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:45.408227 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a9b66-471e-465a-b56a-fdcedb3768f0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:45.443723 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88154e1d-ac0c-4629-957e-4b14b960988f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:45.444390 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88154e1d-ac0c-4629-957e-4b14b960988f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:45.444656 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88154e1d-ac0c-4629-957e-4b14b960988f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:45.444931 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88154e1d-ac0c-4629-957e-4b14b960988f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:45.445723 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88154e1d-ac0c-4629-957e-4b14b960988f None admin] RBAC: Adding query filter params (interface=public, service_id=eeac63ceaac749d7863ed1d2035a38b2, region_id=RegionOne) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:45.446060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88154e1d-ac0c-4629-957e-4b14b960988f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:45.447445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88154e1d-ac0c-4629-957e-4b14b960988f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:45.454878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 446/911] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jun 2 18:48:45 2022] GET /identity/v3/endpoints?service_id=eeac63ceaac749d7863ed1d2035a38b2&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:45.460462 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e350a8-b361-43fc-b81b-ae0cde5e7815 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:45.588355 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e350a8-b361-43fc-b81b-ae0cde5e7815 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:45.595916 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:45.624505 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57448cf4-2c62-4a49-849c-42858316f420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:45.625310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57448cf4-2c62-4a49-849c-42858316f420 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:45.625468 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57448cf4-2c62-4a49-849c-42858316f420 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:45.625699 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57448cf4-2c62-4a49-849c-42858316f420 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:45.626415 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57448cf4-2c62-4a49-849c-42858316f420 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:45.627794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57448cf4-2c62-4a49-849c-42858316f420 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:45.634413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 466/912] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jun 2 18:48:45 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 18:48:45.827769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdd505-75af-4603-b853-43f0aa37eebc None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:45.828696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdd505-75af-4603-b853-43f0aa37eebc None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:45.828977 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdd505-75af-4603-b853-43f0aa37eebc None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:45.830529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 447/913] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:45.836665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d36245-f76c-49e0-a35d-5a0647a7ddad None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:45.837207 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d36245-f76c-49e0-a35d-5a0647a7ddad None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:45.837677 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d36245-f76c-49e0-a35d-5a0647a7ddad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:45.856266 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-61d36245-f76c-49e0-a35d-5a0647a7ddad None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:45.857784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-61d36245-f76c-49e0-a35d-5a0647a7ddad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:45.870519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7632ff-5b73-4f7c-85c0-5c41b95092e7 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:45.870827 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7632ff-5b73-4f7c-85c0-5c41b95092e7 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:45.871066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7632ff-5b73-4f7c-85c0-5c41b95092e7 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:45.872676 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 448/914] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:48:45.877776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a07ce-a666-40bd-8c07-b1a8133eed2e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:45.878084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a07ce-a666-40bd-8c07-b1a8133eed2e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:45.878357 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a07ce-a666-40bd-8c07-b1a8133eed2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:45.901669 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-9c2a07ce-a666-40bd-8c07-b1a8133eed2e None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:45.903454 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9c2a07ce-a666-40bd-8c07-b1a8133eed2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:45.937896 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 467/915] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:48:45.954135 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d36245-f76c-49e0-a35d-5a0647a7ddad None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:45.986683 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 449/916] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:48:46.009513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a07ce-a666-40bd-8c07-b1a8133eed2e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:46.031792 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:46.072146 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:46.077520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d36245-f76c-49e0-a35d-5a0647a7ddad None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:46.114890 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec9926-4c1c-4e4f-9408-41155f098186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:46.115466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a07ce-a666-40bd-8c07-b1a8133eed2e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:46.115863 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec9926-4c1c-4e4f-9408-41155f098186 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:46.116235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec9926-4c1c-4e4f-9408-41155f098186 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:46.116600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec9926-4c1c-4e4f-9408-41155f098186 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:46.128376 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec9926-4c1c-4e4f-9408-41155f098186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:46.137044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-49ec9926-4c1c-4e4f-9408-41155f098186 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 18:48:46.137044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:46.137044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:46.137044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:46.137044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:46.137044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:46.137044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:46.137044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:46.137044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:46.137044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:46.137044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:46.137044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:46.137044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:46.137044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:46.137044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:46.137044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:46.137992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:46.137992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:46.137992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:46.137992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:46.137992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:46.137992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:46.137992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:46.137992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:46.137992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:46.137992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:46.137992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:46.137992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:46.137992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:46.137992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:46.137992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:46.137992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:46.138821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:46.138821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:46.138821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:46.138821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:46.138821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:46.138821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:46.138821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:46.138821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:46.138821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:46.138821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:46.138821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 18:48:46.138821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:46.143396 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 468/917] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Jun 2 18:48:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:46.144724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec9926-4c1c-4e4f-9408-41155f098186 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:46.156950 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109dfde-5061-4e68-a49f-4fb60bddf376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:46.158103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109dfde-5061-4e68-a49f-4fb60bddf376 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:46.158574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109dfde-5061-4e68-a49f-4fb60bddf376 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:46.159031 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109dfde-5061-4e68-a49f-4fb60bddf376 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:46.159868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109dfde-5061-4e68-a49f-4fb60bddf376 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:46.161451 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109dfde-5061-4e68-a49f-4fb60bddf376 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:46.173941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-c109dfde-5061-4e68-a49f-4fb60bddf376 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 18:48:46.173941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:46.173941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:46.173941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:46.173941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:46.173941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:46.173941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:46.173941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:46.173941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 18:48:46.173941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:46.173941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:46.173941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:46.173941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:46.173941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:46.173941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:46.173941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:46.173941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:46.174937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:46.174937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:46.174937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:46.174937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:46.174937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:46.174937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:46.174937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:46.174937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:46.174937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:46.174937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:46.174937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:46.174937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:46.174937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:46.174937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:46.174937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:46.174937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:46.175775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:46.175775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:46.175775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:46.175775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:46.175775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:46.175775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:46.175775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:46.175775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:46.175775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:46.175775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:46.175775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:46.175775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:46.175775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 18:48:46.175775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:46.183253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 450/918] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:48:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:46.184971 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109dfde-5061-4e68-a49f-4fb60bddf376 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:46.257020 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec9926-4c1c-4e4f-9408-41155f098186 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:46.279490 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:46.294745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75152e24-5d79-4532-a4d2-4102de98371c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:46.295679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75152e24-5d79-4532-a4d2-4102de98371c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:46.295679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75152e24-5d79-4532-a4d2-4102de98371c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:46.295964 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75152e24-5d79-4532-a4d2-4102de98371c None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:46.296778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75152e24-5d79-4532-a4d2-4102de98371c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:46.297130 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75152e24-5d79-4532-a4d2-4102de98371c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:46.298498 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75152e24-5d79-4532-a4d2-4102de98371c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:46.299401 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109dfde-5061-4e68-a49f-4fb60bddf376 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:46.312518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 469/919] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jun 2 18:48:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:46.313825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75152e24-5d79-4532-a4d2-4102de98371c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:46.336829 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cce61-cb63-43c8-9be8-161d6ef8b77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:46.338031 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cce61-cb63-43c8-9be8-161d6ef8b77f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:46.338532 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cce61-cb63-43c8-9be8-161d6ef8b77f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:46.339079 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cce61-cb63-43c8-9be8-161d6ef8b77f None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:46.340220 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cce61-cb63-43c8-9be8-161d6ef8b77f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:46.340783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cce61-cb63-43c8-9be8-161d6ef8b77f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:46.341297 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:46.343244 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cce61-cb63-43c8-9be8-161d6ef8b77f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:46.356623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 451/920] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:48:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:46.358762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cce61-cb63-43c8-9be8-161d6ef8b77f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:46.425749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75152e24-5d79-4532-a4d2-4102de98371c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:46.462009 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481b859-701f-4022-b53a-a509e6b27673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:46.462849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481b859-701f-4022-b53a-a509e6b27673 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:46.463126 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481b859-701f-4022-b53a-a509e6b27673 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:46.463393 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481b859-701f-4022-b53a-a509e6b27673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:46.464298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cce61-cb63-43c8-9be8-161d6ef8b77f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:46.475486 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481b859-701f-4022-b53a-a509e6b27673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:46.476980 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481b859-701f-4022-b53a-a509e6b27673 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:46.501285 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966b148-c0ec-4811-a59e-1c23a6ee9809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:46.502391 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966b148-c0ec-4811-a59e-1c23a6ee9809 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:46.502672 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966b148-c0ec-4811-a59e-1c23a6ee9809 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:46.502935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-8481b859-701f-4022-b53a-a509e6b27673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:46.502935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:46.502935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:46.502935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:46.502935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:46.502935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:46.502935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:46.502935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:46.502935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:46.502935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:46.502935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:46.502935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:46.502935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:46.502935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:46.502935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:46.503805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:46.503805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:46.503805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:46.503805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:46.503805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:46.503805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:46.503805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:46.503805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:46.503805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:46.503805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:46.503805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:46.503805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:46.503805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:46.503805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:46.503805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:46.503805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:46.503805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:46.504697 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:46.504697 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:46.504697 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:46.504697 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:46.504919 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966b148-c0ec-4811-a59e-1c23a6ee9809 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:46.504919 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966b148-c0ec-4811-a59e-1c23a6ee9809 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:46.504919 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966b148-c0ec-4811-a59e-1c23a6ee9809 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:46.505534 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966b148-c0ec-4811-a59e-1c23a6ee9809 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:46.507525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 470/921] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:46.513766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481b859-701f-4022-b53a-a509e6b27673 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:46.515215 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 452/922] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 2 18:48:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:46.516033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966b148-c0ec-4811-a59e-1c23a6ee9809 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:46.531118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:46.608524 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:46.617673 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966b148-c0ec-4811-a59e-1c23a6ee9809 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:46.637420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481b859-701f-4022-b53a-a509e6b27673 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:46.651462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fd69f-2430-48d3-b47d-cf7378c26269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:46.652055 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fd69f-2430-48d3-b47d-cf7378c26269 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:46.652508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fd69f-2430-48d3-b47d-cf7378c26269 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:46.652783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fd69f-2430-48d3-b47d-cf7378c26269 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:46.653527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fd69f-2430-48d3-b47d-cf7378c26269 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:46.654926 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fd69f-2430-48d3-b47d-cf7378c26269 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:46.682085 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 453/923] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jun 2 18:48:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:48:46.694698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9272a-f64b-40d0-aa61-57c479b608fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:46.695436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9272a-f64b-40d0-aa61-57c479b608fd None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:46.695764 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9272a-f64b-40d0-aa61-57c479b608fd None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:46.696039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9272a-f64b-40d0-aa61-57c479b608fd None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:46.696824 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9272a-f64b-40d0-aa61-57c479b608fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:46.697131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9272a-f64b-40d0-aa61-57c479b608fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:46.698773 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9272a-f64b-40d0-aa61-57c479b608fd None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:46.717995 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 471/924] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:46.720198 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fd69f-2430-48d3-b47d-cf7378c26269 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:46.795643 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:46.841851 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fd69f-2430-48d3-b47d-cf7378c26269 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:46.880075 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723d7ab-5bd2-403e-a4f0-ea043812ea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:46.880925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723d7ab-5bd2-403e-a4f0-ea043812ea48 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:46.881204 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723d7ab-5bd2-403e-a4f0-ea043812ea48 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:46.881474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723d7ab-5bd2-403e-a4f0-ea043812ea48 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:46.890688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723d7ab-5bd2-403e-a4f0-ea043812ea48 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:46.892177 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723d7ab-5bd2-403e-a4f0-ea043812ea48 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:46.908298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-c723d7ab-5bd2-403e-a4f0-ea043812ea48 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 18:48:46.908298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:46.908298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:46.908298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:46.908298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:46.908298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:46.908298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:46.908298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:46.908298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:46.908298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:46.908298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:46.908298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:46.908298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:46.908298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:46.908298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:46.908298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:46.910502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:46.910502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:46.910502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:46.910502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:46.910502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:46.910502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:46.910502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:46.910502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:46.910502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:46.910502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:46.910502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:46.910502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:46.910502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:46.910502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:46.910502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:46.910502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:46.910502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:46.910502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:46.911805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:46.911805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:46.911805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:46.911805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:46.911805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:46.911805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:46.911805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:46.911805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:46.911805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 18:48:46.911805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:46.911805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 454/925] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 2 18:48:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:46.916012 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9272a-f64b-40d0-aa61-57c479b608fd None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:47.025551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9272a-f64b-40d0-aa61-57c479b608fd None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:47.062974 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:47.070484 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a5911-f655-432c-a43b-353474ce9b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:47.071218 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a5911-f655-432c-a43b-353474ce9b6f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:47.071496 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a5911-f655-432c-a43b-353474ce9b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:47.071762 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a5911-f655-432c-a43b-353474ce9b6f None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:47.072596 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a5911-f655-432c-a43b-353474ce9b6f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:47.072895 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a5911-f655-432c-a43b-353474ce9b6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:47.074864 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a5911-f655-432c-a43b-353474ce9b6f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:47.097594 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 472/926] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Jun 2 18:48:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:47.099019 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723d7ab-5bd2-403e-a4f0-ea043812ea48 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:47.203662 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723d7ab-5bd2-403e-a4f0-ea043812ea48 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:47.231420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:47.239035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f66e0-b1cd-40b9-ac73-4781250fe76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:47.239924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f66e0-b1cd-40b9-ac73-4781250fe76e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:47.240204 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f66e0-b1cd-40b9-ac73-4781250fe76e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:47.240501 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f66e0-b1cd-40b9-ac73-4781250fe76e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:47.252446 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f66e0-b1cd-40b9-ac73-4781250fe76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:47.253928 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f66e0-b1cd-40b9-ac73-4781250fe76e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:47.271187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-a78f66e0-b1cd-40b9-ac73-4781250fe76e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:47.271187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:47.271187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:47.271187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:47.271187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:47.271187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:47.271187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:47.271187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:47.271187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:47.271187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:47.271187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:47.271187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:47.271187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:47.271187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:47.271187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:47.272123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:47.272123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:47.272123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:47.272123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:47.272123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:47.272123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:47.272123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:47.272123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:47.272123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:47.272123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:47.272123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:47.272123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:47.272123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:47.272123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:47.272123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:47.272123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:47.272123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:47.273212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:47.273212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:47.273212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:47.273212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:47.273212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 455/927] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:47.279834 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a5911-f655-432c-a43b-353474ce9b6f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:47.379278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a527cff-e815-460f-bf4f-a3c018985264 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:47.379640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a527cff-e815-460f-bf4f-a3c018985264 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:47.379840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a527cff-e815-460f-bf4f-a3c018985264 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:47.381481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 456/928] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:48:47.386697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386d2af-1eb1-47fb-9951-54c47084bc3f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:47.387001 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386d2af-1eb1-47fb-9951-54c47084bc3f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:47.387249 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386d2af-1eb1-47fb-9951-54c47084bc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:47.388219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a5911-f655-432c-a43b-353474ce9b6f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:47.404126 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8386d2af-1eb1-47fb-9951-54c47084bc3f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:47.405359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8386d2af-1eb1-47fb-9951-54c47084bc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:47.430639 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42485f1b-18c5-4a7a-896a-01251446ff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:47.431568 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42485f1b-18c5-4a7a-896a-01251446ff61 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:47.431843 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42485f1b-18c5-4a7a-896a-01251446ff61 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:47.432336 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42485f1b-18c5-4a7a-896a-01251446ff61 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:47.433124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42485f1b-18c5-4a7a-896a-01251446ff61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:47.433861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42485f1b-18c5-4a7a-896a-01251446ff61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:47.435735 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42485f1b-18c5-4a7a-896a-01251446ff61 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:47.451089 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 473/929] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:47.457154 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42485f1b-18c5-4a7a-896a-01251446ff61 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:47.483183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 457/930] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:48:47.501482 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386d2af-1eb1-47fb-9951-54c47084bc3f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:47.516388 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:47.587219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42485f1b-18c5-4a7a-896a-01251446ff61 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:47.637538 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038bd32-0b27-4039-877a-b241946c41f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:47.639412 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038bd32-0b27-4039-877a-b241946c41f4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:47.640098 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038bd32-0b27-4039-877a-b241946c41f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:47.640551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038bd32-0b27-4039-877a-b241946c41f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:47.644288 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386d2af-1eb1-47fb-9951-54c47084bc3f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:47.650514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038bd32-0b27-4039-877a-b241946c41f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:47.652349 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038bd32-0b27-4039-877a-b241946c41f4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:47.658112 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:47.673382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-7038bd32-0b27-4039-877a-b241946c41f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:47.673382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:47.673382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:47.673382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:47.673382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:47.673382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:47.673382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:47.673382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:47.673382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:47.673382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:47.673382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:47.673382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:47.673382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:47.673382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:47.673382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:47.674395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:47.674395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:47.674395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:47.674395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:47.674395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:47.674395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:47.674395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:47.674395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:47.674395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:47.674395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:47.674395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:47.674395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:47.674395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:47.674395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:47.674395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:47.674395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:47.674395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:47.675303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:47.675303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:47.675303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:47.675303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:47.675303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:47.675303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:47.675303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:47.675303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:47.678055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 474/931] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:47.683494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038bd32-0b27-4039-877a-b241946c41f4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:47.690192 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f538767-e7ed-44a5-8989-bbcfea0021ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:47.691013 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f538767-e7ed-44a5-8989-bbcfea0021ec None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:47.691285 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f538767-e7ed-44a5-8989-bbcfea0021ec None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:47.691549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f538767-e7ed-44a5-8989-bbcfea0021ec None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:47.692197 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f538767-e7ed-44a5-8989-bbcfea0021ec None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:47.693569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f538767-e7ed-44a5-8989-bbcfea0021ec None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:47.706531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-7f538767-e7ed-44a5-8989-bbcfea0021ec None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 18:48:47.706531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:47.706531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:47.706531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:47.706531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:47.706531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:47.706531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:47.706531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:47.706531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 18:48:47.706531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:47.706531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:47.706531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:47.706531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:47.706531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:47.706531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:47.706531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:47.706531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:47.707990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:47.707990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:47.707990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:47.707990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:47.707990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:47.707990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:47.707990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:47.707990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:47.707990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:47.707990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:47.707990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:47.707990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:47.707990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:47.707990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:47.707990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:47.707990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:47.709326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:47.709326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:47.709326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:47.709326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:47.709326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:47.709326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:47.709326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:47.709326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:47.709326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:47.709326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:47.709326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:47.709326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:47.709326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 18:48:47.709326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:47.709326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 458/932] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 2 18:48:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:47.714822 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f538767-e7ed-44a5-8989-bbcfea0021ec None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:47.830912 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038bd32-0b27-4039-877a-b241946c41f4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:47.838853 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f538767-e7ed-44a5-8989-bbcfea0021ec None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:47.848363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:47.879639 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0420748-b1fb-4b7c-b237-aaa815c77237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:47.880709 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0420748-b1fb-4b7c-b237-aaa815c77237 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:47.881088 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0420748-b1fb-4b7c-b237-aaa815c77237 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:47.881450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0420748-b1fb-4b7c-b237-aaa815c77237 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:47.882312 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0420748-b1fb-4b7c-b237-aaa815c77237 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:47.882707 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0420748-b1fb-4b7c-b237-aaa815c77237 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:47.884165 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0420748-b1fb-4b7c-b237-aaa815c77237 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:47.885706 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dcef5-e07e-41f1-82b5-b2704da58767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:47.887084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dcef5-e07e-41f1-82b5-b2704da58767 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:47.887524 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dcef5-e07e-41f1-82b5-b2704da58767 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:47.888208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dcef5-e07e-41f1-82b5-b2704da58767 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:47.889146 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dcef5-e07e-41f1-82b5-b2704da58767 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:47.889600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dcef5-e07e-41f1-82b5-b2704da58767 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:47.890170 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 459/933] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 2 18:48:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:47.891595 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dcef5-e07e-41f1-82b5-b2704da58767 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:47.897847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0420748-b1fb-4b7c-b237-aaa815c77237 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:47.913742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 475/934] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:47.916423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dcef5-e07e-41f1-82b5-b2704da58767 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:47.945973 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:48.015892 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0420748-b1fb-4b7c-b237-aaa815c77237 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:48.027729 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dcef5-e07e-41f1-82b5-b2704da58767 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:48.052996 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fbb22-0f33-4fd9-8035-edf8cd44f54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:48.053734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fbb22-0f33-4fd9-8035-edf8cd44f54b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:48.054043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fbb22-0f33-4fd9-8035-edf8cd44f54b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:48.054320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fbb22-0f33-4fd9-8035-edf8cd44f54b None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:48.055043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fbb22-0f33-4fd9-8035-edf8cd44f54b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:48.055347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fbb22-0f33-4fd9-8035-edf8cd44f54b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:48.056726 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fbb22-0f33-4fd9-8035-edf8cd44f54b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:48.061751 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 460/935] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 2 18:48:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:48.063021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cabef-2bf6-4343-b06a-982e497bdcf7 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:48.063304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cabef-2bf6-4343-b06a-982e497bdcf7 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:48.063575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cabef-2bf6-4343-b06a-982e497bdcf7 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:48.064969 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 461/936] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:48.069590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cabef-2bf6-4343-b06a-982e497bdcf7 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:48.072288 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea9df6-66ed-4521-b443-7fd99de55e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:48.074542 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea9df6-66ed-4521-b443-7fd99de55e9d None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:48.074825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea9df6-66ed-4521-b443-7fd99de55e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:48.075103 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea9df6-66ed-4521-b443-7fd99de55e9d None admin] PATH_INFO: `/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/23aa142375c54b94ad276d1a4b9031e0/roles/a1ccf0afb5d6486cac2bf01dc16f56fa` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:48.077386 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea9df6-66ed-4521-b443-7fd99de55e9d None admin] RBAC: Authorizing `identity:create_grant(project_id=3a3d8f5b51ff4201b3968c9173ae06a7, user_id=23aa142375c54b94ad276d1a4b9031e0, role_id=a1ccf0afb5d6486cac2bf01dc16f56fa)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:48.079020 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea9df6-66ed-4521-b443-7fd99de55e9d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:48.101991 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 476/937] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:48:47 2022] PUT /identity/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/23aa142375c54b94ad276d1a4b9031e0/roles/a1ccf0afb5d6486cac2bf01dc16f56fa => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:48:48.104851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a3d4b-b0f3-4818-ae2b-e1897f7805d3 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:48.105379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a3d4b-b0f3-4818-ae2b-e1897f7805d3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:48.105897 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a3d4b-b0f3-4818-ae2b-e1897f7805d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:48.125752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-334a3d4b-b0f3-4818-ae2b-e1897f7805d3 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:48.127306 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-334a3d4b-b0f3-4818-ae2b-e1897f7805d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:48.154266 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:48.183903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cabef-2bf6-4343-b06a-982e497bdcf7 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:48.207575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:48.208145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 477/938] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:48.228477 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168da7f6-b216-46f3-aee3-e3ce5f3b5d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:48.229373 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168da7f6-b216-46f3-aee3-e3ce5f3b5d72 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:48.230328 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168da7f6-b216-46f3-aee3-e3ce5f3b5d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:48.230787 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168da7f6-b216-46f3-aee3-e3ce5f3b5d72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:48.231846 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168da7f6-b216-46f3-aee3-e3ce5f3b5d72 None admin] RBAC: Adding query filter params (interface=public, service_id=21cf923f42064ef797cb5b38aaaf0637, region_id=RegionOne) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:48.232008 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a3d4b-b0f3-4818-ae2b-e1897f7805d3 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:48.232357 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168da7f6-b216-46f3-aee3-e3ce5f3b5d72 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:48.233924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168da7f6-b216-46f3-aee3-e3ce5f3b5d72 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:48.240315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 462/939] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jun 2 18:48:48 2022] GET /identity/v3/endpoints?service_id=21cf923f42064ef797cb5b38aaaf0637&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:48.246002 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168da7f6-b216-46f3-aee3-e3ce5f3b5d72 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:48.345465 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a3d4b-b0f3-4818-ae2b-e1897f7805d3 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:48.358970 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168da7f6-b216-46f3-aee3-e3ce5f3b5d72 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:48.385815 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b6842-f5a4-47d3-82e2-6d0c0479d4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:48.386915 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b6842-f5a4-47d3-82e2-6d0c0479d4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:48.387272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b6842-f5a4-47d3-82e2-6d0c0479d4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:48.387639 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b6842-f5a4-47d3-82e2-6d0c0479d4e7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:48.388393 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b6842-f5a4-47d3-82e2-6d0c0479d4e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:48.389929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b6842-f5a4-47d3-82e2-6d0c0479d4e7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:48.400335 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df0dcf-9a7c-4e12-a398-ee4524dabc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:48.401244 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df0dcf-9a7c-4e12-a398-ee4524dabc30 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:48.401729 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df0dcf-9a7c-4e12-a398-ee4524dabc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:48.402161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df0dcf-9a7c-4e12-a398-ee4524dabc30 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:48.402975 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df0dcf-9a7c-4e12-a398-ee4524dabc30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:48.404484 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df0dcf-9a7c-4e12-a398-ee4524dabc30 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:48.406447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-8f9b6842-f5a4-47d3-82e2-6d0c0479d4e7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 18:48:48.406447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:48.406447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:48.406447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:48.406447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:48.406447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:48.406447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:48.406447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:48.406447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 18:48:48.406447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:48.406447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:48.406447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:48.406447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:48.406447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:48.406447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:48.406447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:48.407527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:48.407527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:48.407527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:48.407527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:48.407527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:48.407527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:48.407527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:48.407527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:48.407527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:48.407527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:48.407527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:48.407527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:48.407527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:48.407527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:48.407527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:48.407527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:48.408533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:48.408533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:48.408533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:48.408533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:48.408533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:48.408533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:48.408533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:48.408533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:48.408533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:48.408533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:48.408533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:48.408533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:48.408533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:48.408533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 18:48:48.408533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:48.410787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 478/940] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Jun 2 18:48:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:48.414527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 463/941] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jun 2 18:48:48 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 18:48:48.421965 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b6842-f5a4-47d3-82e2-6d0c0479d4e7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:48.451204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:48.540883 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b6842-f5a4-47d3-82e2-6d0c0479d4e7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:48.577685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e54df2-d8f2-45ae-ab90-91d9e161c23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:48.578770 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e54df2-d8f2-45ae-ab90-91d9e161c23d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:48.579225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e54df2-d8f2-45ae-ab90-91d9e161c23d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:48.579670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e54df2-d8f2-45ae-ab90-91d9e161c23d None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:48.580731 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e54df2-d8f2-45ae-ab90-91d9e161c23d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:48.581214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e54df2-d8f2-45ae-ab90-91d9e161c23d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:48.583158 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e54df2-d8f2-45ae-ab90-91d9e161c23d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:48.589239 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 479/942] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 2 18:48:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:48.595478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df0dcf-9a7c-4e12-a398-ee4524dabc30 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:48.635170 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:48.710574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df0dcf-9a7c-4e12-a398-ee4524dabc30 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:48.745399 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363eb7b-15d8-4000-9cf7-25d109c4fcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:48.746114 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363eb7b-15d8-4000-9cf7-25d109c4fcb3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:48.746396 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363eb7b-15d8-4000-9cf7-25d109c4fcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:48.746668 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363eb7b-15d8-4000-9cf7-25d109c4fcb3 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:48.747431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363eb7b-15d8-4000-9cf7-25d109c4fcb3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:48.747739 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363eb7b-15d8-4000-9cf7-25d109c4fcb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:48.749128 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363eb7b-15d8-4000-9cf7-25d109c4fcb3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:48.754728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 464/943] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 2 18:48:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:48.760304 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e54df2-d8f2-45ae-ab90-91d9e161c23d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:48.852130 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:48.868997 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e54df2-d8f2-45ae-ab90-91d9e161c23d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:48.904337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8515b9a-47e3-4383-86c3-dad7ec444f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:48.905370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8515b9a-47e3-4383-86c3-dad7ec444f85 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:48.905930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8515b9a-47e3-4383-86c3-dad7ec444f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:48.906423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8515b9a-47e3-4383-86c3-dad7ec444f85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:48.907375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8515b9a-47e3-4383-86c3-dad7ec444f85 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:48.908965 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8515b9a-47e3-4383-86c3-dad7ec444f85 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:48.935086 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 480/944] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jun 2 18:48:48 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:48:49.178489 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e845ded-1348-4e23-b5b6-33f8e453b745 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:49.179010 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e845ded-1348-4e23-b5b6-33f8e453b745 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:49.179010 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e845ded-1348-4e23-b5b6-33f8e453b745 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:49.180582 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 465/945] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:49.186149 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802795b3-3512-42ac-b88e-681a41dae374 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:49.186434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802795b3-3512-42ac-b88e-681a41dae374 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:49.186706 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802795b3-3512-42ac-b88e-681a41dae374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:49.208017 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-802795b3-3512-42ac-b88e-681a41dae374 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:49.209519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-802795b3-3512-42ac-b88e-681a41dae374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:49.289371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 481/946] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:49.319130 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e845ded-1348-4e23-b5b6-33f8e453b745 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:49.428754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:49.437045 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e845ded-1348-4e23-b5b6-33f8e453b745 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:49.474095 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fd6d7-fc82-4ab6-961e-c482bda8ac9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:49.474774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fd6d7-fc82-4ab6-961e-c482bda8ac9f None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:49.475052 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fd6d7-fc82-4ab6-961e-c482bda8ac9f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:49.475326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fd6d7-fc82-4ab6-961e-c482bda8ac9f None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:49.476041 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516fd6d7-fc82-4ab6-961e-c482bda8ac9f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:49.477486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516fd6d7-fc82-4ab6-961e-c482bda8ac9f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:49.478884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: WARNING keystone.server.flask.common [None req-516fd6d7-fc82-4ab6-961e-c482bda8ac9f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 18:48:49.498847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.sql.core [None req-516fd6d7-fc82-4ab6-961e-c482bda8ac9f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 18:48:49.498847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 18:48:49.498847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [parameters: {'id': 'd43b9d07904f40b2b6ed3566f1deeb4d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 18:48:49.498847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80259) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 18:48:49.516234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-516fd6d7-fc82-4ab6-961e-c482bda8ac9f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d43b9d07904f40b2b6ed3566f1deeb4d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d43b9d07904f40b2b6ed3566f1deeb4d. Jun 02 18:48:49.516234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:49.516234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 18:48:49.516234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 18:48:49.516234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 18:48:49.516234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 18:48:49.516234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 18:48:49.516234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 18:48:49.516234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 18:48:49.516234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application conn.query(q) Jun 02 18:48:49.516234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 18:48:49.516234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 18:48:49.516234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 18:48:49.517109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application result.read() Jun 02 18:48:49.517109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 18:48:49.517109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 18:48:49.517109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 18:48:49.517109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 18:48:49.517109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 18:48:49.517109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 18:48:49.517109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 18:48:49.517109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 18:48:49.517109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 18:48:49.517109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:49.517109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 18:48:49.517109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:49.517109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:49.517109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 18:48:49.517109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 18:48:49.517109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 02 18:48:49.517109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 02 18:48:49.518081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 18:48:49.518081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application next(self.gen) Jun 02 18:48:49.518081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 18:48:49.518081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application yield resource Jun 02 18:48:49.518081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 18:48:49.518081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application next(self.gen) Jun 02 18:48:49.518081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 18:48:49.518081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 18:48:49.518081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 18:48:49.518081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 18:48:49.518081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 18:48:49.518081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise self.value Jun 02 18:48:49.518081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 18:48:49.518081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 18:48:49.518081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 18:48:49.518081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application session.commit() Jun 02 18:48:49.518081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 18:48:49.518981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 18:48:49.518981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 18:48:49.518981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 18:48:49.518981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 18:48:49.518981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self.session.flush() Jun 02 18:48:49.518981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 18:48:49.518981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 18:48:49.518981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 18:48:49.518981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 18:48:49.518981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 18:48:49.518981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application compat.raise_( Jun 02 18:48:49.518981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 18:48:49.518981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception Jun 02 18:48:49.518981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 18:48:49.518981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 18:48:49.518981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 18:48:49.518981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 18:48:49.519894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 18:48:49.519894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 18:48:49.519894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 18:48:49.519894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 18:48:49.519894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 18:48:49.519894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 18:48:49.519894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 18:48:49.519894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 18:48:49.519894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 18:48:49.519894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 18:48:49.519894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 18:48:49.519894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 18:48:49.519894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 18:48:49.519894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 18:48:49.519894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 18:48:49.520696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 18:48:49.520696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 18:48:49.520696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception Jun 02 18:48:49.520696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 18:48:49.520696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 18:48:49.520696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 18:48:49.520696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 18:48:49.520696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 18:48:49.520696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 18:48:49.520696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 18:48:49.520696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application conn.query(q) Jun 02 18:48:49.520696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 18:48:49.520696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 18:48:49.520696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 18:48:49.520696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application result.read() Jun 02 18:48:49.520696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 18:48:49.520696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 18:48:49.521549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 18:48:49.521549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 18:48:49.521549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 18:48:49.521549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 18:48:49.521549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 18:48:49.521549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 18:48:49.521549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 18:48:49.521549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 18:48:49.521549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [parameters: {'id': 'd43b9d07904f40b2b6ed3566f1deeb4d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 18:48:49.521549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 18:48:49.521549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:49.521549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:49.521549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:49.521549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:49.521549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 02 18:48:49.524093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 02 18:48:49.524093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 18:48:49.524093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 18:48:49.524093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 02 18:48:49.524093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:49.524093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:49.524093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:49.524093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:49.524093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:49.524093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:49.524093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:49.524093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:49.524093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:49.524093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:49.524093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:49.524093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:49.524093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:49.525693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:49.525693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 02 18:48:49.525693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 02 18:48:49.525693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:49.525693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:49.525693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 02 18:48:49.525693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 02 18:48:49.525693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d43b9d07904f40b2b6ed3566f1deeb4d. Jun 02 18:48:49.525693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:49.525693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 466/947] 10.222.0.15 () {60 vars in 1140 bytes} [Thu Jun 2 18:48:49 2022] POST /identity/v3/projects => generated 262 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:49.533876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802795b3-3512-42ac-b88e-681a41dae374 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:49.608598 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:49.643861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802795b3-3512-42ac-b88e-681a41dae374 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:49.683091 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f60d9d-88e2-4b23-b38d-79a326e9f519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:49.684145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f60d9d-88e2-4b23-b38d-79a326e9f519 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:49.684429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f60d9d-88e2-4b23-b38d-79a326e9f519 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:49.684704 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f60d9d-88e2-4b23-b38d-79a326e9f519 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:49.693931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f60d9d-88e2-4b23-b38d-79a326e9f519 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:49.695414 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f60d9d-88e2-4b23-b38d-79a326e9f519 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:49.711201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-47f60d9d-88e2-4b23-b38d-79a326e9f519 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:49.711201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:49.711201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:49.711201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:49.711201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:49.711201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:49.711201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:49.711201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:49.711201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:49.711201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:49.711201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:49.711201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:49.711201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:49.711201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:49.711201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:49.713225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:49.713225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:49.713225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:49.713225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:49.713225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:49.713225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:49.713225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:49.713225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:49.713225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:49.713225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:49.713225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:49.713225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:49.713225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:49.713225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:49.713225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:49.713225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:49.713225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:49.715452 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:49.715452 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:49.715452 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:49.715452 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:49.715452 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:49.715452 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:49.715452 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:49.715452 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:49.715452 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 482/948] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:49.723155 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fd6d7-fc82-4ab6-961e-c482bda8ac9f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:49.832784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fd6d7-fc82-4ab6-961e-c482bda8ac9f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:49.868110 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad07a4-2d74-4184-a289-4f8f51c55321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:49.868779 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad07a4-2d74-4184-a289-4f8f51c55321 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:49.869069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad07a4-2d74-4184-a289-4f8f51c55321 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:49.869344 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad07a4-2d74-4184-a289-4f8f51c55321 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:49.870365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad07a4-2d74-4184-a289-4f8f51c55321 None admin] RBAC: Adding query filter params (name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:49.871093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad07a4-2d74-4184-a289-4f8f51c55321 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:49.872760 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad07a4-2d74-4184-a289-4f8f51c55321 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:49.898184 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 467/949] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 2 18:48:49 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:50.481061 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c326ec-34fe-4a09-9dc6-039f4bba7e26 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:50.481755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c326ec-34fe-4a09-9dc6-039f4bba7e26 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:50.481755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c326ec-34fe-4a09-9dc6-039f4bba7e26 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:50.483307 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 483/950] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:50.490105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c30f0-0454-48c9-ac2d-48430979963b None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:50.490609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c30f0-0454-48c9-ac2d-48430979963b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:50.490764 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c30f0-0454-48c9-ac2d-48430979963b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:50.510642 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-484c30f0-0454-48c9-ac2d-48430979963b None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:50.512131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-484c30f0-0454-48c9-ac2d-48430979963b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:50.515000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:50.596279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 468/951] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:48:50.619733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c326ec-34fe-4a09-9dc6-039f4bba7e26 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:50.728833 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c326ec-34fe-4a09-9dc6-039f4bba7e26 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:50.757460 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:50.766241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddcb41-b917-4ed2-be70-18bdc809e5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:50.767067 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddcb41-b917-4ed2-be70-18bdc809e5ac None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:50.767346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddcb41-b917-4ed2-be70-18bdc809e5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:50.767621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddcb41-b917-4ed2-be70-18bdc809e5ac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:50.779398 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddcb41-b917-4ed2-be70-18bdc809e5ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:48:50.788039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-65ddcb41-b917-4ed2-be70-18bdc809e5ac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 18:48:50.788039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:50.788039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:50.788039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:50.788039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:50.788039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:50.788039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:50.788039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:50.788039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:50.788039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:50.788039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:50.788039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:50.788039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:48:50.788039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:48:50.788039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:48:50.788039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:48:50.789132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:48:50.789132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:48:50.789132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:48:50.789132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:48:50.789132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:50.789132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:50.789132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:50.789132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:50.789132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:50.789132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:50.789132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:50.789132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:50.789132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:50.789132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:50.789132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:50.789132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:50.790174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:50.790174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:50.790174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:50.790174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:50.790174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:48:50.790174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:48:50.790174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:48:50.790174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:48:50.790174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:48:50.790174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:48:50.790174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 18:48:50.790174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:50.790174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 484/952] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Jun 2 18:48:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:50.797814 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c30f0-0454-48c9-ac2d-48430979963b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:50.903483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c30f0-0454-48c9-ac2d-48430979963b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:50.914359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff92bc-3e06-467b-9d04-2838805067b4 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:50.914648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff92bc-3e06-467b-9d04-2838805067b4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:50.914925 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff92bc-3e06-467b-9d04-2838805067b4 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:50.916550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 485/953] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:50.921690 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe803eb-8bd3-4b56-b411-f00ee4bfbc96 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:50.922024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe803eb-8bd3-4b56-b411-f00ee4bfbc96 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:50.922307 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe803eb-8bd3-4b56-b411-f00ee4bfbc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:50.940935 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa2dc5-5c3c-410b-a67d-616d03dd3c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:50.941617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa2dc5-5c3c-410b-a67d-616d03dd3c33 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:50.941723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-efe803eb-8bd3-4b56-b411-f00ee4bfbc96 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:50.941958 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa2dc5-5c3c-410b-a67d-616d03dd3c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:50.942242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa2dc5-5c3c-410b-a67d-616d03dd3c33 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:50.942854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-efe803eb-8bd3-4b56-b411-f00ee4bfbc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:50.942986 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa2dc5-5c3c-410b-a67d-616d03dd3c33 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:50.943292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa2dc5-5c3c-410b-a67d-616d03dd3c33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:50.944970 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa2dc5-5c3c-410b-a67d-616d03dd3c33 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:50.956220 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 469/954] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jun 2 18:48:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:50.962094 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa2dc5-5c3c-410b-a67d-616d03dd3c33 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:50.965916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:51.036105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 486/955] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:48:51.064357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe803eb-8bd3-4b56-b411-f00ee4bfbc96 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:51.083556 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa2dc5-5c3c-410b-a67d-616d03dd3c33 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:51.121342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3bb85-60bd-44f0-b2ac-943833b7abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:51.122635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3bb85-60bd-44f0-b2ac-943833b7abc3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:51.123176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3bb85-60bd-44f0-b2ac-943833b7abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:51.123643 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3bb85-60bd-44f0-b2ac-943833b7abc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:51.137042 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3bb85-60bd-44f0-b2ac-943833b7abc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:51.138883 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3bb85-60bd-44f0-b2ac-943833b7abc3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:51.158522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-81c3bb85-60bd-44f0-b2ac-943833b7abc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:51.158522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:51.158522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:51.158522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:51.158522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:51.158522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:51.158522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:51.158522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:51.158522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:51.158522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:51.158522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:51.158522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:51.158522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:51.158522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:51.158522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:51.159486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:51.159486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:51.159486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:51.159486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:51.159486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:51.159486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:51.159486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:51.159486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:51.159486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:51.159486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:51.159486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:51.159486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:51.159486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:51.159486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:51.159486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:51.159486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:51.159486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:51.160405 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:51.160405 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:51.160405 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:51.160405 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:51.167442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 470/956] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:51.168998 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3bb85-60bd-44f0-b2ac-943833b7abc3 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:51.201024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe803eb-8bd3-4b56-b411-f00ee4bfbc96 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:51.226213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:51.234952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:51.251040 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ed522-c405-4d49-a2f4-d16bf0a6ea9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:51.251875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ed522-c405-4d49-a2f4-d16bf0a6ea9d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:51.252156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ed522-c405-4d49-a2f4-d16bf0a6ea9d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:51.252430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ed522-c405-4d49-a2f4-d16bf0a6ea9d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:51.253348 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ed522-c405-4d49-a2f4-d16bf0a6ea9d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:51.255744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ed522-c405-4d49-a2f4-d16bf0a6ea9d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:51.271935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-1d5ed522-c405-4d49-a2f4-d16bf0a6ea9d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 18:48:51.271935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:51.271935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:51.271935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:51.271935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:51.271935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:51.271935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:51.271935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:51.271935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 18:48:51.271935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:51.271935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:51.271935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:51.271935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:51.271935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:51.271935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:51.271935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:51.271935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:51.273152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:51.273152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:51.273152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:51.273152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:51.273152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:51.273152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:51.273152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:51.273152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:51.273152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:51.273152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:51.273152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:51.273152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:51.273152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:51.273152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:51.273152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:51.273152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:51.274574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:51.274574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:51.274574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:51.274574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:51.274574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:51.274574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:51.274574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:51.274574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:51.274574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:51.274574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:51.274574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:51.274574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:51.274574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 18:48:51.274574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:51.277868 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 487/957] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 2 18:48:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:51.280577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ed522-c405-4d49-a2f4-d16bf0a6ea9d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:51.292205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3bb85-60bd-44f0-b2ac-943833b7abc3 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:51.333560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461a715-29c6-40f5-8666-3c40101a8901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:51.334525 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461a715-29c6-40f5-8666-3c40101a8901 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:51.334944 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461a715-29c6-40f5-8666-3c40101a8901 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:51.335350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461a715-29c6-40f5-8666-3c40101a8901 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:51.336204 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461a715-29c6-40f5-8666-3c40101a8901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:51.337066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461a715-29c6-40f5-8666-3c40101a8901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:51.339033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461a715-29c6-40f5-8666-3c40101a8901 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:51.358874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 471/958] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:51.359318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52b9b6-1973-4861-8330-5624820bc5da None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:51.359988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52b9b6-1973-4861-8330-5624820bc5da None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:51.359988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52b9b6-1973-4861-8330-5624820bc5da None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:51.361327 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 472/959] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:51.361888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52b9b6-1973-4861-8330-5624820bc5da None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:51.415417 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ed522-c405-4d49-a2f4-d16bf0a6ea9d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:51.452846 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e2e67-6c69-44bc-bb75-9e3f7f3d3c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:51.453898 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e2e67-6c69-44bc-bb75-9e3f7f3d3c0b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:51.454386 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e2e67-6c69-44bc-bb75-9e3f7f3d3c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:51.454909 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e2e67-6c69-44bc-bb75-9e3f7f3d3c0b None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:51.455816 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e2e67-6c69-44bc-bb75-9e3f7f3d3c0b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:51.456214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e2e67-6c69-44bc-bb75-9e3f7f3d3c0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:51.458086 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e2e67-6c69-44bc-bb75-9e3f7f3d3c0b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:51.463239 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 488/960] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 2 18:48:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:51.468241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa5f9-7262-486c-90f4-b8b1230f0a7b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:51.468522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa5f9-7262-486c-90f4-b8b1230f0a7b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:51.468801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa5f9-7262-486c-90f4-b8b1230f0a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:51.471428 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52b9b6-1973-4861-8330-5624820bc5da None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:51.486506 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f46fa5f9-7262-486c-90f4-b8b1230f0a7b None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:51.487729 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f46fa5f9-7262-486c-90f4-b8b1230f0a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:51.487873 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:51.514031 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb2130-9a2c-4eb1-b627-453cebe5c6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:51.515709 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb2130-9a2c-4eb1-b627-453cebe5c6ec None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:51.516139 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb2130-9a2c-4eb1-b627-453cebe5c6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:51.516553 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb2130-9a2c-4eb1-b627-453cebe5c6ec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:51.524582 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb2130-9a2c-4eb1-b627-453cebe5c6ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:51.526413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb2130-9a2c-4eb1-b627-453cebe5c6ec None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:51.535589 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:51.544706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-1efb2130-9a2c-4eb1-b627-453cebe5c6ec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 18:48:51.544706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:51.544706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:51.544706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:51.544706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:51.544706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:51.544706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:51.544706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:51.544706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:51.544706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:51.544706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:51.544706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:51.544706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:51.544706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:51.544706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:51.544706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:51.545623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:51.545623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:51.545623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:51.545623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:51.545623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:51.545623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:51.545623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:51.545623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:51.545623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:51.545623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:51.545623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:51.545623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:51.545623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:51.545623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:51.545623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:51.545623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:51.545623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:51.545623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:51.546594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:51.546594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:51.546594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:51.546594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:51.546594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:51.546594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:51.546594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:51.546594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:51.546594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 18:48:51.546594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:51.550628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 473/961] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 2 18:48:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:51.551325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb2130-9a2c-4eb1-b627-453cebe5c6ec None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:51.566450 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 489/962] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:51.567129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fa5f9-7262-486c-90f4-b8b1230f0a7b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:51.669880 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fa5f9-7262-486c-90f4-b8b1230f0a7b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:51.674075 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb2130-9a2c-4eb1-b627-453cebe5c6ec None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:51.705963 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96b439-29ae-415d-8ae1-e2b37f732e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:51.706640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96b439-29ae-415d-8ae1-e2b37f732e48 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:51.706916 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96b439-29ae-415d-8ae1-e2b37f732e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:51.707543 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96b439-29ae-415d-8ae1-e2b37f732e48 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:51.708378 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96b439-29ae-415d-8ae1-e2b37f732e48 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:51.708685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96b439-29ae-415d-8ae1-e2b37f732e48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:51.709500 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a530a7-5920-4003-aecc-9f5f0fe523a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:51.710142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96b439-29ae-415d-8ae1-e2b37f732e48 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:51.710363 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a530a7-5920-4003-aecc-9f5f0fe523a5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:51.710647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a530a7-5920-4003-aecc-9f5f0fe523a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:51.710922 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a530a7-5920-4003-aecc-9f5f0fe523a5 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:51.711622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a530a7-5920-4003-aecc-9f5f0fe523a5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:51.712090 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a530a7-5920-4003-aecc-9f5f0fe523a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:51.714331 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a530a7-5920-4003-aecc-9f5f0fe523a5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:51.720230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 474/963] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 2 18:48:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:51.721144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a530a7-5920-4003-aecc-9f5f0fe523a5 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:51.737359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 490/964] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Jun 2 18:48:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:51.737359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96b439-29ae-415d-8ae1-e2b37f732e48 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:51.767903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:51.771706 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:51.835364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a530a7-5920-4003-aecc-9f5f0fe523a5 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:51.841983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96b439-29ae-415d-8ae1-e2b37f732e48 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:51.871928 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81406c6-77cf-4172-b1bb-c0c4bedabebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:51.872826 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81406c6-77cf-4172-b1bb-c0c4bedabebe None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:51.873096 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81406c6-77cf-4172-b1bb-c0c4bedabebe None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:51.873378 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81406c6-77cf-4172-b1bb-c0c4bedabebe None admin] PATH_INFO: `/v3/services/compute` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:51.874123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81406c6-77cf-4172-b1bb-c0c4bedabebe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:51.875432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81406c6-77cf-4172-b1bb-c0c4bedabebe None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:51.877292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b3a05-9551-42f5-bd40-c9f8e1807627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:51.877986 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b3a05-9551-42f5-bd40-c9f8e1807627 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:51.878265 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b3a05-9551-42f5-bd40-c9f8e1807627 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:51.878544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b3a05-9551-42f5-bd40-c9f8e1807627 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:51.879274 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b3a05-9551-42f5-bd40-c9f8e1807627 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:51.880624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b3a05-9551-42f5-bd40-c9f8e1807627 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:51.888602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-e81406c6-77cf-4172-b1bb-c0c4bedabebe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 18:48:51.888602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:51.888602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:51.888602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:51.888602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:51.888602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:51.888602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:51.888602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:51.888602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 18:48:51.888602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:51.888602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:51.888602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:51.888602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:51.888602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:51.888602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:51.888602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:51.888602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:51.889733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:51.889733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:51.889733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:51.889733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:51.889733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:51.889733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:51.889733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:51.889733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:51.889733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:51.889733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:51.889733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:51.889733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:51.889733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:51.889733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:51.889733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:51.889733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:51.890858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:51.890858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:51.890858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:51.890858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:51.890858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:51.890858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:51.890858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:51.890858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:51.890858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:51.890858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:51.890858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:51.890858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:51.890858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 18:48:51.890858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:51.890858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 475/965] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:51.896131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81406c6-77cf-4172-b1bb-c0c4bedabebe None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:51.903636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 491/966] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jun 2 18:48:51 2022] POST /identity/v3/endpoints => generated 349 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:48:51.904460 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b3a05-9551-42f5-bd40-c9f8e1807627 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:52.034939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81406c6-77cf-4172-b1bb-c0c4bedabebe None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:52.037336 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:52.055436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:52.076220 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b3a05-9551-42f5-bd40-c9f8e1807627 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:52.082608 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332b450-43f3-41ec-8409-d1a89149e53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:52.083409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332b450-43f3-41ec-8409-d1a89149e53c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:52.083752 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332b450-43f3-41ec-8409-d1a89149e53c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:52.084100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332b450-43f3-41ec-8409-d1a89149e53c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:52.117092 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbc95c-9a2f-4db4-a63d-b2a16aefa252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:52.118406 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbc95c-9a2f-4db4-a63d-b2a16aefa252 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:52.118406 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbc95c-9a2f-4db4-a63d-b2a16aefa252 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:52.118406 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbc95c-9a2f-4db4-a63d-b2a16aefa252 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:52.119165 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbc95c-9a2f-4db4-a63d-b2a16aefa252 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:52.119269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbc95c-9a2f-4db4-a63d-b2a16aefa252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:52.120922 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbc95c-9a2f-4db4-a63d-b2a16aefa252 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:52.127017 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 492/967] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 2 18:48:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:52.132390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbc95c-9a2f-4db4-a63d-b2a16aefa252 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:52.175378 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332b450-43f3-41ec-8409-d1a89149e53c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:52.176680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332b450-43f3-41ec-8409-d1a89149e53c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:52.268872 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbc95c-9a2f-4db4-a63d-b2a16aefa252 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:52.291289 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 476/968] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:48:51 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 18:48:52.296987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332b450-43f3-41ec-8409-d1a89149e53c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:52.299313 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:52.312737 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4bea6-7fef-4cc1-9788-87e8d93d4e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:52.313422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4bea6-7fef-4cc1-9788-87e8d93d4e80 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:52.313705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4bea6-7fef-4cc1-9788-87e8d93d4e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:52.314007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4bea6-7fef-4cc1-9788-87e8d93d4e80 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:52.314717 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4bea6-7fef-4cc1-9788-87e8d93d4e80 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:52.315024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4bea6-7fef-4cc1-9788-87e8d93d4e80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:52.316408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4bea6-7fef-4cc1-9788-87e8d93d4e80 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:52.321142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 493/969] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 2 18:48:52 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:52.321142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998608e0-2511-4ecc-9785-69814e075851 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:52.321142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998608e0-2511-4ecc-9785-69814e075851 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:52.321142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998608e0-2511-4ecc-9785-69814e075851 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:52.321142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 494/970] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:52.330878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2462e-b0b4-4dc5-9e23-3c31f9cfbf39 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:52.331164 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2462e-b0b4-4dc5-9e23-3c31f9cfbf39 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:52.331439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2462e-b0b4-4dc5-9e23-3c31f9cfbf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:52.350128 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b8b2462e-b0b4-4dc5-9e23-3c31f9cfbf39 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:52.351356 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b8b2462e-b0b4-4dc5-9e23-3c31f9cfbf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:52.362782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:52.430075 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332b450-43f3-41ec-8409-d1a89149e53c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:52.442337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 495/971] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:48:52.465758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2462e-b0b4-4dc5-9e23-3c31f9cfbf39 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:52.472263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0137aa9-50b8-4290-aebb-655a08b22a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:52.473133 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0137aa9-50b8-4290-aebb-655a08b22a3d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:52.473415 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0137aa9-50b8-4290-aebb-655a08b22a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:52.473688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0137aa9-50b8-4290-aebb-655a08b22a3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:52.486626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0137aa9-50b8-4290-aebb-655a08b22a3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:52.488112 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0137aa9-50b8-4290-aebb-655a08b22a3d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:52.508098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-e0137aa9-50b8-4290-aebb-655a08b22a3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:52.508098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:52.508098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:52.508098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:52.508098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:52.508098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:52.508098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:52.508098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:52.508098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:52.508098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:52.508098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:52.508098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:52.508098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:48:52.508098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:48:52.508098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:48:52.509089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:48:52.509089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:52.509089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:52.509089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:52.509089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:52.509089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:52.509089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:52.509089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:52.509089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:52.509089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:52.509089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:52.509089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:52.509089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:52.509089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:52.509089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:52.509089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:52.509089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:52.510015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:48:52.510015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:48:52.510015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:48:52.510015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:52.510015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 477/972] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:52.518902 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0137aa9-50b8-4290-aebb-655a08b22a3d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:52.591961 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:52.599031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2462e-b0b4-4dc5-9e23-3c31f9cfbf39 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:52.635390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea27da5-6429-44c8-997f-536e4f216f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:52.636124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea27da5-6429-44c8-997f-536e4f216f61 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:52.636403 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea27da5-6429-44c8-997f-536e4f216f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:52.636671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea27da5-6429-44c8-997f-536e4f216f61 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:52.637381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea27da5-6429-44c8-997f-536e4f216f61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:52.638913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea27da5-6429-44c8-997f-536e4f216f61 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:52.640169 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: WARNING keystone.server.flask.common [None req-8ea27da5-6429-44c8-997f-536e4f216f61 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 18:48:52.653366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0137aa9-50b8-4290-aebb-655a08b22a3d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:52.653844 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.sql.core [None req-8ea27da5-6429-44c8-997f-536e4f216f61 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 18:48:52.653844 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 18:48:52.653844 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [parameters: {'user_id': 'e54b82d2523b4da88863eefa7fab445b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 18:48:52.653844 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80258) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 18:48:52.662930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-8ea27da5-6429-44c8-997f-536e4f216f61 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 18:48:52.662930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:52.662930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 18:48:52.662930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 18:48:52.662930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 18:48:52.662930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 18:48:52.662930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 18:48:52.662930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 18:48:52.662930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 18:48:52.662930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application conn.query(q) Jun 02 18:48:52.662930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 18:48:52.662930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 18:48:52.662930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 18:48:52.662930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application result.read() Jun 02 18:48:52.662930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 18:48:52.663818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 18:48:52.663818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 18:48:52.663818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 18:48:52.663818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 18:48:52.663818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 18:48:52.663818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 18:48:52.663818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 18:48:52.663818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 18:48:52.663818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:52.663818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 18:48:52.663818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:52.663818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:52.663818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 18:48:52.663818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 18:48:52.663818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 02 18:48:52.663818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 02 18:48:52.663818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 18:48:52.663818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application next(self.gen) Jun 02 18:48:52.666470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 18:48:52.666470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application yield resource Jun 02 18:48:52.666470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 18:48:52.666470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application next(self.gen) Jun 02 18:48:52.666470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 18:48:52.666470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 18:48:52.666470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 18:48:52.666470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 18:48:52.666470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 18:48:52.666470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise self.value Jun 02 18:48:52.666470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 18:48:52.666470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 18:48:52.666470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 18:48:52.666470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application session.commit() Jun 02 18:48:52.666470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 18:48:52.666470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 18:48:52.666470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 18:48:52.667423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 18:48:52.667423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 18:48:52.667423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.session.flush() Jun 02 18:48:52.667423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 18:48:52.667423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 18:48:52.667423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 18:48:52.667423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 18:48:52.667423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 18:48:52.667423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application compat.raise_( Jun 02 18:48:52.667423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 18:48:52.667423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception Jun 02 18:48:52.667423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 18:48:52.667423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 18:48:52.667423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 18:48:52.667423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 18:48:52.667423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 18:48:52.667423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 18:48:52.668385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 18:48:52.668385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 18:48:52.668385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 02 18:48:52.668385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 02 18:48:52.668385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 18:48:52.668385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 18:48:52.668385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 18:48:52.668385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 18:48:52.668385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 18:48:52.668385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 18:48:52.668385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 18:48:52.668385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 18:48:52.668385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 18:48:52.668385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 18:48:52.668385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 18:48:52.668385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception Jun 02 18:48:52.669214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 18:48:52.669214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 18:48:52.669214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 18:48:52.669214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 18:48:52.669214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 18:48:52.669214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 18:48:52.669214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 18:48:52.669214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application conn.query(q) Jun 02 18:48:52.669214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 18:48:52.669214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 18:48:52.669214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 18:48:52.669214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application result.read() Jun 02 18:48:52.669214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 18:48:52.669214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 18:48:52.669214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 18:48:52.669214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 18:48:52.670210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 18:48:52.670210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 18:48:52.670210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 18:48:52.670210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 18:48:52.670210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 18:48:52.670210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 18:48:52.670210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e54b82d2523b4da88863eefa7fab445b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 18:48:52.670210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 18:48:52.670210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:52.670210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:52.670210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:52.670210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:52.670210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:52.670210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:52.670210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:52.671526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:52.671526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:52.671526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:52.671526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:52.671526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:52.671526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:52.671526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:52.671526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 02 18:48:52.671526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 02 18:48:52.671526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:52.671526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:52.671526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:52.671526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:52.671526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:52.671526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:52.671526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 02 18:48:52.671526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 02 18:48:52.673923 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 02 18:48:52.673923 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 02 18:48:52.673923 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 18:48:52.673923 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 18:48:52.673923 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 18:48:52.673923 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:52.673923 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 496/973] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Jun 2 18:48:52 2022] POST /identity/v3/users => generated 160 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:52.676652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea27da5-6429-44c8-997f-536e4f216f61 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:52.688191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:52.705294 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4d8d8-3cf4-4a69-998d-67d3392a65f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:52.706140 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4d8d8-3cf4-4a69-998d-67d3392a65f1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:52.706646 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4d8d8-3cf4-4a69-998d-67d3392a65f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:52.706991 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4d8d8-3cf4-4a69-998d-67d3392a65f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:52.708750 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4d8d8-3cf4-4a69-998d-67d3392a65f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:52.709348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4d8d8-3cf4-4a69-998d-67d3392a65f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:52.710862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4d8d8-3cf4-4a69-998d-67d3392a65f1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:52.730817 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 478/974] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:52.735234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4d8d8-3cf4-4a69-998d-67d3392a65f1 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:52.797346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea27da5-6429-44c8-997f-536e4f216f61 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:52.834006 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0139fb-2212-4fab-9167-77b3ef679e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:52.835158 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0139fb-2212-4fab-9167-77b3ef679e49 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:52.835632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0139fb-2212-4fab-9167-77b3ef679e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:52.836091 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0139fb-2212-4fab-9167-77b3ef679e49 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:52.840461 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4d8d8-3cf4-4a69-998d-67d3392a65f1 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:52.845481 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0139fb-2212-4fab-9167-77b3ef679e49 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:52.847373 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0139fb-2212-4fab-9167-77b3ef679e49 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:52.854973 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:52.863851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-2a0139fb-2212-4fab-9167-77b3ef679e49 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 18:48:52.863851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:52.863851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:52.863851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:52.863851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:52.863851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:52.863851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:52.863851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:52.863851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:52.863851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:52.863851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:52.863851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:52.863851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:48:52.863851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:48:52.863851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:48:52.863851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:48:52.864878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:52.864878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:52.864878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:48:52.864878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:52.864878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:48:52.864878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:48:52.864878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:52.864878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:52.864878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:52.864878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:52.864878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:52.864878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:52.864878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:52.864878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:52.864878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:52.864878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:52.864878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:52.864878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:52.865870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:52.865870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:52.865870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:48:52.865870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:48:52.865870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:48:52.865870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:48:52.865870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:48:52.865870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:48:52.865870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 18:48:52.865870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:52.869308 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 497/975] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:48:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:52.875268 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0139fb-2212-4fab-9167-77b3ef679e49 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:52.884652 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bcecd-9ebd-40e9-9a9d-ed2537a64149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:52.885461 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bcecd-9ebd-40e9-9a9d-ed2537a64149 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:52.885896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bcecd-9ebd-40e9-9a9d-ed2537a64149 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:52.886094 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bcecd-9ebd-40e9-9a9d-ed2537a64149 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:52.895084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bcecd-9ebd-40e9-9a9d-ed2537a64149 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:52.897004 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bcecd-9ebd-40e9-9a9d-ed2537a64149 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:52.915590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-e46bcecd-9ebd-40e9-9a9d-ed2537a64149 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:52.915590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:52.915590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:52.915590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:52.915590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:52.915590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:52.915590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:52.915590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:52.915590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:52.915590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:52.915590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:52.915590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:52.915590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:48:52.915590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:48:52.915590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:48:52.916513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:48:52.916513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:52.916513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:52.916513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:52.916513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:52.916513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:52.916513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:52.916513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:52.916513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:52.916513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:52.916513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:52.916513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:52.916513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:52.916513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:52.916513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:52.916513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:52.916513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:52.917607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:48:52.917607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:48:52.917607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:48:52.917607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:48:52.917607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:48:52.917607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:48:52.917607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:48:52.917607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:52.921861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 479/976] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:52.922914 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bcecd-9ebd-40e9-9a9d-ed2537a64149 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:52.958379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:53.000679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0139fb-2212-4fab-9167-77b3ef679e49 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:53.048290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093898da-4721-4aec-8430-b76462097125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:53.050046 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093898da-4721-4aec-8430-b76462097125 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:53.050528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093898da-4721-4aec-8430-b76462097125 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:53.050992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093898da-4721-4aec-8430-b76462097125 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:53.051767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bcecd-9ebd-40e9-9a9d-ed2537a64149 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:53.052217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093898da-4721-4aec-8430-b76462097125 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:53.052729 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093898da-4721-4aec-8430-b76462097125 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:53.059859 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093898da-4721-4aec-8430-b76462097125 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:53.094564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bca32-51b2-4fe2-812d-086dca3d1dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:53.095630 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bca32-51b2-4fe2-812d-086dca3d1dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:53.096126 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bca32-51b2-4fe2-812d-086dca3d1dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:53.096595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bca32-51b2-4fe2-812d-086dca3d1dd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:53.097568 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bca32-51b2-4fe2-812d-086dca3d1dd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:53.098221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bca32-51b2-4fe2-812d-086dca3d1dd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:53.100461 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bca32-51b2-4fe2-812d-086dca3d1dd9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:53.113828 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 498/977] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 2 18:48:52 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:53.118831 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 480/978] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:48:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:53.125286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093898da-4721-4aec-8430-b76462097125 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:53.243711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093898da-4721-4aec-8430-b76462097125 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:53.271277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:53.284988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8febce8-cf2b-4efc-9128-63a2f7fea207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:53.286121 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8febce8-cf2b-4efc-9128-63a2f7fea207 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:53.286696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8febce8-cf2b-4efc-9128-63a2f7fea207 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:53.287166 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8febce8-cf2b-4efc-9128-63a2f7fea207 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:53.288208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8febce8-cf2b-4efc-9128-63a2f7fea207 None admin] RBAC: Adding query filter params (role.id=a1ccf0afb5d6486cac2bf01dc16f56fa, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=23aa142375c54b94ad276d1a4b9031e0) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:53.288721 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8febce8-cf2b-4efc-9128-63a2f7fea207 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:53.290439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8febce8-cf2b-4efc-9128-63a2f7fea207 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:53.299021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 499/979] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:48:53 2022] GET /identity/v3/role_assignments?user.id=23aa142375c54b94ad276d1a4b9031e0&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=a1ccf0afb5d6486cac2bf01dc16f56fa => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:54.271413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a1200-92ce-4713-81e3-278e5eb04e4b None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:54.271977 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a1200-92ce-4713-81e3-278e5eb04e4b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:54.271977 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a1200-92ce-4713-81e3-278e5eb04e4b None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:54.273476 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 481/980] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:54.278922 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8e0ba-65ce-4869-b882-b8164c722ea0 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:54.279342 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8e0ba-65ce-4869-b882-b8164c722ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:54.279417 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8e0ba-65ce-4869-b882-b8164c722ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:54.298595 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-21b8e0ba-65ce-4869-b882-b8164c722ea0 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:54.300099 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-21b8e0ba-65ce-4869-b882-b8164c722ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:54.375468 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 500/981] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:54.398058 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a1200-92ce-4713-81e3-278e5eb04e4b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:54.436340 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:54.508939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a1200-92ce-4713-81e3-278e5eb04e4b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:54.546126 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ffe74-6e59-46c9-8a81-086989527331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:54.547115 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ffe74-6e59-46c9-8a81-086989527331 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:54.547403 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ffe74-6e59-46c9-8a81-086989527331 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:54.547674 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ffe74-6e59-46c9-8a81-086989527331 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:54.548318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ffe74-6e59-46c9-8a81-086989527331 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:54.549690 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ffe74-6e59-46c9-8a81-086989527331 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:54.562000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-ea5ffe74-6e59-46c9-8a81-086989527331 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 18:48:54.562000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:54.562000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:54.562000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:54.562000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:54.562000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:54.562000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:54.562000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:54.562000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 18:48:54.562000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:54.562000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:54.562000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:54.562000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:54.562000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:54.562000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:54.562000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:54.562000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:54.563016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:54.563016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:54.563016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:54.563016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:54.563016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:54.563016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:54.563016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:54.563016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:54.563016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:54.563016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:54.563016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:54.563016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:54.563016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:54.563016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:54.563016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:54.563016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:54.563870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:54.563870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:54.563870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:54.563870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:54.563870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:54.563870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:54.563870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:54.563870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:54.563870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:54.563870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:54.563870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:54.563870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:54.563870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 18:48:54.563870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:54.565871 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 482/982] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 2 18:48:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:54.569557 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8e0ba-65ce-4869-b882-b8164c722ea0 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:54.664107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2a695-27ee-44b3-8b8e-fbeda8f9d9d2 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:54.664500 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2a695-27ee-44b3-8b8e-fbeda8f9d9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:54.664767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2a695-27ee-44b3-8b8e-fbeda8f9d9d2 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:54.666455 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 483/983] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:54.671992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065fe72-bbda-413e-b832-b04f4865fb21 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:54.672257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065fe72-bbda-413e-b832-b04f4865fb21 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:54.672544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065fe72-bbda-413e-b832-b04f4865fb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:54.674694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8e0ba-65ce-4869-b882-b8164c722ea0 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:54.690157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d065fe72-bbda-413e-b832-b04f4865fb21 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:54.691438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d065fe72-bbda-413e-b832-b04f4865fb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:54.695252 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:54.714822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f960f9-46d7-4fbf-baa2-57a2326bbf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:54.715499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f960f9-46d7-4fbf-baa2-57a2326bbf1c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:54.715779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f960f9-46d7-4fbf-baa2-57a2326bbf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:54.716047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f960f9-46d7-4fbf-baa2-57a2326bbf1c None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:54.716797 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f960f9-46d7-4fbf-baa2-57a2326bbf1c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:54.717101 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f960f9-46d7-4fbf-baa2-57a2326bbf1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:54.718507 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f960f9-46d7-4fbf-baa2-57a2326bbf1c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:54.723802 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 501/984] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 2 18:48:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:54.729702 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f960f9-46d7-4fbf-baa2-57a2326bbf1c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:54.761687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 484/985] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:48:54.784820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065fe72-bbda-413e-b832-b04f4865fb21 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:54.813825 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:54.834459 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f960f9-46d7-4fbf-baa2-57a2326bbf1c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:54.871318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba376f7-35f8-4ba2-9b44-df39717c2679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:54.872082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba376f7-35f8-4ba2-9b44-df39717c2679 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:54.872359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba376f7-35f8-4ba2-9b44-df39717c2679 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:54.872643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba376f7-35f8-4ba2-9b44-df39717c2679 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:54.873339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba376f7-35f8-4ba2-9b44-df39717c2679 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:54.873642 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba376f7-35f8-4ba2-9b44-df39717c2679 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:54.875200 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba376f7-35f8-4ba2-9b44-df39717c2679 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:54.885698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 502/986] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 2 18:48:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:54.886565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba376f7-35f8-4ba2-9b44-df39717c2679 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:54.886942 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065fe72-bbda-413e-b832-b04f4865fb21 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:54.922298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc80f97-4c8b-4996-8768-df57d5eb9133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:54.922979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc80f97-4c8b-4996-8768-df57d5eb9133 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:54.923261 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc80f97-4c8b-4996-8768-df57d5eb9133 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:54.923539 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc80f97-4c8b-4996-8768-df57d5eb9133 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:54.924269 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc80f97-4c8b-4996-8768-df57d5eb9133 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:54.925661 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc80f97-4c8b-4996-8768-df57d5eb9133 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:54.936747 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:54.940068 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 485/987] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 2 18:48:54 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 18:48:54.998426 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba376f7-35f8-4ba2-9b44-df39717c2679 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:55.047057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e9e53-24ee-4eca-b0b0-22d26cfef786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:55.047680 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e9e53-24ee-4eca-b0b0-22d26cfef786 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:55.047968 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e9e53-24ee-4eca-b0b0-22d26cfef786 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:55.048282 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e9e53-24ee-4eca-b0b0-22d26cfef786 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:55.049116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e9e53-24ee-4eca-b0b0-22d26cfef786 None admin] RBAC: Adding query filter params (interface=admin, service_id=21cf923f42064ef797cb5b38aaaf0637, region_id=RegionOne) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:55.049435 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e9e53-24ee-4eca-b0b0-22d26cfef786 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:55.050907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e9e53-24ee-4eca-b0b0-22d26cfef786 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:55.061932 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 503/988] 10.222.0.15 () {56 vars in 1249 bytes} [Thu Jun 2 18:48:54 2022] GET /identity/v3/endpoints?service_id=21cf923f42064ef797cb5b38aaaf0637&interface=admin®ion_id=RegionOne => generated 193 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:55.063688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc80f97-4c8b-4996-8768-df57d5eb9133 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:55.165950 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:55.181681 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc80f97-4c8b-4996-8768-df57d5eb9133 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:55.217142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fb1d5-b594-4e0e-96a6-66cd29a4612b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:55.217826 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fb1d5-b594-4e0e-96a6-66cd29a4612b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:55.218104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fb1d5-b594-4e0e-96a6-66cd29a4612b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:55.218374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fb1d5-b594-4e0e-96a6-66cd29a4612b None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:55.219047 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fb1d5-b594-4e0e-96a6-66cd29a4612b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:55.220436 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fb1d5-b594-4e0e-96a6-66cd29a4612b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:55.228925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 486/989] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jun 2 18:48:55 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 18:48:55.671766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af5032-e141-4f2f-95e1-877b49bb907b None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:55.672315 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af5032-e141-4f2f-95e1-877b49bb907b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:55.672315 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af5032-e141-4f2f-95e1-877b49bb907b None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:55.673850 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 504/990] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:55.679199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98fb36-c687-4bcd-918b-65a2ce54a14f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:55.679681 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98fb36-c687-4bcd-918b-65a2ce54a14f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:55.679897 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98fb36-c687-4bcd-918b-65a2ce54a14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:55.697437 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ab98fb36-c687-4bcd-918b-65a2ce54a14f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:55.698748 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ab98fb36-c687-4bcd-918b-65a2ce54a14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:55.771784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 487/991] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:55.794650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af5032-e141-4f2f-95e1-877b49bb907b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:55.908746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af5032-e141-4f2f-95e1-877b49bb907b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:55.917057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:55.947493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece9013-40e6-4dc7-848f-9907a3e7c79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:55.947971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece9013-40e6-4dc7-848f-9907a3e7c79d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:55.948313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece9013-40e6-4dc7-848f-9907a3e7c79d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:55.948644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece9013-40e6-4dc7-848f-9907a3e7c79d None admin] PATH_INFO: `/v3/services/image` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:55.949332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece9013-40e6-4dc7-848f-9907a3e7c79d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:55.950734 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece9013-40e6-4dc7-848f-9907a3e7c79d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:55.963400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-aece9013-40e6-4dc7-848f-9907a3e7c79d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 18:48:55.963400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:55.963400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:55.963400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:55.963400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:55.963400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:55.963400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:55.963400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:55.963400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 18:48:55.963400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:55.963400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:55.963400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:55.963400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:55.963400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:55.963400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:55.963400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:55.963400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:55.964513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:55.964513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:55.964513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:55.964513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:55.964513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:55.964513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:55.964513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:55.964513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:55.964513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:55.964513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:55.964513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:55.964513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:55.964513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:55.964513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:55.964513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:55.964513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:55.971219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:55.971219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:55.971219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:55.971219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:55.971219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:55.971219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:55.971219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:55.971219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:55.971219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:55.971219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:55.971219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:55.971219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:55.971219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 18:48:55.971219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:55.971219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 505/992] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Jun 2 18:48:55 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:55.972012 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98fb36-c687-4bcd-918b-65a2ce54a14f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:56.057238 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:56.080964 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98fb36-c687-4bcd-918b-65a2ce54a14f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:56.117595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750cf8a-6551-494f-871e-e110e21ea48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:56.118468 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750cf8a-6551-494f-871e-e110e21ea48c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:56.118743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750cf8a-6551-494f-871e-e110e21ea48c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:56.119009 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750cf8a-6551-494f-871e-e110e21ea48c None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:56.119711 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750cf8a-6551-494f-871e-e110e21ea48c None admin] RBAC: Adding query filter params (name=image) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:56.120035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750cf8a-6551-494f-871e-e110e21ea48c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:56.121415 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750cf8a-6551-494f-871e-e110e21ea48c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:56.128568 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 488/993] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:56.134194 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece9013-40e6-4dc7-848f-9907a3e7c79d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:56.246199 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece9013-40e6-4dc7-848f-9907a3e7c79d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:56.291234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc62323-a471-4d53-a2fd-e2e505ca3629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:56.292003 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc62323-a471-4d53-a2fd-e2e505ca3629 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:56.292323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc62323-a471-4d53-a2fd-e2e505ca3629 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:56.292588 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc62323-a471-4d53-a2fd-e2e505ca3629 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:56.293267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc62323-a471-4d53-a2fd-e2e505ca3629 None admin] RBAC: Adding query filter params (type=image) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:56.293596 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc62323-a471-4d53-a2fd-e2e505ca3629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:56.295108 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc62323-a471-4d53-a2fd-e2e505ca3629 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:56.302806 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 506/994] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:48:56 2022] GET /identity/v3/services?type=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:48:57.309930 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209e9dc-9388-4d6e-af60-0b5cf675511e None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:57.310493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209e9dc-9388-4d6e-af60-0b5cf675511e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:57.310493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209e9dc-9388-4d6e-af60-0b5cf675511e None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:57.312000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 489/995] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:57.317135 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2db89-9bf3-47bb-b92e-ac0355cc3a87 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:57.317545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2db89-9bf3-47bb-b92e-ac0355cc3a87 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:57.317644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2db89-9bf3-47bb-b92e-ac0355cc3a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:57.336527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-91b2db89-9bf3-47bb-b92e-ac0355cc3a87 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:57.337732 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-91b2db89-9bf3-47bb-b92e-ac0355cc3a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:57.366035 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:57.409630 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 507/996] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:48:57.433453 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209e9dc-9388-4d6e-af60-0b5cf675511e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:57.533838 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b891b64-2597-4af6-8625-b06e9f58c06e None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:57.533838 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b891b64-2597-4af6-8625-b06e9f58c06e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:57.533838 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b891b64-2597-4af6-8625-b06e9f58c06e None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:57.536608 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 508/997] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:57.538430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47a1f7-10eb-4453-9a81-bd218955046d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:57.538713 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47a1f7-10eb-4453-9a81-bd218955046d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:57.538987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47a1f7-10eb-4453-9a81-bd218955046d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:57.549016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209e9dc-9388-4d6e-af60-0b5cf675511e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:57.558737 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6f47a1f7-10eb-4453-9a81-bd218955046d None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:57.560004 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6f47a1f7-10eb-4453-9a81-bd218955046d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:57.585276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91510553-accc-4e0d-ae9d-088e3cefb7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:57.586083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91510553-accc-4e0d-ae9d-088e3cefb7dd None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:57.586444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91510553-accc-4e0d-ae9d-088e3cefb7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:57.586680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91510553-accc-4e0d-ae9d-088e3cefb7dd None admin] PATH_INFO: `/v3/services/compute` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:57.587263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91510553-accc-4e0d-ae9d-088e3cefb7dd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:57.588796 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91510553-accc-4e0d-ae9d-088e3cefb7dd None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:57.601120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-91510553-accc-4e0d-ae9d-088e3cefb7dd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 18:48:57.601120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:57.601120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:57.601120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:57.601120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:57.601120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:57.601120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:57.601120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:57.601120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 18:48:57.601120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:57.601120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:57.601120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:57.601120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:57.601120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:57.601120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:57.601120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:57.601120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:57.602228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:57.602228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:57.602228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:57.602228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:57.602228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:57.602228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:57.602228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:57.602228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:57.602228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:57.602228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:57.602228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:57.602228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:57.602228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:57.602228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:57.602228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:57.602228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:57.603074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:57.603074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:57.603074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:57.603074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:57.603074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:57.603074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:57.603074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:57.603074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:57.603074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:57.603074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:57.603074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:57.603074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:57.603074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 18:48:57.603074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:48:57.603074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 490/998] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:48:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:48:57.608352 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91510553-accc-4e0d-ae9d-088e3cefb7dd None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:57.621154 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:57.639273 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 509/999] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:48:57.662054 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47a1f7-10eb-4453-9a81-bd218955046d None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:57.717309 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91510553-accc-4e0d-ae9d-088e3cefb7dd None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:57.752652 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f252eb-0db1-43eb-80c7-5e118953eb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:57.753321 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f252eb-0db1-43eb-80c7-5e118953eb77 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:57.753601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f252eb-0db1-43eb-80c7-5e118953eb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:57.754008 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f252eb-0db1-43eb-80c7-5e118953eb77 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:57.754708 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f252eb-0db1-43eb-80c7-5e118953eb77 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:57.755013 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f252eb-0db1-43eb-80c7-5e118953eb77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:57.756392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f252eb-0db1-43eb-80c7-5e118953eb77 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:57.759891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:57.767723 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 491/1000] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 2 18:48:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:57.768492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f252eb-0db1-43eb-80c7-5e118953eb77 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:57.772044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47a1f7-10eb-4453-9a81-bd218955046d None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:57.806758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d082b-bb2e-40e9-9678-0e6693c96f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:57.807649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d082b-bb2e-40e9-9678-0e6693c96f5d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:57.808042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d082b-bb2e-40e9-9678-0e6693c96f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:57.808237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d082b-bb2e-40e9-9678-0e6693c96f5d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:57.808890 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d082b-bb2e-40e9-9678-0e6693c96f5d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:57.810398 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d082b-bb2e-40e9-9678-0e6693c96f5d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:57.822576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-253d082b-bb2e-40e9-9678-0e6693c96f5d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 18:48:57.822576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:57.822576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:48:57.822576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:48:57.822576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:48:57.822576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:48:57.822576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:48:57.822576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:57.822576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 18:48:57.822576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:57.822576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:48:57.822576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:57.822576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:48:57.822576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:48:57.822576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:48:57.822576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:48:57.822576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:48:57.824300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:48:57.824300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:48:57.824300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:48:57.824300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:48:57.824300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:48:57.824300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:48:57.824300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:48:57.824300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:48:57.824300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:48:57.824300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:48:57.824300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:48:57.824300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:48:57.824300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:48:57.824300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:48:57.824300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:48:57.824300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:48:57.825185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:48:57.825185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:48:57.825185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:48:57.825185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:48:57.825185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:48:57.825185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:48:57.825185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:48:57.825185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:48:57.825185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:48:57.825185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:48:57.825185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:48:57.825185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:48:57.825185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 18:48:57.825185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:48:57.825185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 510/1001] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 2 18:48:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:48:57.830273 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d082b-bb2e-40e9-9678-0e6693c96f5d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:57.850095 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:57.877995 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f252eb-0db1-43eb-80c7-5e118953eb77 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:57.915665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce7ab0-5a48-42e6-8a74-9680b4ffd917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:57.916374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce7ab0-5a48-42e6-8a74-9680b4ffd917 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:57.916684 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce7ab0-5a48-42e6-8a74-9680b4ffd917 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:57.916963 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce7ab0-5a48-42e6-8a74-9680b4ffd917 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:57.917671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce7ab0-5a48-42e6-8a74-9680b4ffd917 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:57.918005 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce7ab0-5a48-42e6-8a74-9680b4ffd917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:57.919408 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce7ab0-5a48-42e6-8a74-9680b4ffd917 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:57.929271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 492/1002] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 2 18:48:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:57.930530 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce7ab0-5a48-42e6-8a74-9680b4ffd917 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:57.942710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d082b-bb2e-40e9-9678-0e6693c96f5d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:57.979952 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660e799-2938-474f-8804-d06a101f9c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:57.980674 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660e799-2938-474f-8804-d06a101f9c92 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:57.980958 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660e799-2938-474f-8804-d06a101f9c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:57.981280 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660e799-2938-474f-8804-d06a101f9c92 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:57.982021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660e799-2938-474f-8804-d06a101f9c92 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:57.982332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660e799-2938-474f-8804-d06a101f9c92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:57.983875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660e799-2938-474f-8804-d06a101f9c92 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:57.993830 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 511/1003] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 2 18:48:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:57.994918 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660e799-2938-474f-8804-d06a101f9c92 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:58.019125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:58.038067 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce7ab0-5a48-42e6-8a74-9680b4ffd917 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:58.075091 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19822dfc-6ca3-4608-a09c-9964ed1a1597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:58.075780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19822dfc-6ca3-4608-a09c-9964ed1a1597 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:58.076111 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19822dfc-6ca3-4608-a09c-9964ed1a1597 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:58.076394 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19822dfc-6ca3-4608-a09c-9964ed1a1597 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:58.077190 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19822dfc-6ca3-4608-a09c-9964ed1a1597 None admin] RBAC: Adding query filter params (interface=public, service_id=edf7708235d0475c8d6ef4ff7b858e45, region_id=RegionOne) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:58.077501 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19822dfc-6ca3-4608-a09c-9964ed1a1597 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:58.079205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19822dfc-6ca3-4608-a09c-9964ed1a1597 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:58.085235 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 493/1004] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jun 2 18:48:57 2022] GET /identity/v3/endpoints?service_id=edf7708235d0475c8d6ef4ff7b858e45&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:58.091071 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19822dfc-6ca3-4608-a09c-9964ed1a1597 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:58.093776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:58.094162 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660e799-2938-474f-8804-d06a101f9c92 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:58.129617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45854bb9-1c20-464b-8c66-f7c3c0097345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:58.130319 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45854bb9-1c20-464b-8c66-f7c3c0097345 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:58.131242 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45854bb9-1c20-464b-8c66-f7c3c0097345 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:58.131242 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45854bb9-1c20-464b-8c66-f7c3c0097345 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:58.131545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45854bb9-1c20-464b-8c66-f7c3c0097345 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:48:58.131852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45854bb9-1c20-464b-8c66-f7c3c0097345 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:58.133220 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45854bb9-1c20-464b-8c66-f7c3c0097345 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:58.138308 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 512/1005] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 2 18:48:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:48:58.144066 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45854bb9-1c20-464b-8c66-f7c3c0097345 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:58.203869 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19822dfc-6ca3-4608-a09c-9964ed1a1597 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:58.235471 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:58.243306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca85db9-9e2e-405b-b655-bcd376093a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:58.243982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca85db9-9e2e-405b-b655-bcd376093a30 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:58.244257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca85db9-9e2e-405b-b655-bcd376093a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:58.244529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca85db9-9e2e-405b-b655-bcd376093a30 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:58.245263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca85db9-9e2e-405b-b655-bcd376093a30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:58.246669 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca85db9-9e2e-405b-b655-bcd376093a30 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:58.252513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45854bb9-1c20-464b-8c66-f7c3c0097345 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:58.253129 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 494/1006] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jun 2 18:48:58 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 18:48:58.294406 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339cab09-8b29-44a0-80f3-8a6223bbeb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:58.295113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cab09-8b29-44a0-80f3-8a6223bbeb57 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:58.295396 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cab09-8b29-44a0-80f3-8a6223bbeb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:58.295656 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cab09-8b29-44a0-80f3-8a6223bbeb57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:58.296448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339cab09-8b29-44a0-80f3-8a6223bbeb57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:58.298005 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339cab09-8b29-44a0-80f3-8a6223bbeb57 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:58.321843 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 513/1007] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jun 2 18:48:58 2022] POST /identity/v3/endpoints => generated 325 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:48:58.622851 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cebbb-1a5d-4092-8b74-b5aabe12a3d3 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:58.623385 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cebbb-1a5d-4092-8b74-b5aabe12a3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:58.623385 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cebbb-1a5d-4092-8b74-b5aabe12a3d3 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:58.624908 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 495/1008] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:48:58.630052 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d37bb-7da0-426b-ae08-6b9f09181701 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:58.630334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d37bb-7da0-426b-ae08-6b9f09181701 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:58.630613 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d37bb-7da0-426b-ae08-6b9f09181701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:58.649651 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e06d37bb-7da0-426b-ae08-6b9f09181701 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:48:58.650881 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e06d37bb-7da0-426b-ae08-6b9f09181701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:48:58.727071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 514/1009] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:48:58 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:48:58.749867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845cebbb-1a5d-4092-8b74-b5aabe12a3d3 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:48:58.822511 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:48:58.864732 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845cebbb-1a5d-4092-8b74-b5aabe12a3d3 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:48:58.900191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97724b97-5bda-4fa1-962f-977d2b56141e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:48:58.901170 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97724b97-5bda-4fa1-962f-977d2b56141e None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:48:58.901618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97724b97-5bda-4fa1-962f-977d2b56141e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:48:58.902231 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97724b97-5bda-4fa1-962f-977d2b56141e None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:48:58.903089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97724b97-5bda-4fa1-962f-977d2b56141e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:48:58.904605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97724b97-5bda-4fa1-962f-977d2b56141e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:48:58.920556 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 496/1010] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 2 18:48:58 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:49:00.527079 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e3ea7-9d46-478b-94b3-bbe017b0603c None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:00.527654 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e3ea7-9d46-478b-94b3-bbe017b0603c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:00.527654 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e3ea7-9d46-478b-94b3-bbe017b0603c None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:00.529408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 515/1011] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:00.535430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace8862-b339-428e-965c-6caece9da889 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:00.535940 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace8862-b339-428e-965c-6caece9da889 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:00.536173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace8862-b339-428e-965c-6caece9da889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:00.554317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-cace8862-b339-428e-965c-6caece9da889 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:00.555516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-cace8862-b339-428e-965c-6caece9da889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:00.633241 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 497/1012] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:00 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:00.657037 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e3ea7-9d46-478b-94b3-bbe017b0603c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:00.662571 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4a065-8788-4408-87d5-d35a8d035e83 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:00.662856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4a065-8788-4408-87d5-d35a8d035e83 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:00.663131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4a065-8788-4408-87d5-d35a8d035e83 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:00.664686 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 498/1013] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:49:00.669896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d41a47-cfd2-4832-9102-df0372a97c3a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:00.670181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d41a47-cfd2-4832-9102-df0372a97c3a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:00.670463 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d41a47-cfd2-4832-9102-df0372a97c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:00.687103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-96d41a47-cfd2-4832-9102-df0372a97c3a None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:00.688311 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-96d41a47-cfd2-4832-9102-df0372a97c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:00.737949 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:00.738512 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:00.760910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 499/1014] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:00 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:49:00.773107 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e3ea7-9d46-478b-94b3-bbe017b0603c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:00.784803 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d41a47-cfd2-4832-9102-df0372a97c3a None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:00.812703 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7fc06-a09b-45d4-8ec9-5c33b753a7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:00.813787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7fc06-a09b-45d4-8ec9-5c33b753a7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:00.814102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7fc06-a09b-45d4-8ec9-5c33b753a7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:00.814376 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7fc06-a09b-45d4-8ec9-5c33b753a7b2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:00.815223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7fc06-a09b-45d4-8ec9-5c33b753a7b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:00.817302 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7fc06-a09b-45d4-8ec9-5c33b753a7b2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:00.834133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-9fd7fc06-a09b-45d4-8ec9-5c33b753a7b2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 18:49:00.834133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:00.834133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:49:00.834133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:49:00.834133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:49:00.834133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:49:00.834133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:49:00.834133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:49:00.834133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 18:49:00.834133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:49:00.834133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:49:00.834133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:49:00.834133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:00.834133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:00.834133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:00.834133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:00.834133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:00.835224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:00.835224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:00.835224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:00.835224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:00.835224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:00.835224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:00.835224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:49:00.835224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:49:00.835224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:49:00.835224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:49:00.835224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:00.835224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:00.835224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:00.835224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:00.835224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:00.835224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:00.836057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:00.836057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:00.836057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:00.836057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:00.836057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:00.836057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:00.836057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:00.836057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:00.836057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:00.836057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:00.836057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:49:00.836057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:49:00.836057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 18:49:00.836057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:49:00.836057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 516/1015] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:49:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:49:00.842169 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7fc06-a09b-45d4-8ec9-5c33b753a7b2 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:00.892552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d41a47-cfd2-4832-9102-df0372a97c3a None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:00.929636 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d247e18-ff1f-4a52-b442-1efae2115cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:00.930465 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d247e18-ff1f-4a52-b442-1efae2115cfb None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:00.930740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d247e18-ff1f-4a52-b442-1efae2115cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:00.931010 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d247e18-ff1f-4a52-b442-1efae2115cfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:00.932310 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d247e18-ff1f-4a52-b442-1efae2115cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:00.934140 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d247e18-ff1f-4a52-b442-1efae2115cfb None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:00.935774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 500/1016] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:49:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:49:00.941773 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d247e18-ff1f-4a52-b442-1efae2115cfb None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:00.966649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7fc06-a09b-45d4-8ec9-5c33b753a7b2 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:00.993172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:01.009368 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed138f11-09a1-44fc-a4e9-e272de284a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:01.010082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed138f11-09a1-44fc-a4e9-e272de284a15 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:01.010478 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed138f11-09a1-44fc-a4e9-e272de284a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:01.010802 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed138f11-09a1-44fc-a4e9-e272de284a15 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:01.011524 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed138f11-09a1-44fc-a4e9-e272de284a15 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:01.011836 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed138f11-09a1-44fc-a4e9-e272de284a15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:01.013225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed138f11-09a1-44fc-a4e9-e272de284a15 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:01.015439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:01.019336 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 517/1017] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 2 18:49:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:49:01.024824 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed138f11-09a1-44fc-a4e9-e272de284a15 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:01.053121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d247e18-ff1f-4a52-b442-1efae2115cfb None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:01.090602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f6de1-88c1-4ca2-b11d-230e6b5b158d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:01.091268 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f6de1-88c1-4ca2-b11d-230e6b5b158d None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:01.091547 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f6de1-88c1-4ca2-b11d-230e6b5b158d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:01.091816 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f6de1-88c1-4ca2-b11d-230e6b5b158d None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:01.092611 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f6de1-88c1-4ca2-b11d-230e6b5b158d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:01.094092 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f6de1-88c1-4ca2-b11d-230e6b5b158d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:01.131003 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed138f11-09a1-44fc-a4e9-e272de284a15 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:01.134277 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 501/1018] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 2 18:49:00 2022] POST /identity/v3/projects => generated 311 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:49:01.156236 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a310a22-1a32-47ac-ba7c-25bb84a87816 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:01.156467 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a310a22-1a32-47ac-ba7c-25bb84a87816 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:01.156750 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a310a22-1a32-47ac-ba7c-25bb84a87816 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:01.158448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 502/1019] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:49:01.164563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f845a3b-bd7d-4528-9f0e-4058b2045091 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:01.164825 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f845a3b-bd7d-4528-9f0e-4058b2045091 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:01.165108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f845a3b-bd7d-4528-9f0e-4058b2045091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:01.172904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ed9b2-1f3d-415d-a66b-95f4054c64fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:01.173592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ed9b2-1f3d-415d-a66b-95f4054c64fd None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:01.173903 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ed9b2-1f3d-415d-a66b-95f4054c64fd None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:01.174174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ed9b2-1f3d-415d-a66b-95f4054c64fd None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:01.174885 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ed9b2-1f3d-415d-a66b-95f4054c64fd None admin] RBAC: Adding query filter params (type=compute) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:01.175191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ed9b2-1f3d-415d-a66b-95f4054c64fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:01.176592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ed9b2-1f3d-415d-a66b-95f4054c64fd None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:01.183093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 518/1020] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 2 18:49:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:49:01.184145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-3f845a3b-bd7d-4528-9f0e-4058b2045091 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:01.185355 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3f845a3b-bd7d-4528-9f0e-4058b2045091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:01.188980 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ed9b2-1f3d-415d-a66b-95f4054c64fd None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:01.265413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 503/1021] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:01 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:49:01.268919 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:01.288993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f845a3b-bd7d-4528-9f0e-4058b2045091 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:01.314298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ed9b2-1f3d-415d-a66b-95f4054c64fd None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:01.326289 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:01.360494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cfa9b-5f7a-4711-b8ab-2e8576eb21f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:01.361174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cfa9b-5f7a-4711-b8ab-2e8576eb21f7 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:01.361453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cfa9b-5f7a-4711-b8ab-2e8576eb21f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:01.361726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cfa9b-5f7a-4711-b8ab-2e8576eb21f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:01.362525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cfa9b-5f7a-4711-b8ab-2e8576eb21f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:01.363917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cfa9b-5f7a-4711-b8ab-2e8576eb21f7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:01.393053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 519/1022] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jun 2 18:49:01 2022] POST /identity/v3/endpoints => generated 334 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 18:49:01.416349 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f845a3b-bd7d-4528-9f0e-4058b2045091 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:01.462097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffceb21f-a408-4689-ba1a-a0e176fa1c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:01.462921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffceb21f-a408-4689-ba1a-a0e176fa1c68 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:01.463200 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffceb21f-a408-4689-ba1a-a0e176fa1c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:01.463572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffceb21f-a408-4689-ba1a-a0e176fa1c68 None admin] PATH_INFO: `/v3/services/image` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:01.464252 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffceb21f-a408-4689-ba1a-a0e176fa1c68 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:01.465690 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffceb21f-a408-4689-ba1a-a0e176fa1c68 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:01.478505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-ffceb21f-a408-4689-ba1a-a0e176fa1c68 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 18:49:01.478505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:01.478505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:49:01.478505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:49:01.478505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:49:01.478505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:49:01.478505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:49:01.478505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:49:01.478505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 18:49:01.478505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:01.478505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:49:01.478505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:01.478505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:01.478505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:01.478505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:01.478505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:01.478505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:01.480080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:01.480080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:01.480080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:01.480080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:01.480080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:01.480080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:01.480080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:49:01.480080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:49:01.480080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:49:01.480080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:49:01.480080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:01.480080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:01.480080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:01.480080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:01.480080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:01.480080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:01.480957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:01.480957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:01.480957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:01.480957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:01.480957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:01.480957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:01.480957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:01.480957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:01.480957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:01.480957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:01.480957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:49:01.480957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:49:01.480957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 18:49:01.480957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:01.480957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 504/1023] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Jun 2 18:49:01 2022] GET /identity/v3/services/image => generated 86 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:49:01.486364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cfa9b-5f7a-4711-b8ab-2e8576eb21f7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:01.617266 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cfa9b-5f7a-4711-b8ab-2e8576eb21f7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:01.640159 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:01.654861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb75654-48ea-4cfd-898d-f0ecd9562299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:01.655535 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb75654-48ea-4cfd-898d-f0ecd9562299 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:01.655818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb75654-48ea-4cfd-898d-f0ecd9562299 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:01.656092 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb75654-48ea-4cfd-898d-f0ecd9562299 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:01.656808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb75654-48ea-4cfd-898d-f0ecd9562299 None admin] RBAC: Adding query filter params (name=image) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:01.657145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb75654-48ea-4cfd-898d-f0ecd9562299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:01.658592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb75654-48ea-4cfd-898d-f0ecd9562299 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:01.663771 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 520/1024] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:49:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:01.669666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffceb21f-a408-4689-ba1a-a0e176fa1c68 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:01.767948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:01.777755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffceb21f-a408-4689-ba1a-a0e176fa1c68 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:01.813483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0be092-9df3-4009-b105-3d6dc03fadbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:01.814188 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0be092-9df3-4009-b105-3d6dc03fadbe None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:01.814474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0be092-9df3-4009-b105-3d6dc03fadbe None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:01.814733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0be092-9df3-4009-b105-3d6dc03fadbe None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:01.815441 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0be092-9df3-4009-b105-3d6dc03fadbe None admin] RBAC: Adding query filter params (type=image) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:01.815748 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0be092-9df3-4009-b105-3d6dc03fadbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:01.817132 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0be092-9df3-4009-b105-3d6dc03fadbe None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:01.822494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 505/1025] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:49:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:01.828278 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb75654-48ea-4cfd-898d-f0ecd9562299 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:01.931946 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb75654-48ea-4cfd-898d-f0ecd9562299 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:01.967418 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e9a4e-76ae-48c3-bea5-eae5e76090bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:01.968092 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e9a4e-76ae-48c3-bea5-eae5e76090bf None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:01.968374 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e9a4e-76ae-48c3-bea5-eae5e76090bf None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:01.968642 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e9a4e-76ae-48c3-bea5-eae5e76090bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:01.969432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e9a4e-76ae-48c3-bea5-eae5e76090bf None admin] RBAC: Adding query filter params (interface=public, service_id=f6ebda71682b4c948b2c8259841971cb, region_id=RegionOne) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:01.969747 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e9a4e-76ae-48c3-bea5-eae5e76090bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:01.971164 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e9a4e-76ae-48c3-bea5-eae5e76090bf None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:01.976735 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 521/1026] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jun 2 18:49:01 2022] GET /identity/v3/endpoints?service_id=f6ebda71682b4c948b2c8259841971cb&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:01.982211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0be092-9df3-4009-b105-3d6dc03fadbe None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:02.085294 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0be092-9df3-4009-b105-3d6dc03fadbe None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:02.119347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d19a68-e4bc-4c7a-b99a-dad7ccbeda34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:02.120165 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d19a68-e4bc-4c7a-b99a-dad7ccbeda34 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:02.120423 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d19a68-e4bc-4c7a-b99a-dad7ccbeda34 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:02.120724 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d19a68-e4bc-4c7a-b99a-dad7ccbeda34 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:02.121412 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d19a68-e4bc-4c7a-b99a-dad7ccbeda34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:02.122830 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d19a68-e4bc-4c7a-b99a-dad7ccbeda34 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:02.129716 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 506/1027] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jun 2 18:49:01 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 18:49:03.420584 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3a6b8-6c57-47dc-b027-18b626289904 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:03.421193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3a6b8-6c57-47dc-b027-18b626289904 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:03.421193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3a6b8-6c57-47dc-b027-18b626289904 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:03.422749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 522/1028] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:03.428602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf0614-82ba-466d-905f-91ab0a3673f3 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:03.429084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf0614-82ba-466d-905f-91ab0a3673f3 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:03.429294 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf0614-82ba-466d-905f-91ab0a3673f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:03.448616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-42bf0614-82ba-466d-905f-91ab0a3673f3 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:03.449897 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-42bf0614-82ba-466d-905f-91ab0a3673f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:03.469472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:03.531234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 507/1029] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:03.555998 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3a6b8-6c57-47dc-b027-18b626289904 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:03.611620 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:03.666599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3a6b8-6c57-47dc-b027-18b626289904 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:03.700749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9df06f-1d6e-467c-89cf-eaafee3eca3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:03.701476 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9df06f-1d6e-467c-89cf-eaafee3eca3f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:03.701755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9df06f-1d6e-467c-89cf-eaafee3eca3f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:03.702047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9df06f-1d6e-467c-89cf-eaafee3eca3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:03.703204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9df06f-1d6e-467c-89cf-eaafee3eca3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:03.704639 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9df06f-1d6e-467c-89cf-eaafee3eca3f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:03.706460 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 523/1030] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:49:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:03.712427 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf0614-82ba-466d-905f-91ab0a3673f3 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:03.774546 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51adcbb-4cfc-4977-b5dd-a274874eb65a None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:03.774893 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51adcbb-4cfc-4977-b5dd-a274874eb65a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:03.775105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51adcbb-4cfc-4977-b5dd-a274874eb65a None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:03.776537 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 524/1031] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:49:03.781414 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66a974-a11c-446e-b2b2-66c046fbc340 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:03.781702 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66a974-a11c-446e-b2b2-66c046fbc340 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:03.782015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66a974-a11c-446e-b2b2-66c046fbc340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:03.799674 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5a66a974-a11c-446e-b2b2-66c046fbc340 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:03.800890 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5a66a974-a11c-446e-b2b2-66c046fbc340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:03.818665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf0614-82ba-466d-905f-91ab0a3673f3 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:03.854372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebe4b1-ae54-4a72-9309-fb2faf39d352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:03.855057 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebe4b1-ae54-4a72-9309-fb2faf39d352 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:03.855347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebe4b1-ae54-4a72-9309-fb2faf39d352 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:03.855626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebe4b1-ae54-4a72-9309-fb2faf39d352 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:03.856338 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebe4b1-ae54-4a72-9309-fb2faf39d352 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:03.857811 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebe4b1-ae54-4a72-9309-fb2faf39d352 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:03.878962 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 525/1032] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:49:03.881889 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 508/1033] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 2 18:49:03 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:49:03.902847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebe4b1-ae54-4a72-9309-fb2faf39d352 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:03.912741 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:04.017038 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebe4b1-ae54-4a72-9309-fb2faf39d352 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:04.055347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e151c-74a1-443e-82ce-e38a283ca52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:04.056172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e151c-74a1-443e-82ce-e38a283ca52b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:04.056456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e151c-74a1-443e-82ce-e38a283ca52b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:04.056728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e151c-74a1-443e-82ce-e38a283ca52b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:04.069616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e151c-74a1-443e-82ce-e38a283ca52b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:49:04.078488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-8c3e151c-74a1-443e-82ce-e38a283ca52b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 18:49:04.078488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:04.078488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:04.078488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:04.078488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:04.078488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:04.078488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:04.078488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:04.078488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:04.078488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:04.078488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:04.078488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:04.078488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:49:04.078488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:49:04.078488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:49:04.078488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:49:04.079531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:49:04.079531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:49:04.079531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:49:04.079531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:49:04.079531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:04.079531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:04.079531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:04.079531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:04.079531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:04.079531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:04.079531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:04.079531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:04.079531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:04.079531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:04.079531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:04.079531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:04.086206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:04.086206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:04.086206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:04.086206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:04.086206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:49:04.086206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:49:04.086206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:49:04.086206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:49:04.086206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:49:04.086206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:49:04.086206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 18:49:04.086206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:04.086206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 509/1034] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Jun 2 18:49:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:04.088128 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66a974-a11c-446e-b2b2-66c046fbc340 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:04.141623 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:04.197300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66a974-a11c-446e-b2b2-66c046fbc340 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:04.231681 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d383da-f69e-4134-8c92-5d17d3535fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:04.232413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d383da-f69e-4134-8c92-5d17d3535fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:04.232788 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d383da-f69e-4134-8c92-5d17d3535fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:04.233143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d383da-f69e-4134-8c92-5d17d3535fb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:04.234003 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d383da-f69e-4134-8c92-5d17d3535fb4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:04.234313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d383da-f69e-4134-8c92-5d17d3535fb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:04.235920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d383da-f69e-4134-8c92-5d17d3535fb4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:04.245941 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 526/1035] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jun 2 18:49:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:04.251674 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e151c-74a1-443e-82ce-e38a283ca52b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:04.324890 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:04.363965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e151c-74a1-443e-82ce-e38a283ca52b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:04.400339 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9738c-5206-4cac-9180-14545e7513a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:04.401715 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9738c-5206-4cac-9180-14545e7513a1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:04.402027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9738c-5206-4cac-9180-14545e7513a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:04.402304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9738c-5206-4cac-9180-14545e7513a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:04.413325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9738c-5206-4cac-9180-14545e7513a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:04.414826 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9738c-5206-4cac-9180-14545e7513a1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:04.417224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f1bb3-29f0-4465-bd21-4e0d33cee3ec None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:04.417752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f1bb3-29f0-4465-bd21-4e0d33cee3ec None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:04.418171 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f1bb3-29f0-4465-bd21-4e0d33cee3ec None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:04.420090 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 527/1036] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:04.425059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b764d71-e5b3-4103-ad2e-26c9b3c005ea None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:04.425615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b764d71-e5b3-4103-ad2e-26c9b3c005ea None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:04.425615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b764d71-e5b3-4103-ad2e-26c9b3c005ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:04.436967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-2da9738c-5206-4cac-9180-14545e7513a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:49:04.436967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:04.436967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:04.436967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:04.436967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:04.436967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:04.436967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:04.436967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:04.436967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:04.436967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:04.436967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:04.436967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:04.436967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:49:04.436967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:49:04.436967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:49:04.438305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:49:04.438305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:04.438305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:04.438305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:04.438305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:04.438305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:04.438305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:04.438305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:04.438305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:04.438305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:04.438305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:04.438305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:04.438305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:04.438305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:04.438305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:04.438305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:04.438305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:04.439180 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:49:04.439180 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:49:04.439180 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:49:04.439180 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:04.439180 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 510/1037] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:04.444888 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4b764d71-e5b3-4103-ad2e-26c9b3c005ea None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:04.445032 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9738c-5206-4cac-9180-14545e7513a1 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:04.446113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4b764d71-e5b3-4103-ad2e-26c9b3c005ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:04.525860 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 528/1038] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:49:04.543142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b764d71-e5b3-4103-ad2e-26c9b3c005ea None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:04.555164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9738c-5206-4cac-9180-14545e7513a1 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:04.574126 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:04.590383 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:04.593038 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e379b6-a6c3-46e0-8e56-bafdc2a74682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:04.593825 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e379b6-a6c3-46e0-8e56-bafdc2a74682 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:04.594139 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e379b6-a6c3-46e0-8e56-bafdc2a74682 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:04.594499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e379b6-a6c3-46e0-8e56-bafdc2a74682 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:04.595280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e379b6-a6c3-46e0-8e56-bafdc2a74682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:04.595577 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e379b6-a6c3-46e0-8e56-bafdc2a74682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:04.596973 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e379b6-a6c3-46e0-8e56-bafdc2a74682 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:04.610070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 511/1039] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:04.618019 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e379b6-a6c3-46e0-8e56-bafdc2a74682 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:04.676644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b764d71-e5b3-4103-ad2e-26c9b3c005ea None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:04.712650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7be957-82da-4b78-a346-06da98854848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:04.713697 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be957-82da-4b78-a346-06da98854848 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:04.714005 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be957-82da-4b78-a346-06da98854848 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:04.714281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be957-82da-4b78-a346-06da98854848 None admin] PATH_INFO: `/v3/services/image` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:04.714928 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7be957-82da-4b78-a346-06da98854848 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:04.716331 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7be957-82da-4b78-a346-06da98854848 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:04.728059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-6c7be957-82da-4b78-a346-06da98854848 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 18:49:04.728059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:04.728059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:49:04.728059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:49:04.728059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:49:04.728059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:49:04.728059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:49:04.728059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:49:04.728059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 18:49:04.728059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:49:04.728059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:49:04.728059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:49:04.728059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:04.728059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:04.728059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:04.728059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:04.728059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:04.729120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:04.729120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:04.729120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:04.729120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:04.729120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:04.729120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:04.729120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:49:04.729120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:49:04.729120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:49:04.729120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:49:04.729120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:04.729120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:04.729120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:04.729120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:04.729120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:04.729120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:04.730093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:04.730093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:04.730093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:04.730093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:04.730093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:04.730093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:04.730093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:04.730093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:04.730093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:04.730093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:04.730093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:49:04.730093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:49:04.730093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 18:49:04.730093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:49:04.734558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 529/1040] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Jun 2 18:49:04 2022] GET /identity/v3/services/image => generated 86 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:04.735559 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7be957-82da-4b78-a346-06da98854848 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:04.741552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e379b6-a6c3-46e0-8e56-bafdc2a74682 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:04.777651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce209a84-1e77-4732-8bea-3f88b99cfc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:04.778490 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce209a84-1e77-4732-8bea-3f88b99cfc5b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:04.778773 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce209a84-1e77-4732-8bea-3f88b99cfc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:04.779045 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce209a84-1e77-4732-8bea-3f88b99cfc5b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:04.786532 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce209a84-1e77-4732-8bea-3f88b99cfc5b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:04.787991 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce209a84-1e77-4732-8bea-3f88b99cfc5b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:04.802647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-ce209a84-1e77-4732-8bea-3f88b99cfc5b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 18:49:04.802647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:04.802647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:04.802647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:04.802647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:04.802647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:04.802647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:04.802647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:04.802647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:04.802647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:04.802647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:04.802647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:04.802647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:49:04.802647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:49:04.802647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:49:04.802647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:49:04.803634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:04.803634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:04.803634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:49:04.803634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:49:04.803634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:49:04.803634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:49:04.803634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:04.803634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:04.803634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:04.803634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:04.803634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:04.803634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:04.803634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:04.803634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:04.803634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:04.803634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:04.803634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:04.803634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:04.804590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:04.804590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:04.804590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:49:04.804590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:49:04.804590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:49:04.804590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:49:04.804590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:49:04.804590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:49:04.804590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 18:49:04.804590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:04.804590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 512/1041] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jun 2 18:49:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:49:04.809891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce209a84-1e77-4732-8bea-3f88b99cfc5b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:04.840590 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7be957-82da-4b78-a346-06da98854848 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:04.842074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:04.859902 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:04.876811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e275e79-cb24-4c8e-afdb-e1837901f31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:04.877669 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e275e79-cb24-4c8e-afdb-e1837901f31d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:04.877780 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e275e79-cb24-4c8e-afdb-e1837901f31d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:04.878040 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e275e79-cb24-4c8e-afdb-e1837901f31d None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:04.878736 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e275e79-cb24-4c8e-afdb-e1837901f31d None admin] RBAC: Adding query filter params (name=image) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:04.879039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e275e79-cb24-4c8e-afdb-e1837901f31d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:04.880398 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e275e79-cb24-4c8e-afdb-e1837901f31d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:04.890407 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 530/1042] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:49:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:04.891371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e275e79-cb24-4c8e-afdb-e1837901f31d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:04.926387 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce209a84-1e77-4732-8bea-3f88b99cfc5b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:04.969047 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949be15c-7b04-46e2-a61b-d396251c62e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:04.969740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949be15c-7b04-46e2-a61b-d396251c62e3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:04.970054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949be15c-7b04-46e2-a61b-d396251c62e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:04.970332 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949be15c-7b04-46e2-a61b-d396251c62e3 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:04.971182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949be15c-7b04-46e2-a61b-d396251c62e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:04.971494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949be15c-7b04-46e2-a61b-d396251c62e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:04.973048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949be15c-7b04-46e2-a61b-d396251c62e3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:04.991603 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 513/1043] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jun 2 18:49:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:04.997396 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949be15c-7b04-46e2-a61b-d396251c62e3 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:05.012068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e275e79-cb24-4c8e-afdb-e1837901f31d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:05.048133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625b31c-3fd6-4d71-b148-8e92b2988e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:05.049182 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625b31c-3fd6-4d71-b148-8e92b2988e0d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:05.049473 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625b31c-3fd6-4d71-b148-8e92b2988e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:05.049757 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625b31c-3fd6-4d71-b148-8e92b2988e0d None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:05.050575 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625b31c-3fd6-4d71-b148-8e92b2988e0d None admin] RBAC: Adding query filter params (type=image) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:05.050897 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625b31c-3fd6-4d71-b148-8e92b2988e0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:05.052283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625b31c-3fd6-4d71-b148-8e92b2988e0d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:05.062270 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 531/1044] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:49:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:49:05.063223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625b31c-3fd6-4d71-b148-8e92b2988e0d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:05.096372 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:05.101579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:05.108774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949be15c-7b04-46e2-a61b-d396251c62e3 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:05.148842 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67879ea-a006-476a-b540-e38977c0f902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:05.149833 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67879ea-a006-476a-b540-e38977c0f902 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:05.150314 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67879ea-a006-476a-b540-e38977c0f902 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:05.150564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67879ea-a006-476a-b540-e38977c0f902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:05.172698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625b31c-3fd6-4d71-b148-8e92b2988e0d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:05.209966 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0500050-e547-4a45-afae-716c41774fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:05.211044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0500050-e547-4a45-afae-716c41774fe5 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:05.211550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0500050-e547-4a45-afae-716c41774fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:05.212014 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0500050-e547-4a45-afae-716c41774fe5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:05.212880 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0500050-e547-4a45-afae-716c41774fe5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:05.214749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0500050-e547-4a45-afae-716c41774fe5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:05.220588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67879ea-a006-476a-b540-e38977c0f902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:05.222078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67879ea-a006-476a-b540-e38977c0f902 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:05.238658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 532/1045] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jun 2 18:49:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:49:05.343760 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:05.353058 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 514/1046] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:49:04 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 18:49:05.358918 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0500050-e547-4a45-afae-716c41774fe5 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:05.455951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:05.481201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0500050-e547-4a45-afae-716c41774fe5 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:05.527722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcf23a-eac1-431a-af88-8a5f69017670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:05.528925 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcf23a-eac1-431a-af88-8a5f69017670 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:05.529425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcf23a-eac1-431a-af88-8a5f69017670 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:05.529946 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcf23a-eac1-431a-af88-8a5f69017670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:05.542840 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcf23a-eac1-431a-af88-8a5f69017670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:05.544410 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcf23a-eac1-431a-af88-8a5f69017670 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:05.562340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-73dcf23a-eac1-431a-af88-8a5f69017670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:49:05.562340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:05.562340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:05.562340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:05.562340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:05.562340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:05.562340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:05.562340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:05.562340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:05.562340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:05.562340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:05.562340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:05.562340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:49:05.562340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:49:05.562340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:49:05.563314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:49:05.563314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:05.563314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:05.563314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:05.563314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:05.563314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:05.563314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:05.563314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:05.563314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:05.563314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:05.563314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:05.563314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:05.563314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:05.563314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:05.563314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:05.563314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:05.563314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:05.564281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:49:05.564281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:49:05.564281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:49:05.564281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:49:05.564281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 533/1047] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:49:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:05.570814 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67879ea-a006-476a-b540-e38977c0f902 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:05.675624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67879ea-a006-476a-b540-e38977c0f902 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:05.711572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b9e29-7169-4fdc-bd8d-5317b0584fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:05.712148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b9e29-7169-4fdc-bd8d-5317b0584fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:05.712425 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b9e29-7169-4fdc-bd8d-5317b0584fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:05.712698 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b9e29-7169-4fdc-bd8d-5317b0584fc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:05.713752 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b9e29-7169-4fdc-bd8d-5317b0584fc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:05.714082 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b9e29-7169-4fdc-bd8d-5317b0584fc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:05.715469 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b9e29-7169-4fdc-bd8d-5317b0584fc7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:05.727279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 515/1048] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:49:05.732822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcf23a-eac1-431a-af88-8a5f69017670 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:05.834124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcf23a-eac1-431a-af88-8a5f69017670 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:05.867970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2b548-a145-4088-b67e-90f307e9a2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:05.868792 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2b548-a145-4088-b67e-90f307e9a2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:05.869060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2b548-a145-4088-b67e-90f307e9a2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:05.869331 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2b548-a145-4088-b67e-90f307e9a2f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:05.871682 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:05.878966 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2b548-a145-4088-b67e-90f307e9a2f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:05.880516 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2b548-a145-4088-b67e-90f307e9a2f3 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:05.896337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-aaf2b548-a145-4088-b67e-90f307e9a2f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:49:05.896337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:05.896337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:05.896337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:05.896337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:05.896337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:05.896337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:05.896337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:05.896337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:05.896337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:05.896337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:05.896337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:05.896337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:49:05.896337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:49:05.896337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:49:05.897381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:49:05.897381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:05.897381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:05.897381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:05.897381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:05.897381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:05.897381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:05.897381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:05.897381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:05.897381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:05.897381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:05.897381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:05.897381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:05.897381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:05.897381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:05.897381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:05.897381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:05.898337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:49:05.898337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:49:05.898337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:49:05.898337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:49:05.898337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:49:05.898337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:49:05.898337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:49:05.898337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:49:05.899626 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 534/1049] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:49:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:05.903788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b9e29-7169-4fdc-bd8d-5317b0584fc7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:05.965679 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:06.011494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b9e29-7169-4fdc-bd8d-5317b0584fc7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:06.047361 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abce70-3fc1-48b1-a815-288a5c5b7e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:06.048023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abce70-3fc1-48b1-a815-288a5c5b7e13 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:06.048304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abce70-3fc1-48b1-a815-288a5c5b7e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:06.048690 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abce70-3fc1-48b1-a815-288a5c5b7e13 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:06.049472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abce70-3fc1-48b1-a815-288a5c5b7e13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:06.049780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abce70-3fc1-48b1-a815-288a5c5b7e13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:06.051239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abce70-3fc1-48b1-a815-288a5c5b7e13 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:06.068964 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 516/1050] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:49:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:06.070230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2b548-a145-4088-b67e-90f307e9a2f3 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:06.173274 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2b548-a145-4088-b67e-90f307e9a2f3 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:06.208724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e5aa4-edea-43b3-a651-eb811ae76202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:06.209527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e5aa4-edea-43b3-a651-eb811ae76202 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:06.209934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e5aa4-edea-43b3-a651-eb811ae76202 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:06.210295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e5aa4-edea-43b3-a651-eb811ae76202 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:06.211237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e5aa4-edea-43b3-a651-eb811ae76202 None admin] RBAC: Adding query filter params (role.id=a1ccf0afb5d6486cac2bf01dc16f56fa, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=6b8ff9f5032e498db3c70c79cc11989b) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:06.211685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e5aa4-edea-43b3-a651-eb811ae76202 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:06.213289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e5aa4-edea-43b3-a651-eb811ae76202 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:06.213566 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb85ac4-511d-468c-846d-cabbc3bb4457 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:06.213923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb85ac4-511d-468c-846d-cabbc3bb4457 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:06.214255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb85ac4-511d-468c-846d-cabbc3bb4457 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:06.215858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 517/1051] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:06.219889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 535/1052] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:49:06 2022] GET /identity/v3/role_assignments?user.id=6b8ff9f5032e498db3c70c79cc11989b&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=a1ccf0afb5d6486cac2bf01dc16f56fa => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:49:06.220877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c403f6b-ee31-4c88-b600-f4e61a26efc9 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:06.221210 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c403f6b-ee31-4c88-b600-f4e61a26efc9 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:06.221489 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c403f6b-ee31-4c88-b600-f4e61a26efc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:06.240918 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4c403f6b-ee31-4c88-b600-f4e61a26efc9 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:06.242218 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4c403f6b-ee31-4c88-b600-f4e61a26efc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:06.320619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 518/1053] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:06.345167 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e5aa4-edea-43b3-a651-eb811ae76202 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:06.415645 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:06.461913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e5aa4-edea-43b3-a651-eb811ae76202 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:06.498558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367ee6f-63bf-4402-8fb8-5e8691127724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:06.499279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367ee6f-63bf-4402-8fb8-5e8691127724 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:06.499557 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367ee6f-63bf-4402-8fb8-5e8691127724 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:06.499833 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367ee6f-63bf-4402-8fb8-5e8691127724 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:06.511209 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367ee6f-63bf-4402-8fb8-5e8691127724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:49:06.525782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-1367ee6f-63bf-4402-8fb8-5e8691127724 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:49:06.525782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:06.525782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:06.525782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:06.525782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:06.525782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:06.525782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:06.525782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:06.525782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:06.525782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:06.525782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:06.525782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:06.525782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:49:06.525782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:49:06.525782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:49:06.525782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:49:06.526822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:49:06.526822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:49:06.526822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:49:06.526822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:49:06.526822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:06.526822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:06.526822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:06.526822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:06.526822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:06.526822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:06.526822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:06.526822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:06.526822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:06.526822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:06.526822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:06.526822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:06.527662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:06.527662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:06.527662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:06.527662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:06.527662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:49:06.527662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:49:06.527662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:49:06.527662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:49:06.527662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:49:06.527662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:49:06.527662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:49:06.527662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:49:06.527662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 536/1054] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:49:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:06.535147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c403f6b-ee31-4c88-b600-f4e61a26efc9 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:06.590533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:06.660557 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c403f6b-ee31-4c88-b600-f4e61a26efc9 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:06.695097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19f2ce-8b35-47bf-983f-651832321a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:06.695770 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19f2ce-8b35-47bf-983f-651832321a60 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:06.696045 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19f2ce-8b35-47bf-983f-651832321a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:06.696316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19f2ce-8b35-47bf-983f-651832321a60 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:06.697062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19f2ce-8b35-47bf-983f-651832321a60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:06.697366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19f2ce-8b35-47bf-983f-651832321a60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:06.698933 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19f2ce-8b35-47bf-983f-651832321a60 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:06.712444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 519/1055] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:49:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:06.715347 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367ee6f-63bf-4402-8fb8-5e8691127724 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:06.822346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367ee6f-63bf-4402-8fb8-5e8691127724 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:06.841286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:06.861749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8d084-0f0a-450e-9012-1e5af64de515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:06.862860 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8d084-0f0a-450e-9012-1e5af64de515 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:06.863267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8d084-0f0a-450e-9012-1e5af64de515 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:06.863686 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8d084-0f0a-450e-9012-1e5af64de515 None admin] PATH_INFO: `/v3/users/27d4ba6d1fba4332b800364e4393e6b0` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:06.879134 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8d084-0f0a-450e-9012-1e5af64de515 None admin] RBAC: Authorizing `identity:get_user(user_id=27d4ba6d1fba4332b800364e4393e6b0)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:06.880590 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8d084-0f0a-450e-9012-1e5af64de515 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:06.882541 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 537/1056] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:49:06 2022] GET /identity/v3/users/27d4ba6d1fba4332b800364e4393e6b0 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:06.888296 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19f2ce-8b35-47bf-983f-651832321a60 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:06.995747 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19f2ce-8b35-47bf-983f-651832321a60 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:07.005041 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:07.033433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671af818-4d9c-4873-85c1-ec402f363236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:07.034117 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671af818-4d9c-4873-85c1-ec402f363236 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:07.034394 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671af818-4d9c-4873-85c1-ec402f363236 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:07.034663 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671af818-4d9c-4873-85c1-ec402f363236 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:07.105632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671af818-4d9c-4873-85c1-ec402f363236 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:07.107058 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671af818-4d9c-4873-85c1-ec402f363236 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:07.209179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 520/1057] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:49:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 18:49:07.215111 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8d084-0f0a-450e-9012-1e5af64de515 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:07.323386 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8d084-0f0a-450e-9012-1e5af64de515 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:07.360613 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f313d-380b-4418-aab8-35868f17acb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:07.361466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f313d-380b-4418-aab8-35868f17acb0 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:07.361752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f313d-380b-4418-aab8-35868f17acb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:07.362071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f313d-380b-4418-aab8-35868f17acb0 None admin] PATH_INFO: `/v3/projects/1ae02f2c3b57454c82e72a20276d7342` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:07.363253 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f313d-380b-4418-aab8-35868f17acb0 None admin] RBAC: Authorizing `identity:get_project(project_id=1ae02f2c3b57454c82e72a20276d7342)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:07.364710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f313d-380b-4418-aab8-35868f17acb0 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:07.371563 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 538/1058] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:49:07 2022] GET /identity/v3/projects/1ae02f2c3b57454c82e72a20276d7342 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:07.372575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671af818-4d9c-4873-85c1-ec402f363236 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:07.383061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:07.477858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671af818-4d9c-4873-85c1-ec402f363236 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:07.513104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fb918-d70e-43ac-9b8f-10b441c20e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:07.513942 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fb918-d70e-43ac-9b8f-10b441c20e9e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:07.514424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fb918-d70e-43ac-9b8f-10b441c20e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:07.514910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fb918-d70e-43ac-9b8f-10b441c20e9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:07.515998 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fb918-d70e-43ac-9b8f-10b441c20e9e None admin] RBAC: Adding query filter params (role.id=8560bac1acf74dce81ea6a76f751b641, scope.project.id=1ae02f2c3b57454c82e72a20276d7342, user.id=27d4ba6d1fba4332b800364e4393e6b0) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:07.516317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fb918-d70e-43ac-9b8f-10b441c20e9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:07.517780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fb918-d70e-43ac-9b8f-10b441c20e9e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:07.527096 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 521/1059] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:49:07 2022] GET /identity/v3/role_assignments?user.id=27d4ba6d1fba4332b800364e4393e6b0&scope.project.id=1ae02f2c3b57454c82e72a20276d7342&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:49:07.583930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d112133-e12c-4689-8393-a5b9578fa90f None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:07.584504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d112133-e12c-4689-8393-a5b9578fa90f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:07.584504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d112133-e12c-4689-8393-a5b9578fa90f None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:07.585910 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 539/1060] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:07.592033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415fb67-4924-4f8d-9cfe-251e9113553e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:07.592581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415fb67-4924-4f8d-9cfe-251e9113553e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:07.592581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415fb67-4924-4f8d-9cfe-251e9113553e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:07.612364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-c415fb67-4924-4f8d-9cfe-251e9113553e None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:07.613591 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c415fb67-4924-4f8d-9cfe-251e9113553e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:07.693196 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 522/1061] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:07.716518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d112133-e12c-4689-8393-a5b9578fa90f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:07.764829 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:07.821829 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d112133-e12c-4689-8393-a5b9578fa90f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:07.858028 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa99145-1c29-4723-accb-cf1c05f69fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:07.858682 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa99145-1c29-4723-accb-cf1c05f69fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:07.858966 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa99145-1c29-4723-accb-cf1c05f69fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:07.859243 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa99145-1c29-4723-accb-cf1c05f69fb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:07.926592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa99145-1c29-4723-accb-cf1c05f69fb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:07.928063 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa99145-1c29-4723-accb-cf1c05f69fb6 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:07.974737 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:08.034111 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 540/1062] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:49:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 18:49:08.039798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415fb67-4924-4f8d-9cfe-251e9113553e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:08.042320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:08.150078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415fb67-4924-4f8d-9cfe-251e9113553e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:08.187831 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1205a0a-11ba-4d2e-9572-0a02b9f4ef9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:08.188552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1205a0a-11ba-4d2e-9572-0a02b9f4ef9f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:08.188832 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1205a0a-11ba-4d2e-9572-0a02b9f4ef9f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:08.189103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1205a0a-11ba-4d2e-9572-0a02b9f4ef9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:08.199814 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1205a0a-11ba-4d2e-9572-0a02b9f4ef9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:08.201271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1205a0a-11ba-4d2e-9572-0a02b9f4ef9f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:08.219303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-f1205a0a-11ba-4d2e-9572-0a02b9f4ef9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:49:08.219303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:08.219303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:08.219303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:08.219303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:08.219303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:08.219303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:08.219303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:08.219303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:08.219303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:08.219303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:08.219303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:08.219303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:49:08.219303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:49:08.219303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:49:08.220242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:49:08.220242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:08.220242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:08.220242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:08.220242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:08.220242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:08.220242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:08.220242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:08.220242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:08.220242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:08.220242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:08.220242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:08.220242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:08.220242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:08.220242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:08.220242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:08.220242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:08.221147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:49:08.221147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:49:08.221147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:49:08.221147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:08.221147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 523/1063] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:08.227768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa99145-1c29-4723-accb-cf1c05f69fb6 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:08.333490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa99145-1c29-4723-accb-cf1c05f69fb6 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:08.370871 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1551fa-79a6-4e81-bb61-c96c6b9830ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:08.371543 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1551fa-79a6-4e81-bb61-c96c6b9830ff None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:08.371824 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1551fa-79a6-4e81-bb61-c96c6b9830ff None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:08.372099 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1551fa-79a6-4e81-bb61-c96c6b9830ff None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:08.372818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1551fa-79a6-4e81-bb61-c96c6b9830ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:08.373124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1551fa-79a6-4e81-bb61-c96c6b9830ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:08.374541 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1551fa-79a6-4e81-bb61-c96c6b9830ff None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:08.393825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 541/1064] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:08.478139 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76d9e2-7cef-4c73-9238-5fe0a652371d None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:08.478335 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76d9e2-7cef-4c73-9238-5fe0a652371d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:08.478566 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76d9e2-7cef-4c73-9238-5fe0a652371d None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:08.480219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 524/1065] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:08.486035 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043eea58-e249-4a75-b73d-4550455cbf39 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:08.486390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043eea58-e249-4a75-b73d-4550455cbf39 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:08.486589 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043eea58-e249-4a75-b73d-4550455cbf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:08.492984 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:08.505211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-043eea58-e249-4a75-b73d-4550455cbf39 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:08.506469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-043eea58-e249-4a75-b73d-4550455cbf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:08.593724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 542/1066] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:08.616461 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76d9e2-7cef-4c73-9238-5fe0a652371d None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:08.688569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:08.739675 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76d9e2-7cef-4c73-9238-5fe0a652371d None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:08.774319 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccc11a-eaa4-440a-82dd-3eb9389d2d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:08.775139 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccc11a-eaa4-440a-82dd-3eb9389d2d3e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:08.775421 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccc11a-eaa4-440a-82dd-3eb9389d2d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:08.775791 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccc11a-eaa4-440a-82dd-3eb9389d2d3e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:08.786068 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ccc11a-eaa4-440a-82dd-3eb9389d2d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:49:08.794226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-e4ccc11a-eaa4-440a-82dd-3eb9389d2d3e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 18:49:08.794226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:08.794226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:08.794226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:08.794226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:08.794226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:08.794226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:08.794226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:08.794226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:08.794226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:08.794226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:08.794226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:08.794226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:49:08.794226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:49:08.794226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:49:08.794226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:49:08.795263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:49:08.795263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:49:08.795263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:49:08.795263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:49:08.795263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:08.795263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:08.795263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:08.795263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:08.795263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:08.795263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:08.795263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:08.795263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:08.795263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:08.795263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:08.795263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:08.795263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:08.796105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:08.796105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:08.796105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:08.796105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:08.796105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:49:08.796105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:49:08.796105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:49:08.796105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:49:08.796105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:49:08.796105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:49:08.796105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 18:49:08.796105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:08.796105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 525/1067] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Jun 2 18:49:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:08.801563 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043eea58-e249-4a75-b73d-4550455cbf39 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:08.902385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043eea58-e249-4a75-b73d-4550455cbf39 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:08.937196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc97ca-9286-4cfa-b2fd-09e6f3035a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:08.937896 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc97ca-9286-4cfa-b2fd-09e6f3035a40 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:08.938181 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc97ca-9286-4cfa-b2fd-09e6f3035a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:08.938458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc97ca-9286-4cfa-b2fd-09e6f3035a40 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:08.939204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc97ca-9286-4cfa-b2fd-09e6f3035a40 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:08.939515 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc97ca-9286-4cfa-b2fd-09e6f3035a40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:08.940898 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc97ca-9286-4cfa-b2fd-09e6f3035a40 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:08.942295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:08.950139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 543/1068] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jun 2 18:49:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:08.956111 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccc11a-eaa4-440a-82dd-3eb9389d2d3e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:09.059273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccc11a-eaa4-440a-82dd-3eb9389d2d3e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:09.073226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:09.095006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ca5d8-9820-4274-82e5-028b3baf7946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:09.095815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ca5d8-9820-4274-82e5-028b3baf7946 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:09.096095 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ca5d8-9820-4274-82e5-028b3baf7946 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:09.096365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ca5d8-9820-4274-82e5-028b3baf7946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:09.107002 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ca5d8-9820-4274-82e5-028b3baf7946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:09.108482 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ca5d8-9820-4274-82e5-028b3baf7946 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:09.125584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-d44ca5d8-9820-4274-82e5-028b3baf7946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:49:09.125584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:09.125584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:09.125584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:09.125584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:09.125584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:09.125584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:09.125584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:09.125584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:09.125584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:09.125584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:09.125584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:09.125584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:49:09.125584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:49:09.125584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:49:09.126593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:49:09.126593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:09.126593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:09.126593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:09.126593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:09.126593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:09.126593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:09.126593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:09.126593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:09.126593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:09.126593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:09.126593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:09.126593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:09.126593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:09.126593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:09.126593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:09.126593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:09.127508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:49:09.127508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:49:09.127508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:49:09.127508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:09.127508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 526/1069] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:09.132699 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc97ca-9286-4cfa-b2fd-09e6f3035a40 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:09.237037 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc97ca-9286-4cfa-b2fd-09e6f3035a40 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:09.271733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe0322-094a-416f-8f4a-d7eb37025816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:09.272396 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe0322-094a-416f-8f4a-d7eb37025816 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:09.272678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe0322-094a-416f-8f4a-d7eb37025816 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:09.272948 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe0322-094a-416f-8f4a-d7eb37025816 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:09.273659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe0322-094a-416f-8f4a-d7eb37025816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:09.273987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe0322-094a-416f-8f4a-d7eb37025816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:09.275356 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe0322-094a-416f-8f4a-d7eb37025816 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:09.287450 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 544/1070] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:09.293293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ca5d8-9820-4274-82e5-028b3baf7946 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:09.398072 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ca5d8-9820-4274-82e5-028b3baf7946 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:09.432814 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40580040-ed9b-4137-8309-baacb14f731e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:09.433617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40580040-ed9b-4137-8309-baacb14f731e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:09.433928 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40580040-ed9b-4137-8309-baacb14f731e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:09.434197 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40580040-ed9b-4137-8309-baacb14f731e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:09.442981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40580040-ed9b-4137-8309-baacb14f731e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:09.444433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40580040-ed9b-4137-8309-baacb14f731e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:09.459302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-40580040-ed9b-4137-8309-baacb14f731e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 18:49:09.459302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:09.459302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:09.459302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:09.459302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:09.459302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:09.459302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:09.459302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:09.459302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:09.459302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:09.459302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:09.459302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:09.459302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:49:09.459302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:49:09.459302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:49:09.459302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:49:09.460303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:09.460303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:09.460303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:49:09.460303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:49:09.460303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:49:09.460303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:49:09.460303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:09.460303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:09.460303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:09.460303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:09.460303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:09.460303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:09.460303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:09.460303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:09.460303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:09.460303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:09.460303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:09.460303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:09.461253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:09.461253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:09.461253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:49:09.461253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:49:09.461253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:49:09.461253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:49:09.461253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:49:09.461253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:49:09.461253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 18:49:09.461253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:09.461253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 527/1071] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jun 2 18:49:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:09.466939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe0322-094a-416f-8f4a-d7eb37025816 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:09.533315 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:09.579394 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe0322-094a-416f-8f4a-d7eb37025816 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:09.617076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330279a-1880-483f-9d1c-fc2101358e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:09.617739 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330279a-1880-483f-9d1c-fc2101358e6e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:09.618041 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330279a-1880-483f-9d1c-fc2101358e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:09.618314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330279a-1880-483f-9d1c-fc2101358e6e None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:09.619136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330279a-1880-483f-9d1c-fc2101358e6e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:09.619642 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330279a-1880-483f-9d1c-fc2101358e6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:09.621094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330279a-1880-483f-9d1c-fc2101358e6e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:09.638338 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 545/1072] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jun 2 18:49:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:09.644814 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40580040-ed9b-4137-8309-baacb14f731e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:09.675907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:09.752574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40580040-ed9b-4137-8309-baacb14f731e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:09.787075 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397c773-2d92-4c1a-8643-6ad41d42d0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:09.787875 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397c773-2d92-4c1a-8643-6ad41d42d0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:09.788150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397c773-2d92-4c1a-8643-6ad41d42d0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:09.788423 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397c773-2d92-4c1a-8643-6ad41d42d0d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:09.799165 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397c773-2d92-4c1a-8643-6ad41d42d0d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:09.800619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397c773-2d92-4c1a-8643-6ad41d42d0d2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:09.817666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-9397c773-2d92-4c1a-8643-6ad41d42d0d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:49:09.817666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:09.817666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:09.817666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:09.817666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:09.817666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:09.817666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:09.817666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:09.817666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:09.817666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:09.817666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:09.817666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:09.817666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:49:09.817666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:49:09.817666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:49:09.818665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:49:09.818665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:09.818665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:09.818665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:09.818665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:09.818665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:09.818665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:09.818665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:09.818665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:09.818665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:09.818665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:09.818665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:09.818665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:09.818665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:09.818665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:09.818665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:09.818665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:09.819639 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:49:09.819639 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:49:09.819639 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:49:09.819639 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:09.819639 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 528/1073] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:49:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:09.822367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074af423-d7dc-4ed6-b14b-6004cd7b729e None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:09.823257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074af423-d7dc-4ed6-b14b-6004cd7b729e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:09.823596 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074af423-d7dc-4ed6-b14b-6004cd7b729e None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:09.824813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397c773-2d92-4c1a-8643-6ad41d42d0d2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:09.825950 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 546/1074] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:09.829930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d938b3-8306-4b4b-990b-526e5212f96c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:09.830214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d938b3-8306-4b4b-990b-526e5212f96c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:09.830488 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d938b3-8306-4b4b-990b-526e5212f96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:09.851764 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-08d938b3-8306-4b4b-990b-526e5212f96c None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:09.853383 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-08d938b3-8306-4b4b-990b-526e5212f96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:09.911241 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:09.925575 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 547/1075] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:49:09.933165 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397c773-2d92-4c1a-8643-6ad41d42d0d2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:09.948190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d938b3-8306-4b4b-990b-526e5212f96c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:09.967135 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c83967-8fba-4521-8d0d-b600ef61bff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:09.967797 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83967-8fba-4521-8d0d-b600ef61bff3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:09.968074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83967-8fba-4521-8d0d-b600ef61bff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:09.968343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83967-8fba-4521-8d0d-b600ef61bff3 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:09.969054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c83967-8fba-4521-8d0d-b600ef61bff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:09.969676 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c83967-8fba-4521-8d0d-b600ef61bff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:09.970741 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c83967-8fba-4521-8d0d-b600ef61bff3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:09.982641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 529/1076] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:09.988165 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c83967-8fba-4521-8d0d-b600ef61bff3 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:09.994243 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:10.047655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d938b3-8306-4b4b-990b-526e5212f96c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:10.081835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c69b59-5e5e-4d57-873e-53ad3d5b22a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:10.082920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c69b59-5e5e-4d57-873e-53ad3d5b22a4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:10.083203 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c69b59-5e5e-4d57-873e-53ad3d5b22a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:10.083473 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c69b59-5e5e-4d57-873e-53ad3d5b22a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:10.085505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c83967-8fba-4521-8d0d-b600ef61bff3 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:10.095092 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c69b59-5e5e-4d57-873e-53ad3d5b22a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:49:10.102637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-56c69b59-5e5e-4d57-873e-53ad3d5b22a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:49:10.102637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:10.102637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:10.102637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:10.102637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:10.102637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:10.102637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:10.102637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:10.102637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:10.102637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:10.102637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:10.102637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:10.102637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:49:10.102637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:49:10.102637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:49:10.102637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:49:10.103544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:49:10.103544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:49:10.103544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:49:10.103544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:49:10.103544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:10.103544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:10.103544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:10.103544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:10.103544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:10.103544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:10.103544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:10.103544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:10.103544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:10.103544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:10.103544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:10.103544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:10.105113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:10.105113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:10.105113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:10.105113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:10.105113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:49:10.105113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:49:10.105113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:49:10.105113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:49:10.105113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:49:10.105113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:49:10.105113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:49:10.105113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:49:10.105113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 548/1077] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:49:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:49:10.110140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c69b59-5e5e-4d57-873e-53ad3d5b22a4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:10.120566 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058ddda-098d-444b-b919-a6edfbeb5cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:10.121379 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058ddda-098d-444b-b919-a6edfbeb5cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:10.121657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058ddda-098d-444b-b919-a6edfbeb5cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:10.121959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058ddda-098d-444b-b919-a6edfbeb5cc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:10.128619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058ddda-098d-444b-b919-a6edfbeb5cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:10.130138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058ddda-098d-444b-b919-a6edfbeb5cc0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:10.131876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:10.145064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-a058ddda-098d-444b-b919-a6edfbeb5cc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:49:10.145064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:10.145064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:10.145064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:10.145064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:10.145064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:10.145064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:10.145064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:10.145064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:10.145064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:10.145064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:10.145064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:10.145064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:49:10.145064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:49:10.145064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:49:10.146063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:49:10.146063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:10.146063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:10.146063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:10.146063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:10.146063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:10.146063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:10.146063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:10.146063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:10.146063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:10.146063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:10.146063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:10.146063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:10.146063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:10.146063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:10.146063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:10.146063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:10.146965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:49:10.146965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:49:10.146965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:49:10.146965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:49:10.146965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:49:10.146965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:49:10.146965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:49:10.146965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:10.146965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 530/1078] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:49:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:49:10.152219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058ddda-098d-444b-b919-a6edfbeb5cc0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:10.212191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c69b59-5e5e-4d57-873e-53ad3d5b22a4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:10.214861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:10.247104 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cc48a-8689-4179-ba28-5df2177d9f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:10.247778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cc48a-8689-4179-ba28-5df2177d9f6a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:10.248058 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cc48a-8689-4179-ba28-5df2177d9f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:10.248334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cc48a-8689-4179-ba28-5df2177d9f6a None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:10.249089 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680cc48a-8689-4179-ba28-5df2177d9f6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:10.249388 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680cc48a-8689-4179-ba28-5df2177d9f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:10.250817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680cc48a-8689-4179-ba28-5df2177d9f6a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:10.252558 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058ddda-098d-444b-b919-a6edfbeb5cc0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:10.258912 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 549/1079] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:49:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:49:10.265042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cc48a-8689-4179-ba28-5df2177d9f6a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:10.287487 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4770f1-6b20-4178-96b0-485515c6c9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:10.288427 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4770f1-6b20-4178-96b0-485515c6c9ba None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:10.288710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4770f1-6b20-4178-96b0-485515c6c9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:10.288985 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4770f1-6b20-4178-96b0-485515c6c9ba None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:10.289765 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4770f1-6b20-4178-96b0-485515c6c9ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:10.290114 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4770f1-6b20-4178-96b0-485515c6c9ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:10.291617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4770f1-6b20-4178-96b0-485515c6c9ba None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:10.303214 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 531/1080] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:49:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:49:10.309144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4770f1-6b20-4178-96b0-485515c6c9ba None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:10.363423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cc48a-8689-4179-ba28-5df2177d9f6a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:10.367217 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:10.396457 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b82682-160b-4170-aa04-a879af7a86ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:10.397333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b82682-160b-4170-aa04-a879af7a86ca None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:10.397610 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b82682-160b-4170-aa04-a879af7a86ca None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:10.397911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b82682-160b-4170-aa04-a879af7a86ca None admin] PATH_INFO: `/v3/users/27d4ba6d1fba4332b800364e4393e6b0` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:10.399110 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b82682-160b-4170-aa04-a879af7a86ca None admin] RBAC: Authorizing `identity:get_user(user_id=27d4ba6d1fba4332b800364e4393e6b0)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:10.400631 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b82682-160b-4170-aa04-a879af7a86ca None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:10.407020 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 550/1081] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:49:10 2022] GET /identity/v3/users/27d4ba6d1fba4332b800364e4393e6b0 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:49:10.407982 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b82682-160b-4170-aa04-a879af7a86ca None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:10.409325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4770f1-6b20-4178-96b0-485515c6c9ba None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:10.441446 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:10.442753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109771b-d7a3-475c-9306-24c23c65a133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:10.443736 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109771b-d7a3-475c-9306-24c23c65a133 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:10.444014 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109771b-d7a3-475c-9306-24c23c65a133 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:10.444354 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109771b-d7a3-475c-9306-24c23c65a133 None admin] PATH_INFO: `/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/6b8ff9f5032e498db3c70c79cc11989b/roles/a1ccf0afb5d6486cac2bf01dc16f56fa` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:10.446809 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109771b-d7a3-475c-9306-24c23c65a133 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a3d8f5b51ff4201b3968c9173ae06a7, user_id=6b8ff9f5032e498db3c70c79cc11989b, role_id=a1ccf0afb5d6486cac2bf01dc16f56fa)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:10.448370 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109771b-d7a3-475c-9306-24c23c65a133 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:10.462638 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 532/1082] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:49:10 2022] PUT /identity/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/6b8ff9f5032e498db3c70c79cc11989b/roles/a1ccf0afb5d6486cac2bf01dc16f56fa => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 18:49:10.517180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b82682-160b-4170-aa04-a879af7a86ca None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:10.558668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600167b2-1ec7-4139-82d1-69b1fedb22e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:10.559546 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600167b2-1ec7-4139-82d1-69b1fedb22e5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:10.559833 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600167b2-1ec7-4139-82d1-69b1fedb22e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:10.560111 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600167b2-1ec7-4139-82d1-69b1fedb22e5 None admin] PATH_INFO: `/v3/projects/1ae02f2c3b57454c82e72a20276d7342` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:10.561336 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600167b2-1ec7-4139-82d1-69b1fedb22e5 None admin] RBAC: Authorizing `identity:get_project(project_id=1ae02f2c3b57454c82e72a20276d7342)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:10.562846 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600167b2-1ec7-4139-82d1-69b1fedb22e5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:10.564630 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 551/1083] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:49:10 2022] GET /identity/v3/projects/1ae02f2c3b57454c82e72a20276d7342 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:49:10.571337 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109771b-d7a3-475c-9306-24c23c65a133 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:10.678083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109771b-d7a3-475c-9306-24c23c65a133 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:10.696321 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:10.715657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0037667-ca7c-4043-8f36-f12a09ce393a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:10.716487 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0037667-ca7c-4043-8f36-f12a09ce393a None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:10.716761 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0037667-ca7c-4043-8f36-f12a09ce393a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:10.717031 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0037667-ca7c-4043-8f36-f12a09ce393a None admin] PATH_INFO: `/v3/projects/1ae02f2c3b57454c82e72a20276d7342/users/27d4ba6d1fba4332b800364e4393e6b0/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:10.719030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0037667-ca7c-4043-8f36-f12a09ce393a None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae02f2c3b57454c82e72a20276d7342, user_id=27d4ba6d1fba4332b800364e4393e6b0, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:10.720487 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0037667-ca7c-4043-8f36-f12a09ce393a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:10.734327 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 533/1084] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:49:10 2022] PUT /identity/v3/projects/1ae02f2c3b57454c82e72a20276d7342/users/27d4ba6d1fba4332b800364e4393e6b0/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:49:12.686493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93194949-d1bb-4c85-bf6f-9492f6753f60 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:12.687060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93194949-d1bb-4c85-bf6f-9492f6753f60 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:12.687060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93194949-d1bb-4c85-bf6f-9492f6753f60 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:12.688657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 552/1085] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:12.694477 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63f420-0e8a-4c7e-91e1-a98afd94bbc0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:12.695028 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63f420-0e8a-4c7e-91e1-a98afd94bbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:12.695028 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63f420-0e8a-4c7e-91e1-a98afd94bbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:12.724765 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8d63f420-0e8a-4c7e-91e1-a98afd94bbc0 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:12.725982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8d63f420-0e8a-4c7e-91e1-a98afd94bbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:12.808363 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 534/1086] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:12.832718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93194949-d1bb-4c85-bf6f-9492f6753f60 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:12.937837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93194949-d1bb-4c85-bf6f-9492f6753f60 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:12.939391 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:12.973342 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591de7c-1d69-4ecb-9f6a-85792177a7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:12.974196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591de7c-1d69-4ecb-9f6a-85792177a7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:12.974474 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591de7c-1d69-4ecb-9f6a-85792177a7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:12.974742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591de7c-1d69-4ecb-9f6a-85792177a7c4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:12.985610 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591de7c-1d69-4ecb-9f6a-85792177a7c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:49:12.993728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-0591de7c-1d69-4ecb-9f6a-85792177a7c4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 18:49:12.993728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:12.993728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:12.993728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:12.993728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:12.993728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:12.993728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:12.993728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:12.993728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:12.993728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:12.993728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:12.993728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:12.993728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:49:12.993728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:49:12.993728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:49:12.993728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:49:12.994801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:49:12.994801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:49:12.994801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:49:12.994801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:49:12.994801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:12.994801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:12.994801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:12.994801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:12.994801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:12.994801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:12.994801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:12.994801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:12.994801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:12.994801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:12.994801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:12.994801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:12.995889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:12.995889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:12.995889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:12.995889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:12.995889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:49:12.995889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:49:12.995889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:49:12.995889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:49:12.995889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:49:12.995889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:49:12.995889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 18:49:12.995889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:49:12.995889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 553/1087] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Jun 2 18:49:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:13.001221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63f420-0e8a-4c7e-91e1-a98afd94bbc0 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:13.010780 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46e65d-1569-4914-8d24-88e741a4f5a6 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:13.011066 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46e65d-1569-4914-8d24-88e741a4f5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:13.011334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46e65d-1569-4914-8d24-88e741a4f5a6 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:13.012680 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 554/1088] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:13.017906 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03d64d-4f47-406b-a99e-d9274b5d27fe None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:13.018229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03d64d-4f47-406b-a99e-d9274b5d27fe None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:13.018503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03d64d-4f47-406b-a99e-d9274b5d27fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:13.036315 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5c03d64d-4f47-406b-a99e-d9274b5d27fe None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:13.037514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5c03d64d-4f47-406b-a99e-d9274b5d27fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:13.104912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63f420-0e8a-4c7e-91e1-a98afd94bbc0 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:13.112521 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 555/1089] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:13.113932 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:13.137646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03d64d-4f47-406b-a99e-d9274b5d27fe None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:13.139320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a072e4a-af2a-414a-9289-beab1ca0ce30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:13.139992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a072e4a-af2a-414a-9289-beab1ca0ce30 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:13.140267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a072e4a-af2a-414a-9289-beab1ca0ce30 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:13.140541 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a072e4a-af2a-414a-9289-beab1ca0ce30 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:13.141281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a072e4a-af2a-414a-9289-beab1ca0ce30 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:13.141581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a072e4a-af2a-414a-9289-beab1ca0ce30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:13.142979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a072e4a-af2a-414a-9289-beab1ca0ce30 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:13.151121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 535/1090] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jun 2 18:49:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:13.158246 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a072e4a-af2a-414a-9289-beab1ca0ce30 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:13.234550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:13.244600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03d64d-4f47-406b-a99e-d9274b5d27fe None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:13.259547 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a072e4a-af2a-414a-9289-beab1ca0ce30 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:13.277959 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2cb40-9f83-4fc6-818b-0b099a61b5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:13.278778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2cb40-9f83-4fc6-818b-0b099a61b5bc None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:13.279058 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2cb40-9f83-4fc6-818b-0b099a61b5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:13.279331 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2cb40-9f83-4fc6-818b-0b099a61b5bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:13.289912 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2cb40-9f83-4fc6-818b-0b099a61b5bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:49:13.291978 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be518e9-1a6c-4ec8-8a3e-cd7fb942f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:13.292762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be518e9-1a6c-4ec8-8a3e-cd7fb942f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:13.293034 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be518e9-1a6c-4ec8-8a3e-cd7fb942f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:13.293297 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be518e9-1a6c-4ec8-8a3e-cd7fb942f6f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:13.297553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-2ec2cb40-9f83-4fc6-818b-0b099a61b5bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:49:13.297553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:13.297553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:13.297553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:13.297553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:13.297553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:13.297553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:13.297553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:13.297553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:13.297553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:13.297553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:13.297553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:13.297553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:49:13.297553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:49:13.297553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:49:13.297553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:49:13.298523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:49:13.298523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:49:13.298523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:49:13.298523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:49:13.298523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:13.298523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:13.298523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:13.298523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:13.298523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:13.298523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:13.298523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:13.298523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:13.298523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:13.298523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:13.298523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:13.298523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:13.299583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:13.299583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:13.299583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:13.299583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:13.299583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:49:13.299583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:49:13.299583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:49:13.299583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:49:13.299583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:49:13.299583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:49:13.299583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:49:13.299583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:49:13.299583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 556/1091] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:49:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:49:13.303747 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be518e9-1a6c-4ec8-8a3e-cd7fb942f6f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:13.304808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2cb40-9f83-4fc6-818b-0b099a61b5bc None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:13.305205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be518e9-1a6c-4ec8-8a3e-cd7fb942f6f0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:13.322540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-4be518e9-1a6c-4ec8-8a3e-cd7fb942f6f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:49:13.322540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:13.322540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:13.322540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:13.322540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:13.322540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:13.322540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:13.322540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:13.322540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:13.322540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:13.322540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:13.322540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:13.322540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:49:13.322540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:49:13.322540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:49:13.323927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:49:13.323927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:13.323927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:13.323927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:13.323927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:13.323927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:13.323927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:13.323927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:13.323927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:13.323927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:13.323927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:13.323927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:13.323927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:13.323927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:13.323927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:13.323927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:13.323927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:13.325026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:49:13.325026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:49:13.325026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:49:13.325026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:13.325026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 536/1092] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:49:13.329429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be518e9-1a6c-4ec8-8a3e-cd7fb942f6f0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:13.355901 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:13.407221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2cb40-9f83-4fc6-818b-0b099a61b5bc None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:13.432693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be518e9-1a6c-4ec8-8a3e-cd7fb942f6f0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:13.440030 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6c846-e6a0-4b55-8f2d-b6ff49713731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:13.440695 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6c846-e6a0-4b55-8f2d-b6ff49713731 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:13.440971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6c846-e6a0-4b55-8f2d-b6ff49713731 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:13.441239 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6c846-e6a0-4b55-8f2d-b6ff49713731 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:13.441999 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6c846-e6a0-4b55-8f2d-b6ff49713731 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:13.442301 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6c846-e6a0-4b55-8f2d-b6ff49713731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:13.443662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6c846-e6a0-4b55-8f2d-b6ff49713731 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:13.452527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 557/1093] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:49:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:49:13.458680 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6c846-e6a0-4b55-8f2d-b6ff49713731 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:13.466296 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd0071-e8cc-4711-b8ae-e24200ac1180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:13.467085 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd0071-e8cc-4711-b8ae-e24200ac1180 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:13.467434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd0071-e8cc-4711-b8ae-e24200ac1180 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:13.467741 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd0071-e8cc-4711-b8ae-e24200ac1180 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:13.468468 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd0071-e8cc-4711-b8ae-e24200ac1180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:13.468772 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd0071-e8cc-4711-b8ae-e24200ac1180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:13.470189 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd0071-e8cc-4711-b8ae-e24200ac1180 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:13.474757 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:13.483074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 537/1094] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:49:13.488906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd0071-e8cc-4711-b8ae-e24200ac1180 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:13.560124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6c846-e6a0-4b55-8f2d-b6ff49713731 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:13.574518 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:13.592947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd0071-e8cc-4711-b8ae-e24200ac1180 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:13.593820 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad544f-13c2-4182-8d39-5c5dc578b53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:13.594715 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad544f-13c2-4182-8d39-5c5dc578b53d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:13.594997 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad544f-13c2-4182-8d39-5c5dc578b53d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:13.595277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad544f-13c2-4182-8d39-5c5dc578b53d None admin] PATH_INFO: `/v3/users/27d4ba6d1fba4332b800364e4393e6b0` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:13.596496 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad544f-13c2-4182-8d39-5c5dc578b53d None admin] RBAC: Authorizing `identity:get_user(user_id=27d4ba6d1fba4332b800364e4393e6b0)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:13.597977 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad544f-13c2-4182-8d39-5c5dc578b53d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:13.599632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 558/1095] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:49:13 2022] GET /identity/v3/users/27d4ba6d1fba4332b800364e4393e6b0 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:13.605670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad544f-13c2-4182-8d39-5c5dc578b53d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:13.629408 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4052fe-bf60-486a-8a9a-d27db29559da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:13.630236 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4052fe-bf60-486a-8a9a-d27db29559da None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:13.630528 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4052fe-bf60-486a-8a9a-d27db29559da None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:13.630796 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4052fe-bf60-486a-8a9a-d27db29559da None admin] PATH_INFO: `/v3/users/nova` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:13.638044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4052fe-bf60-486a-8a9a-d27db29559da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:13.639480 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4052fe-bf60-486a-8a9a-d27db29559da None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:13.653598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-dc4052fe-bf60-486a-8a9a-d27db29559da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 18:49:13.653598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:13.653598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:13.653598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:13.653598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:13.653598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:13.653598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:13.653598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:13.653598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:13.653598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:13.653598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:13.653598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:13.653598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:49:13.653598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:49:13.653598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:49:13.653598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:49:13.654721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:13.654721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:13.654721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:49:13.654721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:49:13.654721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:49:13.654721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:49:13.654721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:13.654721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:13.654721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:13.654721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:13.654721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:13.654721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:13.654721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:13.654721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:13.654721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:13.654721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:13.654721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:13.654721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:13.655755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:13.655755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:13.655755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:49:13.655755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:49:13.655755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:49:13.655755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:49:13.655755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:49:13.655755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:49:13.655755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 18:49:13.655755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:13.655755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 538/1096] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jun 2 18:49:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:13.660474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4052fe-bf60-486a-8a9a-d27db29559da None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:13.688215 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:13.712042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad544f-13c2-4182-8d39-5c5dc578b53d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:13.748452 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7a7cb-2237-4101-bd7d-d6fbfdf8f758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:13.749110 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7a7cb-2237-4101-bd7d-d6fbfdf8f758 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:13.749390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7a7cb-2237-4101-bd7d-d6fbfdf8f758 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:13.749669 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7a7cb-2237-4101-bd7d-d6fbfdf8f758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:13.762283 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4052fe-bf60-486a-8a9a-d27db29559da None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:13.795780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1e5f3-ac26-4896-8d47-8053b248d70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:13.796442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1e5f3-ac26-4896-8d47-8053b248d70a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:13.796715 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1e5f3-ac26-4896-8d47-8053b248d70a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:13.796984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1e5f3-ac26-4896-8d47-8053b248d70a None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:13.797820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1e5f3-ac26-4896-8d47-8053b248d70a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:13.798138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1e5f3-ac26-4896-8d47-8053b248d70a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:13.799567 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1e5f3-ac26-4896-8d47-8053b248d70a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:13.813069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:13.816987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 539/1097] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jun 2 18:49:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:49:13.817597 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7a7cb-2237-4101-bd7d-d6fbfdf8f758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:13.819112 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7a7cb-2237-4101-bd7d-d6fbfdf8f758 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:13.822638 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1e5f3-ac26-4896-8d47-8053b248d70a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:13.899826 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:13.919291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 559/1098] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:49:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 18:49:13.920637 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1e5f3-ac26-4896-8d47-8053b248d70a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:13.925118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7a7cb-2237-4101-bd7d-d6fbfdf8f758 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:13.957945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19202c27-17fd-40b7-b355-f32c46c5f4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:13.958610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19202c27-17fd-40b7-b355-f32c46c5f4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:13.958913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19202c27-17fd-40b7-b355-f32c46c5f4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:13.959180 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19202c27-17fd-40b7-b355-f32c46c5f4b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:14.020408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7a7cb-2237-4101-bd7d-d6fbfdf8f758 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:14.023510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:14.026362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19202c27-17fd-40b7-b355-f32c46c5f4b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:14.027987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19202c27-17fd-40b7-b355-f32c46c5f4b5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:14.055930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819942d-8504-46cc-ac32-db42018fdfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:14.056893 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819942d-8504-46cc-ac32-db42018fdfaa None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:14.057143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819942d-8504-46cc-ac32-db42018fdfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:14.057443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819942d-8504-46cc-ac32-db42018fdfaa None admin] PATH_INFO: `/v3/projects/1ae02f2c3b57454c82e72a20276d7342` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:14.058657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819942d-8504-46cc-ac32-db42018fdfaa None admin] RBAC: Authorizing `identity:get_project(project_id=1ae02f2c3b57454c82e72a20276d7342)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:14.060080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819942d-8504-46cc-ac32-db42018fdfaa None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:14.061777 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 560/1099] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:49:13 2022] GET /identity/v3/projects/1ae02f2c3b57454c82e72a20276d7342 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:14.067927 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819942d-8504-46cc-ac32-db42018fdfaa None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:14.117336 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:14.127607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 540/1100] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:49:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 18:49:14.133368 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19202c27-17fd-40b7-b355-f32c46c5f4b5 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:14.167584 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819942d-8504-46cc-ac32-db42018fdfaa None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:14.200792 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092b294-10d6-4b7b-93fe-66f874e129b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:14.201445 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092b294-10d6-4b7b-93fe-66f874e129b7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:14.201724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092b294-10d6-4b7b-93fe-66f874e129b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:14.202023 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092b294-10d6-4b7b-93fe-66f874e129b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:14.202847 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092b294-10d6-4b7b-93fe-66f874e129b7 None admin] RBAC: Adding query filter params (role.id=8560bac1acf74dce81ea6a76f751b641, scope.project.id=1ae02f2c3b57454c82e72a20276d7342, user.id=27d4ba6d1fba4332b800364e4393e6b0) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:14.203156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092b294-10d6-4b7b-93fe-66f874e129b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:14.204586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092b294-10d6-4b7b-93fe-66f874e129b7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:14.210778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 561/1101] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:49:14 2022] GET /identity/v3/role_assignments?user.id=27d4ba6d1fba4332b800364e4393e6b0&scope.project.id=1ae02f2c3b57454c82e72a20276d7342&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:49:14.230420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:14.234029 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19202c27-17fd-40b7-b355-f32c46c5f4b5 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:14.272728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003f69b-3c68-44bb-bb5e-d3bbea9c10b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:14.273549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003f69b-3c68-44bb-bb5e-d3bbea9c10b6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:14.273820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003f69b-3c68-44bb-bb5e-d3bbea9c10b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:14.274118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003f69b-3c68-44bb-bb5e-d3bbea9c10b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:14.286112 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003f69b-3c68-44bb-bb5e-d3bbea9c10b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:14.287584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003f69b-3c68-44bb-bb5e-d3bbea9c10b6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:14.307145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-d003f69b-3c68-44bb-bb5e-d3bbea9c10b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:49:14.307145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:14.307145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:14.307145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:14.307145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:14.307145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:14.307145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:14.307145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:14.307145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:14.307145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:14.307145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:14.307145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:14.307145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:49:14.307145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:49:14.307145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:49:14.308150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:49:14.308150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:14.308150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:14.308150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:14.308150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:14.308150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:14.308150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:14.308150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:14.308150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:14.308150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:14.308150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:14.308150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:14.308150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:14.308150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:14.308150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:14.308150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:14.308150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:14.309029 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:49:14.309029 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:49:14.309029 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:49:14.309029 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:14.309029 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 541/1102] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:49:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:49:14.314624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092b294-10d6-4b7b-93fe-66f874e129b7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:14.426613 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092b294-10d6-4b7b-93fe-66f874e129b7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:14.441421 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:14.462994 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa94470-dd49-49b1-8a0e-aad9ed6de7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:14.464204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa94470-dd49-49b1-8a0e-aad9ed6de7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:14.464482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa94470-dd49-49b1-8a0e-aad9ed6de7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:14.464754 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa94470-dd49-49b1-8a0e-aad9ed6de7c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:14.465477 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa94470-dd49-49b1-8a0e-aad9ed6de7c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:14.465789 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa94470-dd49-49b1-8a0e-aad9ed6de7c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:14.467195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa94470-dd49-49b1-8a0e-aad9ed6de7c3 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:14.478967 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 562/1103] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:14.484668 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003f69b-3c68-44bb-bb5e-d3bbea9c10b6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:14.588396 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003f69b-3c68-44bb-bb5e-d3bbea9c10b6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:14.624250 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a04c5-bf33-44b6-87b1-797ce3a34b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:14.625076 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a04c5-bf33-44b6-87b1-797ce3a34b4d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:14.625353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a04c5-bf33-44b6-87b1-797ce3a34b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:14.625623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a04c5-bf33-44b6-87b1-797ce3a34b4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:14.632554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a04c5-bf33-44b6-87b1-797ce3a34b4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:14.634035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a04c5-bf33-44b6-87b1-797ce3a34b4d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:14.647907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-a18a04c5-bf33-44b6-87b1-797ce3a34b4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:49:14.647907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:14.647907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:14.647907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:14.647907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:14.647907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:14.647907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:14.647907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:14.647907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:14.647907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:14.647907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:14.647907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:14.647907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:49:14.647907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:49:14.647907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:49:14.648808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:49:14.648808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:14.648808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:14.648808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:14.648808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:14.648808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:14.648808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:14.648808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:14.648808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:14.648808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:14.648808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:14.648808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:14.648808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:14.648808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:14.648808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:14.648808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:14.648808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:14.649915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:49:14.649915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:49:14.649915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:49:14.649915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:49:14.649915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:49:14.649915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:49:14.649915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:49:14.649915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:14.649915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 542/1104] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:49:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:14.655323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa94470-dd49-49b1-8a0e-aad9ed6de7c3 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:14.763443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa94470-dd49-49b1-8a0e-aad9ed6de7c3 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:14.799018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08201ad4-8c17-4684-8741-92dd5eba2d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:14.799681 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08201ad4-8c17-4684-8741-92dd5eba2d16 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:14.799959 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08201ad4-8c17-4684-8741-92dd5eba2d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:14.800228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08201ad4-8c17-4684-8741-92dd5eba2d16 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:14.801006 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08201ad4-8c17-4684-8741-92dd5eba2d16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:14.801308 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08201ad4-8c17-4684-8741-92dd5eba2d16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:14.802779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08201ad4-8c17-4684-8741-92dd5eba2d16 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:14.815751 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 563/1105] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:49:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:49:14.821935 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a04c5-bf33-44b6-87b1-797ce3a34b4d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:14.838864 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:14.926600 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a04c5-bf33-44b6-87b1-797ce3a34b4d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:14.961820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dd7a3-4e28-4a80-8974-dc02efdf77ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:14.962485 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dd7a3-4e28-4a80-8974-dc02efdf77ed None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:14.962739 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dd7a3-4e28-4a80-8974-dc02efdf77ed None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:14.963082 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dd7a3-4e28-4a80-8974-dc02efdf77ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:14.963917 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dd7a3-4e28-4a80-8974-dc02efdf77ed None admin] RBAC: Adding query filter params (role.id=a1ccf0afb5d6486cac2bf01dc16f56fa, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=6b8ff9f5032e498db3c70c79cc11989b) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:14.964225 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dd7a3-4e28-4a80-8974-dc02efdf77ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:14.965673 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dd7a3-4e28-4a80-8974-dc02efdf77ed None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:14.971990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 543/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:49:14 2022] GET /identity/v3/role_assignments?user.id=6b8ff9f5032e498db3c70c79cc11989b&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=a1ccf0afb5d6486cac2bf01dc16f56fa => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:16.478575 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb246b3-7d36-49e0-8360-2091f0a30c5c None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:16.479429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb246b3-7d36-49e0-8360-2091f0a30c5c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:16.479429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb246b3-7d36-49e0-8360-2091f0a30c5c None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:16.481664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 564/1107] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:16.490535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45647e-a94b-4635-9d8f-f4c99f9cbc48 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:16.491228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45647e-a94b-4635-9d8f-f4c99f9cbc48 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:16.491369 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45647e-a94b-4635-9d8f-f4c99f9cbc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:16.516255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ff45647e-a94b-4635-9d8f-f4c99f9cbc48 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:16.517479 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ff45647e-a94b-4635-9d8f-f4c99f9cbc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:16.586862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 544/1108] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:16.612444 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb246b3-7d36-49e0-8360-2091f0a30c5c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:16.660740 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:16.734501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb246b3-7d36-49e0-8360-2091f0a30c5c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:16.769752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececdf69-9fdc-4e8d-bcbf-fb9be48a4e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:16.770564 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececdf69-9fdc-4e8d-bcbf-fb9be48a4e30 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:16.770836 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececdf69-9fdc-4e8d-bcbf-fb9be48a4e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:16.771103 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececdf69-9fdc-4e8d-bcbf-fb9be48a4e30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:16.772378 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececdf69-9fdc-4e8d-bcbf-fb9be48a4e30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:16.773831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececdf69-9fdc-4e8d-bcbf-fb9be48a4e30 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:16.775483 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 565/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:49:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:16.781451 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45647e-a94b-4635-9d8f-f4c99f9cbc48 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:16.790137 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:16.890883 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45647e-a94b-4635-9d8f-f4c99f9cbc48 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:16.927372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477113f-b50b-4acc-999c-192df07f4095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:16.928041 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477113f-b50b-4acc-999c-192df07f4095 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:16.928320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477113f-b50b-4acc-999c-192df07f4095 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:16.928592 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477113f-b50b-4acc-999c-192df07f4095 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:16.929316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477113f-b50b-4acc-999c-192df07f4095 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:16.930785 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477113f-b50b-4acc-999c-192df07f4095 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:16.953156 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 545/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 2 18:49:16 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:49:19.283573 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8084f4-90b5-42a0-9ab1-2ddec4e23698 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:19.284497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8084f4-90b5-42a0-9ab1-2ddec4e23698 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:19.284497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8084f4-90b5-42a0-9ab1-2ddec4e23698 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:19.286852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 566/1111] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:19.293158 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942761b-68fd-4815-a838-d746f3fa7000 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:19.293891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942761b-68fd-4815-a838-d746f3fa7000 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:19.293984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942761b-68fd-4815-a838-d746f3fa7000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:19.323186 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-1942761b-68fd-4815-a838-d746f3fa7000 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:19.324397 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1942761b-68fd-4815-a838-d746f3fa7000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:19.386876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:19.407603 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 546/1112] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:19.435172 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8084f4-90b5-42a0-9ab1-2ddec4e23698 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:19.548083 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8084f4-90b5-42a0-9ab1-2ddec4e23698 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:19.549560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:19.585285 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf359331-2c36-48d4-bc25-0566be5dae8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:19.586169 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf359331-2c36-48d4-bc25-0566be5dae8f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:19.586445 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf359331-2c36-48d4-bc25-0566be5dae8f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:19.586710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf359331-2c36-48d4-bc25-0566be5dae8f None admin] PATH_INFO: `/v3/roles/1ecbde8dcaa44047899f618334033d43` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:19.588375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf359331-2c36-48d4-bc25-0566be5dae8f None admin] RBAC: Authorizing `identity:get_role(role_id=1ecbde8dcaa44047899f618334033d43)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:19.589737 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf359331-2c36-48d4-bc25-0566be5dae8f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:19.591159 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 567/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:49:19 2022] GET /identity/v3/roles/1ecbde8dcaa44047899f618334033d43 => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:19.600581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942761b-68fd-4815-a838-d746f3fa7000 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:19.711125 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942761b-68fd-4815-a838-d746f3fa7000 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:19.749103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54aa34-fd9c-4184-9ba6-72cd326062fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:19.750006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54aa34-fd9c-4184-9ba6-72cd326062fa None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:19.750285 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54aa34-fd9c-4184-9ba6-72cd326062fa None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:19.750554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54aa34-fd9c-4184-9ba6-72cd326062fa None admin] PATH_INFO: `/v3/users/c03854c7947f448db3bfbab3e51d790c` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:19.764472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54aa34-fd9c-4184-9ba6-72cd326062fa None admin] RBAC: Authorizing `identity:get_user(user_id=c03854c7947f448db3bfbab3e51d790c)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:19.765948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54aa34-fd9c-4184-9ba6-72cd326062fa None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:19.767595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 547/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:49:19 2022] GET /identity/v3/users/c03854c7947f448db3bfbab3e51d790c => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:19.773669 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf359331-2c36-48d4-bc25-0566be5dae8f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:19.874777 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf359331-2c36-48d4-bc25-0566be5dae8f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:19.911916 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcf20e-d5c3-42d4-aef3-05e925ae7bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:19.912560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcf20e-d5c3-42d4-aef3-05e925ae7bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:19.912829 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcf20e-d5c3-42d4-aef3-05e925ae7bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:19.913086 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcf20e-d5c3-42d4-aef3-05e925ae7bb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:19.954028 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:19.986438 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcf20e-d5c3-42d4-aef3-05e925ae7bb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:19.987888 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcf20e-d5c3-42d4-aef3-05e925ae7bb9 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:20.091113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 568/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:49:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 18:49:20.097275 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54aa34-fd9c-4184-9ba6-72cd326062fa None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:20.147556 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:20.202795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54aa34-fd9c-4184-9ba6-72cd326062fa None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:20.238025 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae14a1-fcf3-4d58-93f6-4017af585f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:20.238884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae14a1-fcf3-4d58-93f6-4017af585f7b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:20.239162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae14a1-fcf3-4d58-93f6-4017af585f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:20.239435 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae14a1-fcf3-4d58-93f6-4017af585f7b None admin] PATH_INFO: `/v3/projects/1ae02f2c3b57454c82e72a20276d7342` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:20.240652 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae14a1-fcf3-4d58-93f6-4017af585f7b None admin] RBAC: Authorizing `identity:get_project(project_id=1ae02f2c3b57454c82e72a20276d7342)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:20.242122 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae14a1-fcf3-4d58-93f6-4017af585f7b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:20.243849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 548/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:49:20 2022] GET /identity/v3/projects/1ae02f2c3b57454c82e72a20276d7342 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:20.250639 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcf20e-d5c3-42d4-aef3-05e925ae7bb9 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:20.339086 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:20.370942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcf20e-d5c3-42d4-aef3-05e925ae7bb9 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:20.406360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93edbb-cdd9-437b-a65e-a1d13ccd622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:20.406946 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93edbb-cdd9-437b-a65e-a1d13ccd622d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:20.407231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93edbb-cdd9-437b-a65e-a1d13ccd622d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:20.407504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93edbb-cdd9-437b-a65e-a1d13ccd622d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:20.408335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93edbb-cdd9-437b-a65e-a1d13ccd622d None admin] RBAC: Adding query filter params (role.id=1ecbde8dcaa44047899f618334033d43, scope.project.id=1ae02f2c3b57454c82e72a20276d7342, user.id=c03854c7947f448db3bfbab3e51d790c) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:20.408647 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93edbb-cdd9-437b-a65e-a1d13ccd622d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:20.410132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93edbb-cdd9-437b-a65e-a1d13ccd622d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:20.415708 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 569/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:49:20 2022] GET /identity/v3/role_assignments?user.id=c03854c7947f448db3bfbab3e51d790c&scope.project.id=1ae02f2c3b57454c82e72a20276d7342&role.id=1ecbde8dcaa44047899f618334033d43 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:22.653747 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243415e-6ecd-4a38-97b3-5428c266aaa1 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:22.654648 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243415e-6ecd-4a38-97b3-5428c266aaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:22.654648 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243415e-6ecd-4a38-97b3-5428c266aaa1 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:22.656808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 549/1118] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:22.663249 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f562caa-bad9-4e1b-a172-241a120d2815 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:22.663687 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f562caa-bad9-4e1b-a172-241a120d2815 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:22.663827 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f562caa-bad9-4e1b-a172-241a120d2815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:22.688779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-7f562caa-bad9-4e1b-a172-241a120d2815 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:22.690013 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7f562caa-bad9-4e1b-a172-241a120d2815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:22.768037 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 570/1119] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:22.791510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243415e-6ecd-4a38-97b3-5428c266aaa1 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:22.907181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243415e-6ecd-4a38-97b3-5428c266aaa1 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:22.924289 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:22.942867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023d998-d535-44e7-8616-853b0ed61177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:22.943717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023d998-d535-44e7-8616-853b0ed61177 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:22.943993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023d998-d535-44e7-8616-853b0ed61177 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:22.944260 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023d998-d535-44e7-8616-853b0ed61177 None admin] PATH_INFO: `/v3/roles/1ecbde8dcaa44047899f618334033d43` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:22.945740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023d998-d535-44e7-8616-853b0ed61177 None admin] RBAC: Authorizing `identity:get_role(role_id=1ecbde8dcaa44047899f618334033d43)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:22.947190 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023d998-d535-44e7-8616-853b0ed61177 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:22.948651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 550/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:49:22 2022] GET /identity/v3/roles/1ecbde8dcaa44047899f618334033d43 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:22.957733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f562caa-bad9-4e1b-a172-241a120d2815 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:23.020582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:23.057849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f562caa-bad9-4e1b-a172-241a120d2815 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:23.093849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ea22e-a689-4006-b5aa-3ab2648dea50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:23.094739 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ea22e-a689-4006-b5aa-3ab2648dea50 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:23.095018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ea22e-a689-4006-b5aa-3ab2648dea50 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:23.095292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ea22e-a689-4006-b5aa-3ab2648dea50 None admin] PATH_INFO: `/v3/users/c03854c7947f448db3bfbab3e51d790c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:23.096604 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ea22e-a689-4006-b5aa-3ab2648dea50 None admin] RBAC: Authorizing `identity:get_user(user_id=c03854c7947f448db3bfbab3e51d790c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:23.098087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ea22e-a689-4006-b5aa-3ab2648dea50 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:23.099712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 571/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:49:22 2022] GET /identity/v3/users/c03854c7947f448db3bfbab3e51d790c => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:49:23.106979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023d998-d535-44e7-8616-853b0ed61177 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:23.214860 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023d998-d535-44e7-8616-853b0ed61177 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:23.253157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c6c3a-5216-4f0a-bd7b-1844c046e42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:23.254063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c6c3a-5216-4f0a-bd7b-1844c046e42c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:23.254345 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c6c3a-5216-4f0a-bd7b-1844c046e42c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:23.254616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c6c3a-5216-4f0a-bd7b-1844c046e42c None admin] PATH_INFO: `/v3/projects/1ae02f2c3b57454c82e72a20276d7342` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:23.255843 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c6c3a-5216-4f0a-bd7b-1844c046e42c None admin] RBAC: Authorizing `identity:get_project(project_id=1ae02f2c3b57454c82e72a20276d7342)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:23.257288 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c6c3a-5216-4f0a-bd7b-1844c046e42c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:23.259026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 551/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:49:23 2022] GET /identity/v3/projects/1ae02f2c3b57454c82e72a20276d7342 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:23.268498 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ea22e-a689-4006-b5aa-3ab2648dea50 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:23.379852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ea22e-a689-4006-b5aa-3ab2648dea50 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:23.410227 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:23.416729 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7762d34-f48a-4702-a3e5-196e6592bb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:23.417636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7762d34-f48a-4702-a3e5-196e6592bb28 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:23.417960 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7762d34-f48a-4702-a3e5-196e6592bb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:23.418230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7762d34-f48a-4702-a3e5-196e6592bb28 None admin] PATH_INFO: `/v3/projects/1ae02f2c3b57454c82e72a20276d7342/users/c03854c7947f448db3bfbab3e51d790c/roles/1ecbde8dcaa44047899f618334033d43` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:23.420865 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7762d34-f48a-4702-a3e5-196e6592bb28 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae02f2c3b57454c82e72a20276d7342, user_id=c03854c7947f448db3bfbab3e51d790c, role_id=1ecbde8dcaa44047899f618334033d43)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:23.422351 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7762d34-f48a-4702-a3e5-196e6592bb28 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:23.437656 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 572/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:49:23 2022] PUT /identity/v3/projects/1ae02f2c3b57454c82e72a20276d7342/users/c03854c7947f448db3bfbab3e51d790c/roles/1ecbde8dcaa44047899f618334033d43 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:49:25.653947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22de544-560f-49f5-9b12-81ebecd782ef None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:25.654493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22de544-560f-49f5-9b12-81ebecd782ef None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:25.654493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22de544-560f-49f5-9b12-81ebecd782ef None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:25.656623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 552/1124] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:25.665503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f49b1-7437-452a-869c-3d1aa3bd8702 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:25.665948 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f49b1-7437-452a-869c-3d1aa3bd8702 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:25.666245 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f49b1-7437-452a-869c-3d1aa3bd8702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:25.689743 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-2d7f49b1-7437-452a-869c-3d1aa3bd8702 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:25.690959 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2d7f49b1-7437-452a-869c-3d1aa3bd8702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:25.760655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 573/1125] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:25.784783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22de544-560f-49f5-9b12-81ebecd782ef None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:25.845672 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:25.893531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22de544-560f-49f5-9b12-81ebecd782ef None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:25.930016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1bc8f-059f-441f-a6e0-673519ce7a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:25.930864 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1bc8f-059f-441f-a6e0-673519ce7a78 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:25.931140 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1bc8f-059f-441f-a6e0-673519ce7a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:25.931439 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1bc8f-059f-441f-a6e0-673519ce7a78 None admin] PATH_INFO: `/v3/roles/1ecbde8dcaa44047899f618334033d43` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:25.933174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1bc8f-059f-441f-a6e0-673519ce7a78 None admin] RBAC: Authorizing `identity:get_role(role_id=1ecbde8dcaa44047899f618334033d43)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:25.934603 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1bc8f-059f-441f-a6e0-673519ce7a78 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:25.935967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 553/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:49:25 2022] GET /identity/v3/roles/1ecbde8dcaa44047899f618334033d43 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:25.942553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f49b1-7437-452a-869c-3d1aa3bd8702 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:26.063732 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f49b1-7437-452a-869c-3d1aa3bd8702 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:26.090093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:26.107005 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab4fa0-8214-46cc-8be4-705b78552819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:26.107890 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab4fa0-8214-46cc-8be4-705b78552819 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:26.108170 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab4fa0-8214-46cc-8be4-705b78552819 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:26.108441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab4fa0-8214-46cc-8be4-705b78552819 None admin] PATH_INFO: `/v3/users/c03854c7947f448db3bfbab3e51d790c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:26.109712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab4fa0-8214-46cc-8be4-705b78552819 None admin] RBAC: Authorizing `identity:get_user(user_id=c03854c7947f448db3bfbab3e51d790c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:26.111198 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab4fa0-8214-46cc-8be4-705b78552819 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:26.112856 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 574/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:49:25 2022] GET /identity/v3/users/c03854c7947f448db3bfbab3e51d790c => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:26.118845 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1bc8f-059f-441f-a6e0-673519ce7a78 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:26.223223 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1bc8f-059f-441f-a6e0-673519ce7a78 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:26.245698 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:26.258167 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bf21c-f4a0-458c-b8fd-117e730fad2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:26.258813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bf21c-f4a0-458c-b8fd-117e730fad2c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:26.259092 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bf21c-f4a0-458c-b8fd-117e730fad2c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:26.259442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bf21c-f4a0-458c-b8fd-117e730fad2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:26.335594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bf21c-f4a0-458c-b8fd-117e730fad2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:26.336989 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bf21c-f4a0-458c-b8fd-117e730fad2c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:26.437564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 554/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:49:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 18:49:26.447526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab4fa0-8214-46cc-8be4-705b78552819 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:26.568630 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab4fa0-8214-46cc-8be4-705b78552819 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:26.606914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994dea5-5824-491a-8ed9-d75170bd7ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:26.607712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994dea5-5824-491a-8ed9-d75170bd7ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:26.607989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994dea5-5824-491a-8ed9-d75170bd7ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:26.608261 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994dea5-5824-491a-8ed9-d75170bd7ee1 None admin] PATH_INFO: `/v3/projects/1ae02f2c3b57454c82e72a20276d7342` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:26.609462 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994dea5-5824-491a-8ed9-d75170bd7ee1 None admin] RBAC: Authorizing `identity:get_project(project_id=1ae02f2c3b57454c82e72a20276d7342)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:26.610940 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994dea5-5824-491a-8ed9-d75170bd7ee1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:26.612648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 575/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:49:26 2022] GET /identity/v3/projects/1ae02f2c3b57454c82e72a20276d7342 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:26.619172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bf21c-f4a0-458c-b8fd-117e730fad2c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:26.645676 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:26.724617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bf21c-f4a0-458c-b8fd-117e730fad2c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:26.762016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85566bff-bc3b-4950-badb-8c50f5d6f158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:26.762669 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85566bff-bc3b-4950-badb-8c50f5d6f158 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:26.762947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85566bff-bc3b-4950-badb-8c50f5d6f158 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:26.763217 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85566bff-bc3b-4950-badb-8c50f5d6f158 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:26.764052 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85566bff-bc3b-4950-badb-8c50f5d6f158 None admin] RBAC: Adding query filter params (role.id=1ecbde8dcaa44047899f618334033d43, scope.project.id=1ae02f2c3b57454c82e72a20276d7342, user.id=c03854c7947f448db3bfbab3e51d790c) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:26.764359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85566bff-bc3b-4950-badb-8c50f5d6f158 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:26.765837 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85566bff-bc3b-4950-badb-8c50f5d6f158 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:26.771742 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 555/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:49:26 2022] GET /identity/v3/role_assignments?user.id=c03854c7947f448db3bfbab3e51d790c&scope.project.id=1ae02f2c3b57454c82e72a20276d7342&role.id=1ecbde8dcaa44047899f618334033d43 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:29.079247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35746f80-b323-46a8-8753-87f1a043b34f None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:29.079854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35746f80-b323-46a8-8753-87f1a043b34f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:29.079854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35746f80-b323-46a8-8753-87f1a043b34f None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:29.081144 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 576/1131] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:29.088106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03943f3-e02b-433b-8758-39bb413a46e1 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:29.088965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03943f3-e02b-433b-8758-39bb413a46e1 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:29.089149 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03943f3-e02b-433b-8758-39bb413a46e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:29.112952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f03943f3-e02b-433b-8758-39bb413a46e1 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:29.114182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f03943f3-e02b-433b-8758-39bb413a46e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:29.191310 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 556/1132] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:29.216447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35746f80-b323-46a8-8753-87f1a043b34f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:29.292776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:29.338093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35746f80-b323-46a8-8753-87f1a043b34f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:29.373986 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7ffc9-f26b-4692-8a59-6b7b3230664a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:29.374779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7ffc9-f26b-4692-8a59-6b7b3230664a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:29.375060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7ffc9-f26b-4692-8a59-6b7b3230664a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:29.375335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7ffc9-f26b-4692-8a59-6b7b3230664a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:29.376648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7ffc9-f26b-4692-8a59-6b7b3230664a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:29.378128 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7ffc9-f26b-4692-8a59-6b7b3230664a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:29.379751 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 577/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:49:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:29.386037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03943f3-e02b-433b-8758-39bb413a46e1 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:29.405548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:29.489691 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03943f3-e02b-433b-8758-39bb413a46e1 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:29.524923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e00086-cfba-43c1-a64a-2e3cdbd1d4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:29.525584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e00086-cfba-43c1-a64a-2e3cdbd1d4db None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:29.525868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e00086-cfba-43c1-a64a-2e3cdbd1d4db None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:29.526257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e00086-cfba-43c1-a64a-2e3cdbd1d4db None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:29.526962 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e00086-cfba-43c1-a64a-2e3cdbd1d4db None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:29.528399 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e00086-cfba-43c1-a64a-2e3cdbd1d4db None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:29.559276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 557/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 2 18:49:29 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:49:31.844614 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd794027-93d9-4478-a3da-a5d274c4221b None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:31.845462 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd794027-93d9-4478-a3da-a5d274c4221b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:31.845462 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd794027-93d9-4478-a3da-a5d274c4221b None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:31.847594 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 578/1135] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:31.853875 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e9c9b-852e-4370-91ec-b05498f58ec2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:31.854635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e9c9b-852e-4370-91ec-b05498f58ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:31.854888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e9c9b-852e-4370-91ec-b05498f58ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:31.877700 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8e8e9c9b-852e-4370-91ec-b05498f58ec2 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:31.878945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8e8e9c9b-852e-4370-91ec-b05498f58ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:31.947031 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:31.953707 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 558/1136] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:31.980461 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd794027-93d9-4478-a3da-a5d274c4221b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:32.100688 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd794027-93d9-4478-a3da-a5d274c4221b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:32.128151 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:32.138624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50ab4d-b1d0-457a-9055-a135b6b12303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:32.139422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50ab4d-b1d0-457a-9055-a135b6b12303 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:32.139699 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50ab4d-b1d0-457a-9055-a135b6b12303 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:32.139972 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50ab4d-b1d0-457a-9055-a135b6b12303 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:32.141161 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50ab4d-b1d0-457a-9055-a135b6b12303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:32.142646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50ab4d-b1d0-457a-9055-a135b6b12303 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:32.144271 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 579/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:49:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:32.150326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e9c9b-852e-4370-91ec-b05498f58ec2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:32.259424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e9c9b-852e-4370-91ec-b05498f58ec2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:32.297664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431ba5a-3c16-4b48-ad5b-6099e0e42f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:32.298358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431ba5a-3c16-4b48-ad5b-6099e0e42f44 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:32.298642 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431ba5a-3c16-4b48-ad5b-6099e0e42f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:32.298912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431ba5a-3c16-4b48-ad5b-6099e0e42f44 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:32.299614 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431ba5a-3c16-4b48-ad5b-6099e0e42f44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:32.301059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431ba5a-3c16-4b48-ad5b-6099e0e42f44 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:32.324926 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 559/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 2 18:49:32 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:49:34.572191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f581c09-8cd5-4aa0-bc08-5dc962b76458 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:34.572679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f581c09-8cd5-4aa0-bc08-5dc962b76458 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:34.572765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f581c09-8cd5-4aa0-bc08-5dc962b76458 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:34.574341 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 580/1139] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:34.580712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2ee04-cabc-4ce3-88c5-0a2b24fb9431 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:34.581782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2ee04-cabc-4ce3-88c5-0a2b24fb9431 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:34.581968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2ee04-cabc-4ce3-88c5-0a2b24fb9431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:34.601813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-07b2ee04-cabc-4ce3-88c5-0a2b24fb9431 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:34.602988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-07b2ee04-cabc-4ce3-88c5-0a2b24fb9431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:34.656054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:34.676512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 560/1140] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:34.699908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f581c09-8cd5-4aa0-bc08-5dc962b76458 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:34.806240 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f581c09-8cd5-4aa0-bc08-5dc962b76458 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:34.841219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c3896-831a-4dca-9976-8970c298e835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:34.842025 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c3896-831a-4dca-9976-8970c298e835 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:34.842299 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c3896-831a-4dca-9976-8970c298e835 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:34.842564 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c3896-831a-4dca-9976-8970c298e835 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:34.853127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c3896-831a-4dca-9976-8970c298e835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:49:34.860808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-575c3896-831a-4dca-9976-8970c298e835 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:49:34.860808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:34.860808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:34.860808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:34.860808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:34.860808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:34.860808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:34.860808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:34.860808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:34.860808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:34.860808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:34.860808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:34.860808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:49:34.860808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:49:34.860808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:49:34.860808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:49:34.861929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:49:34.861929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:49:34.861929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:49:34.861929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:49:34.861929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:34.861929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:34.861929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:34.861929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:34.861929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:34.861929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:34.861929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:34.861929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:34.861929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:34.861929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:34.861929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:34.861929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:34.862774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:34.862774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:34.862774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:34.862774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:34.862774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:49:34.862774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:49:34.862774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:49:34.862774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:49:34.862774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:49:34.862774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:49:34.862774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:49:34.862774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:49:34.862774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 581/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:49:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:34.868229 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2ee04-cabc-4ce3-88c5-0a2b24fb9431 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:34.972624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2ee04-cabc-4ce3-88c5-0a2b24fb9431 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:35.016328 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2032aa1-1433-49d9-abfd-be5ca8089c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:35.016996 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2032aa1-1433-49d9-abfd-be5ca8089c3f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:35.017278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2032aa1-1433-49d9-abfd-be5ca8089c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:35.017555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2032aa1-1433-49d9-abfd-be5ca8089c3f None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:35.018331 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2032aa1-1433-49d9-abfd-be5ca8089c3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:35.018636 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2032aa1-1433-49d9-abfd-be5ca8089c3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:35.020022 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2032aa1-1433-49d9-abfd-be5ca8089c3f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:35.028359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 561/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:49:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:35.034383 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c3896-831a-4dca-9976-8970c298e835 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:35.093964 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:35.141762 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c3896-831a-4dca-9976-8970c298e835 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:35.177409 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca0869-2d4a-4dff-bf96-3a8725ba6554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:35.178292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca0869-2d4a-4dff-bf96-3a8725ba6554 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:35.178567 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca0869-2d4a-4dff-bf96-3a8725ba6554 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:35.178834 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca0869-2d4a-4dff-bf96-3a8725ba6554 None admin] PATH_INFO: `/v3/users/5aacd7295693484cb738ec6a2b15fc36` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:35.192751 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca0869-2d4a-4dff-bf96-3a8725ba6554 None admin] RBAC: Authorizing `identity:get_user(user_id=5aacd7295693484cb738ec6a2b15fc36)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:35.194220 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca0869-2d4a-4dff-bf96-3a8725ba6554 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:35.195857 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 582/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:49:35 2022] GET /identity/v3/users/5aacd7295693484cb738ec6a2b15fc36 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:35.203364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2032aa1-1433-49d9-abfd-be5ca8089c3f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:35.254981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:35.314590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2032aa1-1433-49d9-abfd-be5ca8089c3f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:35.351997 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0179e-4cc6-4443-b20a-641c9f9994b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:35.352577 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0179e-4cc6-4443-b20a-641c9f9994b1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:35.352852 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0179e-4cc6-4443-b20a-641c9f9994b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:35.353123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0179e-4cc6-4443-b20a-641c9f9994b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:35.421093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0179e-4cc6-4443-b20a-641c9f9994b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:35.422562 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0179e-4cc6-4443-b20a-641c9f9994b1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:35.471792 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:35.531988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 562/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:49:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 18:49:35.538547 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca0869-2d4a-4dff-bf96-3a8725ba6554 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:35.652357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca0869-2d4a-4dff-bf96-3a8725ba6554 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:35.665571 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:35.695099 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c53a4-c09b-49f3-a87c-8db93f1e18be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:35.695964 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c53a4-c09b-49f3-a87c-8db93f1e18be None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:35.696243 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c53a4-c09b-49f3-a87c-8db93f1e18be None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:35.696516 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c53a4-c09b-49f3-a87c-8db93f1e18be None admin] PATH_INFO: `/v3/projects/03b7f2c08d4442b7b413656903ac1d6d` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:35.697839 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c53a4-c09b-49f3-a87c-8db93f1e18be None admin] RBAC: Authorizing `identity:get_project(project_id=03b7f2c08d4442b7b413656903ac1d6d)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:35.699353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c53a4-c09b-49f3-a87c-8db93f1e18be None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:35.701072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 583/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:49:35 2022] GET /identity/v3/projects/03b7f2c08d4442b7b413656903ac1d6d => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:35.707854 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0179e-4cc6-4443-b20a-641c9f9994b1 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:35.828148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0179e-4cc6-4443-b20a-641c9f9994b1 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:35.865134 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af8a30-d58b-442f-bb9a-0fc56bdf2b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:35.865823 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af8a30-d58b-442f-bb9a-0fc56bdf2b69 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:35.866100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af8a30-d58b-442f-bb9a-0fc56bdf2b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:35.866371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af8a30-d58b-442f-bb9a-0fc56bdf2b69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:35.867193 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af8a30-d58b-442f-bb9a-0fc56bdf2b69 None admin] RBAC: Adding query filter params (role.id=8560bac1acf74dce81ea6a76f751b641, scope.project.id=03b7f2c08d4442b7b413656903ac1d6d, user.id=5aacd7295693484cb738ec6a2b15fc36) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:35.867500 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af8a30-d58b-442f-bb9a-0fc56bdf2b69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:35.868952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af8a30-d58b-442f-bb9a-0fc56bdf2b69 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:35.875248 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 563/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:49:35 2022] GET /identity/v3/role_assignments?user.id=5aacd7295693484cb738ec6a2b15fc36&scope.project.id=03b7f2c08d4442b7b413656903ac1d6d&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:38.086330 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda539ab-2be0-44b3-9943-66830dd89a16 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:38.086960 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda539ab-2be0-44b3-9943-66830dd89a16 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:38.086960 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda539ab-2be0-44b3-9943-66830dd89a16 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:38.088416 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 584/1147] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:49:38.097601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612b992-d218-4d8c-92f7-1fd6fea215d5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:38.098095 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612b992-d218-4d8c-92f7-1fd6fea215d5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:38.098194 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612b992-d218-4d8c-92f7-1fd6fea215d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:38.117682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2612b992-d218-4d8c-92f7-1fd6fea215d5 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:38.118886 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2612b992-d218-4d8c-92f7-1fd6fea215d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:38.121629 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:38.191997 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 564/1148] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:38.217094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda539ab-2be0-44b3-9943-66830dd89a16 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:38.333789 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda539ab-2be0-44b3-9943-66830dd89a16 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:38.372222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56100f0-1dca-42da-8dba-c59ca988ca07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:38.372944 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56100f0-1dca-42da-8dba-c59ca988ca07 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:38.373221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56100f0-1dca-42da-8dba-c59ca988ca07 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:38.373489 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56100f0-1dca-42da-8dba-c59ca988ca07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:38.384446 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56100f0-1dca-42da-8dba-c59ca988ca07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:49:38.392228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-a56100f0-1dca-42da-8dba-c59ca988ca07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:49:38.392228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:38.392228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:38.392228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:38.392228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:38.392228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:38.392228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:38.392228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:38.392228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:38.392228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:38.392228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:38.392228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:38.392228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:49:38.392228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:49:38.392228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:49:38.392228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:49:38.393272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:49:38.393272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:49:38.393272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:49:38.393272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:49:38.393272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:38.393272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:38.393272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:38.393272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:38.393272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:38.393272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:38.393272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:38.393272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:38.393272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:38.393272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:38.393272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:38.393272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:38.394440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:38.394440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:38.394440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:38.394440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:38.394440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:49:38.394440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:49:38.394440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:49:38.394440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:49:38.394440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:49:38.394440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:49:38.394440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:49:38.394440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:49:38.394440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 585/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:49:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:38.400466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612b992-d218-4d8c-92f7-1fd6fea215d5 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:38.506931 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612b992-d218-4d8c-92f7-1fd6fea215d5 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:38.544716 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded4dd9-b149-4f65-ac93-d47ead18c212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:38.545392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded4dd9-b149-4f65-ac93-d47ead18c212 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:38.545667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded4dd9-b149-4f65-ac93-d47ead18c212 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:38.545970 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded4dd9-b149-4f65-ac93-d47ead18c212 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:38.546722 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded4dd9-b149-4f65-ac93-d47ead18c212 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:38.547023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded4dd9-b149-4f65-ac93-d47ead18c212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:38.548398 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded4dd9-b149-4f65-ac93-d47ead18c212 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:38.558059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 565/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:49:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:38.564527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56100f0-1dca-42da-8dba-c59ca988ca07 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:38.609195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:38.668434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56100f0-1dca-42da-8dba-c59ca988ca07 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:38.703333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb743d-d9c8-47c0-9689-b7c2c624dccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:38.704202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb743d-d9c8-47c0-9689-b7c2c624dccb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:38.704489 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb743d-d9c8-47c0-9689-b7c2c624dccb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:38.704765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb743d-d9c8-47c0-9689-b7c2c624dccb None admin] PATH_INFO: `/v3/users/5aacd7295693484cb738ec6a2b15fc36` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:38.706109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb743d-d9c8-47c0-9689-b7c2c624dccb None admin] RBAC: Authorizing `identity:get_user(user_id=5aacd7295693484cb738ec6a2b15fc36)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:38.707905 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb743d-d9c8-47c0-9689-b7c2c624dccb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:38.709560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 586/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:49:38 2022] GET /identity/v3/users/5aacd7295693484cb738ec6a2b15fc36 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:38.715874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded4dd9-b149-4f65-ac93-d47ead18c212 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:38.719057 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:38.825974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded4dd9-b149-4f65-ac93-d47ead18c212 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:38.861995 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1153b-42ba-4cf6-8bcf-27bfc857efba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:38.862864 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1153b-42ba-4cf6-8bcf-27bfc857efba None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:38.863146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1153b-42ba-4cf6-8bcf-27bfc857efba None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:38.863416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1153b-42ba-4cf6-8bcf-27bfc857efba None admin] PATH_INFO: `/v3/projects/03b7f2c08d4442b7b413656903ac1d6d` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:38.864665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1153b-42ba-4cf6-8bcf-27bfc857efba None admin] RBAC: Authorizing `identity:get_project(project_id=03b7f2c08d4442b7b413656903ac1d6d)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:38.866157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1153b-42ba-4cf6-8bcf-27bfc857efba None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:38.867864 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 566/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:49:38 2022] GET /identity/v3/projects/03b7f2c08d4442b7b413656903ac1d6d => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:38.876836 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb743d-d9c8-47c0-9689-b7c2c624dccb None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:38.979331 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb743d-d9c8-47c0-9689-b7c2c624dccb None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:38.988140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:39.016776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dead15a-66eb-4540-8f5f-b78b5a87d470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:39.017664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dead15a-66eb-4540-8f5f-b78b5a87d470 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:39.017971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dead15a-66eb-4540-8f5f-b78b5a87d470 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:39.018243 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dead15a-66eb-4540-8f5f-b78b5a87d470 None admin] PATH_INFO: `/v3/projects/03b7f2c08d4442b7b413656903ac1d6d/users/5aacd7295693484cb738ec6a2b15fc36/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:39.020461 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dead15a-66eb-4540-8f5f-b78b5a87d470 None admin] RBAC: Authorizing `identity:create_grant(project_id=03b7f2c08d4442b7b413656903ac1d6d, user_id=5aacd7295693484cb738ec6a2b15fc36, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:39.021943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dead15a-66eb-4540-8f5f-b78b5a87d470 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:39.038007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 587/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:49:38 2022] PUT /identity/v3/projects/03b7f2c08d4442b7b413656903ac1d6d/users/5aacd7295693484cb738ec6a2b15fc36/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:49:41.256769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d6e5-154c-4b36-a60b-8a0756419bd0 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:41.257357 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d6e5-154c-4b36-a60b-8a0756419bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:41.257357 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d6e5-154c-4b36-a60b-8a0756419bd0 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:41.258715 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 567/1154] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:41.264567 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54457ef9-f88f-4ff6-9987-b4df0d3cf90c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:41.265021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54457ef9-f88f-4ff6-9987-b4df0d3cf90c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:41.265132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54457ef9-f88f-4ff6-9987-b4df0d3cf90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:41.282926 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-54457ef9-f88f-4ff6-9987-b4df0d3cf90c None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:41.284109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-54457ef9-f88f-4ff6-9987-b4df0d3cf90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:41.352877 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 588/1155] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:41.383441 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d6e5-154c-4b36-a60b-8a0756419bd0 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:41.464355 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:41.501977 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d6e5-154c-4b36-a60b-8a0756419bd0 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:41.541071 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4570ddb-1234-4633-99e0-a2d129d3f282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:41.542368 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4570ddb-1234-4633-99e0-a2d129d3f282 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:41.542741 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4570ddb-1234-4633-99e0-a2d129d3f282 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:41.543082 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4570ddb-1234-4633-99e0-a2d129d3f282 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:41.560620 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4570ddb-1234-4633-99e0-a2d129d3f282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:49:41.568203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-b4570ddb-1234-4633-99e0-a2d129d3f282 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:49:41.568203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:41.568203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:41.568203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:41.568203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:41.568203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:41.568203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:41.568203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:41.568203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:41.568203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:41.568203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:41.568203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:41.568203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:49:41.568203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:49:41.568203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:49:41.568203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:49:41.569273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:49:41.569273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:49:41.569273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:49:41.569273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:49:41.569273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:41.569273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:41.569273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:41.569273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:41.569273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:41.569273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:41.569273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:41.569273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:41.569273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:41.569273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:41.569273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:41.569273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:41.570278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:41.570278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:41.570278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:41.570278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:41.570278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:49:41.570278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:49:41.570278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:49:41.570278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:49:41.570278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:49:41.570278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:49:41.570278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:49:41.570278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:41.573975 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 568/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:49:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:41.575652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54457ef9-f88f-4ff6-9987-b4df0d3cf90c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:41.676347 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:41.680844 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54457ef9-f88f-4ff6-9987-b4df0d3cf90c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:41.716780 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e517e-ea5f-4f5d-8bf3-0dd77929cb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:41.717451 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e517e-ea5f-4f5d-8bf3-0dd77929cb1a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:41.717700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e517e-ea5f-4f5d-8bf3-0dd77929cb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:41.718025 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e517e-ea5f-4f5d-8bf3-0dd77929cb1a None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:41.718775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e517e-ea5f-4f5d-8bf3-0dd77929cb1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:41.719082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e517e-ea5f-4f5d-8bf3-0dd77929cb1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:41.720458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e517e-ea5f-4f5d-8bf3-0dd77929cb1a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:41.728735 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 589/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:49:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:41.735807 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4570ddb-1234-4633-99e0-a2d129d3f282 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:41.852028 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4570ddb-1234-4633-99e0-a2d129d3f282 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:41.880693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:41.889537 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc807e-b7c4-4d3f-8eb6-66111d9c66e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:41.890440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc807e-b7c4-4d3f-8eb6-66111d9c66e3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:41.890712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc807e-b7c4-4d3f-8eb6-66111d9c66e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:41.890980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc807e-b7c4-4d3f-8eb6-66111d9c66e3 None admin] PATH_INFO: `/v3/users/5aacd7295693484cb738ec6a2b15fc36` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:41.892193 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc807e-b7c4-4d3f-8eb6-66111d9c66e3 None admin] RBAC: Authorizing `identity:get_user(user_id=5aacd7295693484cb738ec6a2b15fc36)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:41.893625 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc807e-b7c4-4d3f-8eb6-66111d9c66e3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:41.895277 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 569/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:49:41 2022] GET /identity/v3/users/5aacd7295693484cb738ec6a2b15fc36 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:41.901824 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e517e-ea5f-4f5d-8bf3-0dd77929cb1a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:42.009813 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e517e-ea5f-4f5d-8bf3-0dd77929cb1a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:42.044702 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99711780-b849-4d18-be7c-9d62d9209e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:42.045343 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99711780-b849-4d18-be7c-9d62d9209e9d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:42.045620 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99711780-b849-4d18-be7c-9d62d9209e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:42.045923 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99711780-b849-4d18-be7c-9d62d9209e9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:42.074342 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:42.117246 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99711780-b849-4d18-be7c-9d62d9209e9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:42.118647 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99711780-b849-4d18-be7c-9d62d9209e9d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:42.224821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 590/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:49:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 18:49:42.232096 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc807e-b7c4-4d3f-8eb6-66111d9c66e3 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:42.347525 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc807e-b7c4-4d3f-8eb6-66111d9c66e3 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:42.385387 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc700d49-08bf-446e-a7d2-d31664976016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:42.386768 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc700d49-08bf-446e-a7d2-d31664976016 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:42.387216 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc700d49-08bf-446e-a7d2-d31664976016 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:42.387635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc700d49-08bf-446e-a7d2-d31664976016 None admin] PATH_INFO: `/v3/projects/03b7f2c08d4442b7b413656903ac1d6d` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:42.389737 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc700d49-08bf-446e-a7d2-d31664976016 None admin] RBAC: Authorizing `identity:get_project(project_id=03b7f2c08d4442b7b413656903ac1d6d)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:42.392120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc700d49-08bf-446e-a7d2-d31664976016 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:42.394887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 570/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:49:42 2022] GET /identity/v3/projects/03b7f2c08d4442b7b413656903ac1d6d => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:42.402101 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99711780-b849-4d18-be7c-9d62d9209e9d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:42.470129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:42.515714 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99711780-b849-4d18-be7c-9d62d9209e9d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:42.558953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf13b0d-5222-4487-823a-df40e13efbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:42.559615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf13b0d-5222-4487-823a-df40e13efbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:42.559898 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf13b0d-5222-4487-823a-df40e13efbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:42.560168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf13b0d-5222-4487-823a-df40e13efbb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:42.561036 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf13b0d-5222-4487-823a-df40e13efbb8 None admin] RBAC: Adding query filter params (role.id=8560bac1acf74dce81ea6a76f751b641, scope.project.id=03b7f2c08d4442b7b413656903ac1d6d, user.id=5aacd7295693484cb738ec6a2b15fc36) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:42.561349 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf13b0d-5222-4487-823a-df40e13efbb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:42.562827 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf13b0d-5222-4487-823a-df40e13efbb8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:42.569000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 591/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:49:42 2022] GET /identity/v3/role_assignments?user.id=5aacd7295693484cb738ec6a2b15fc36&scope.project.id=03b7f2c08d4442b7b413656903ac1d6d&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:44.787128 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518efcfc-a77b-4419-b111-bd131d03d031 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:44.787947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518efcfc-a77b-4419-b111-bd131d03d031 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:44.787947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518efcfc-a77b-4419-b111-bd131d03d031 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:44.790092 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 571/1162] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:44.796926 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ba7e0-b65a-4623-b0ef-5a20f40f3493 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:44.797318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ba7e0-b65a-4623-b0ef-5a20f40f3493 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:44.797475 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ba7e0-b65a-4623-b0ef-5a20f40f3493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:44.817283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e84ba7e0-b65a-4623-b0ef-5a20f40f3493 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:44.818531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e84ba7e0-b65a-4623-b0ef-5a20f40f3493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:44.890493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 592/1163] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:44.914315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518efcfc-a77b-4419-b111-bd131d03d031 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:44.983576 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:45.021819 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518efcfc-a77b-4419-b111-bd131d03d031 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:45.058624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1026cf1-2ae8-45a2-ac33-26ab684d3983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:45.059208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1026cf1-2ae8-45a2-ac33-26ab684d3983 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:45.059518 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1026cf1-2ae8-45a2-ac33-26ab684d3983 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:45.059789 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1026cf1-2ae8-45a2-ac33-26ab684d3983 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:45.130876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1026cf1-2ae8-45a2-ac33-26ab684d3983 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:45.132318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1026cf1-2ae8-45a2-ac33-26ab684d3983 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:45.197877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:45.237711 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 572/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:49:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 18:49:45.244067 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ba7e0-b65a-4623-b0ef-5a20f40f3493 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:45.304301 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:45.350416 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ba7e0-b65a-4623-b0ef-5a20f40f3493 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:45.385118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beec723-97ce-488e-8528-3019c2cdd90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:45.386104 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beec723-97ce-488e-8528-3019c2cdd90a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:45.386382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beec723-97ce-488e-8528-3019c2cdd90a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:45.386653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beec723-97ce-488e-8528-3019c2cdd90a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:45.393616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beec723-97ce-488e-8528-3019c2cdd90a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:45.395096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beec723-97ce-488e-8528-3019c2cdd90a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:45.409399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-2beec723-97ce-488e-8528-3019c2cdd90a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 18:49:45.409399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:45.409399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 02 18:49:45.409399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 02 18:49:45.409399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:49:45.409399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:49:45.409399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:49:45.409399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:49:45.409399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 02 18:49:45.409399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:49:45.409399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:49:45.409399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:49:45.409399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:45.409399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:45.409399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:45.409399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:45.409399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:45.410619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:45.410619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:45.410619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:45.410619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:45.410619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:45.410619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:45.410619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:49:45.410619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:49:45.410619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:49:45.410619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:49:45.410619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:45.410619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:45.410619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:45.410619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:45.410619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:45.410619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:45.411632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:45.411632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:45.411632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:45.411632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:45.411632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:45.411632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:45.411632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:45.411632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:45.411632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:45.411632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:45.411632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 02 18:49:45.411632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:49:45.411632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 18:49:45.411632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:49:45.411632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 593/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 2 18:49:45 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:45.416678 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1026cf1-2ae8-45a2-ac33-26ab684d3983 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:45.520533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1026cf1-2ae8-45a2-ac33-26ab684d3983 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:45.555952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292de4c6-8990-4bbf-879e-8e99ba85ba02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:45.556618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292de4c6-8990-4bbf-879e-8e99ba85ba02 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:45.556893 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292de4c6-8990-4bbf-879e-8e99ba85ba02 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:45.557162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292de4c6-8990-4bbf-879e-8e99ba85ba02 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:45.557946 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292de4c6-8990-4bbf-879e-8e99ba85ba02 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:45.558246 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292de4c6-8990-4bbf-879e-8e99ba85ba02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:45.559623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292de4c6-8990-4bbf-879e-8e99ba85ba02 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:45.566819 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 573/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jun 2 18:49:45 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:47.770696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55063c38-2355-4e90-b1ba-e669041aa63d None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:47.771298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55063c38-2355-4e90-b1ba-e669041aa63d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:47.771298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55063c38-2355-4e90-b1ba-e669041aa63d None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:47.772646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 594/1167] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:47.780855 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecb9e6-5e57-4885-aa1b-e45edfc61bd3 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:47.781391 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecb9e6-5e57-4885-aa1b-e45edfc61bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:47.781391 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecb9e6-5e57-4885-aa1b-e45edfc61bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:47.800987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-57ecb9e6-5e57-4885-aa1b-e45edfc61bd3 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:47.802139 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-57ecb9e6-5e57-4885-aa1b-e45edfc61bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:47.831905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:47.879892 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 574/1168] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:47.905350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55063c38-2355-4e90-b1ba-e669041aa63d None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:48.020626 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55063c38-2355-4e90-b1ba-e669041aa63d None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:48.034320 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:48.055917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab620093-e173-4158-bef2-697abba71624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:48.056497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab620093-e173-4158-bef2-697abba71624 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:48.056770 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab620093-e173-4158-bef2-697abba71624 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:48.057038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab620093-e173-4158-bef2-697abba71624 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:48.057957 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab620093-e173-4158-bef2-697abba71624 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:48.059324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab620093-e173-4158-bef2-697abba71624 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:48.076650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 595/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Thu Jun 2 18:49:47 2022] POST /identity/v3/domains => generated 267 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:49:50.324154 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6207680-ec6a-4325-a783-db27cad07fb2 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:50.325048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6207680-ec6a-4325-a783-db27cad07fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:50.325048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6207680-ec6a-4325-a783-db27cad07fb2 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:50.327248 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 575/1170] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:50.333856 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49819fd-6e92-4ef3-b579-b65fa64af21b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:50.334609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49819fd-6e92-4ef3-b579-b65fa64af21b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:50.334751 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49819fd-6e92-4ef3-b579-b65fa64af21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:50.354691 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b49819fd-6e92-4ef3-b579-b65fa64af21b None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:50.355894 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b49819fd-6e92-4ef3-b579-b65fa64af21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:50.430952 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 596/1171] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:50.456925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6207680-ec6a-4325-a783-db27cad07fb2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:50.569155 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6207680-ec6a-4325-a783-db27cad07fb2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:50.606973 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18bfe5-3b9f-4bc8-8210-bdf1689240d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:50.607771 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18bfe5-3b9f-4bc8-8210-bdf1689240d0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:50.608047 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18bfe5-3b9f-4bc8-8210-bdf1689240d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:50.608317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18bfe5-3b9f-4bc8-8210-bdf1689240d0 None admin] PATH_INFO: `/v3/domains/56a7d5cf0dd848e1a505b049231c2ebd` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:50.619086 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18bfe5-3b9f-4bc8-8210-bdf1689240d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=56a7d5cf0dd848e1a505b049231c2ebd)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:50.620764 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18bfe5-3b9f-4bc8-8210-bdf1689240d0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:50.622445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 576/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Thu Jun 2 18:49:50 2022] GET /identity/v3/domains/56a7d5cf0dd848e1a505b049231c2ebd => generated 267 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:50.631734 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49819fd-6e92-4ef3-b579-b65fa64af21b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:50.742441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49819fd-6e92-4ef3-b579-b65fa64af21b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:50.744773 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:50.777475 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bbb12-c91c-49cd-9ba2-777e4042a702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:50.778156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bbb12-c91c-49cd-9ba2-777e4042a702 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:50.778401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bbb12-c91c-49cd-9ba2-777e4042a702 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:50.778689 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bbb12-c91c-49cd-9ba2-777e4042a702 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:50.779387 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bbb12-c91c-49cd-9ba2-777e4042a702 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:50.780833 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bbb12-c91c-49cd-9ba2-777e4042a702 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:50.809983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 597/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 2 18:49:50 2022] POST /identity/v3/projects => generated 361 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:49:53.071407 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4af05d-453e-47a1-8293-4add0c04fa6a None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:53.072300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4af05d-453e-47a1-8293-4add0c04fa6a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:53.072300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4af05d-453e-47a1-8293-4add0c04fa6a None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:53.074716 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 577/1174] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:53.083162 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234deaf-c8c7-48c4-900d-d938d7847caa None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:53.083609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234deaf-c8c7-48c4-900d-d938d7847caa None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:53.083697 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234deaf-c8c7-48c4-900d-d938d7847caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:53.102643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b234deaf-c8c7-48c4-900d-d938d7847caa None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:53.103914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b234deaf-c8c7-48c4-900d-d938d7847caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:53.172097 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 598/1175] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:49:53.207534 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4af05d-453e-47a1-8293-4add0c04fa6a None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:53.233495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:53.318731 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4af05d-453e-47a1-8293-4add0c04fa6a None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:53.353955 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e22794-204d-4faa-929c-f1282ca77bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:53.354768 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e22794-204d-4faa-929c-f1282ca77bfa None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:53.355038 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e22794-204d-4faa-929c-f1282ca77bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:53.355336 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e22794-204d-4faa-929c-f1282ca77bfa None admin] PATH_INFO: `/v3/domains/56a7d5cf0dd848e1a505b049231c2ebd` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:53.356653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e22794-204d-4faa-929c-f1282ca77bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=56a7d5cf0dd848e1a505b049231c2ebd)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:53.358144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e22794-204d-4faa-929c-f1282ca77bfa None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:53.359769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 578/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Thu Jun 2 18:49:53 2022] GET /identity/v3/domains/56a7d5cf0dd848e1a505b049231c2ebd => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:53.366410 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234deaf-c8c7-48c4-900d-d938d7847caa None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:53.467599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:53.485579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234deaf-c8c7-48c4-900d-d938d7847caa None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:53.520835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13677e-384a-4a35-8fc1-48d8a31c8eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:53.521509 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13677e-384a-4a35-8fc1-48d8a31c8eab None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:53.521784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13677e-384a-4a35-8fc1-48d8a31c8eab None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:53.522083 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13677e-384a-4a35-8fc1-48d8a31c8eab None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:53.522791 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13677e-384a-4a35-8fc1-48d8a31c8eab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:53.524197 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13677e-384a-4a35-8fc1-48d8a31c8eab None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:53.548804 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 599/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 2 18:49:53 2022] POST /identity/v3/users => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:49:55.836590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8939e17-6f07-4d68-b865-e058312ca3f0 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:55.837434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8939e17-6f07-4d68-b865-e058312ca3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:55.837434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8939e17-6f07-4d68-b865-e058312ca3f0 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:55.839243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 579/1178] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:49:55.845573 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fd2e7-575a-4e6e-a52c-2c22b23636fa None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:55.846069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fd2e7-575a-4e6e-a52c-2c22b23636fa None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:55.846157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fd2e7-575a-4e6e-a52c-2c22b23636fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:55.870825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-073fd2e7-575a-4e6e-a52c-2c22b23636fa None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:55.872909 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-073fd2e7-575a-4e6e-a52c-2c22b23636fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:55.949527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 600/1179] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:55.979367 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8939e17-6f07-4d68-b865-e058312ca3f0 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:56.078379 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:56.093877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8939e17-6f07-4d68-b865-e058312ca3f0 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:56.128456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b76eb-3132-4248-862f-fdd53750b96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:56.129245 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b76eb-3132-4248-862f-fdd53750b96a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:56.129524 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b76eb-3132-4248-862f-fdd53750b96a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:56.129827 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b76eb-3132-4248-862f-fdd53750b96a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:56.141023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b76eb-3132-4248-862f-fdd53750b96a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:49:56.148590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-4e7b76eb-3132-4248-862f-fdd53750b96a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:49:56.148590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:56.148590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:56.148590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:56.148590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:56.148590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:56.148590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:56.148590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:56.148590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:56.148590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:56.148590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:56.148590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:56.148590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:49:56.148590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:49:56.148590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:49:56.148590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:49:56.149641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:49:56.149641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:49:56.149641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:49:56.149641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:49:56.149641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:56.149641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:56.149641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:56.149641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:56.149641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:56.149641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:56.149641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:56.149641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:56.149641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:56.149641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:56.149641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:56.149641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:56.150685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:56.150685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:56.150685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:56.150685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:56.150685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:49:56.150685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:49:56.150685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:49:56.150685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:49:56.150685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:49:56.150685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:49:56.150685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:49:56.150685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:56.150685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 580/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:49:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:56.156539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fd2e7-575a-4e6e-a52c-2c22b23636fa None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:56.233894 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:56.272563 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fd2e7-575a-4e6e-a52c-2c22b23636fa None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:56.309265 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc18aa3-f636-4bc6-8e19-2ce5ed77a655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:56.309964 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc18aa3-f636-4bc6-8e19-2ce5ed77a655 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:56.310244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc18aa3-f636-4bc6-8e19-2ce5ed77a655 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:56.310517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc18aa3-f636-4bc6-8e19-2ce5ed77a655 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:56.311263 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc18aa3-f636-4bc6-8e19-2ce5ed77a655 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:56.311572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc18aa3-f636-4bc6-8e19-2ce5ed77a655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:56.312946 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc18aa3-f636-4bc6-8e19-2ce5ed77a655 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:56.321101 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 601/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:49:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:56.328527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b76eb-3132-4248-862f-fdd53750b96a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:56.435798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b76eb-3132-4248-862f-fdd53750b96a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:56.470979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265e358-04a3-44ff-b9f0-06b0f1597060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:56.471836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265e358-04a3-44ff-b9f0-06b0f1597060 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:56.472105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265e358-04a3-44ff-b9f0-06b0f1597060 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:56.472372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265e358-04a3-44ff-b9f0-06b0f1597060 None admin] PATH_INFO: `/v3/users/bcd0526261c74eed94ccb694b9d5b203` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:56.485909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265e358-04a3-44ff-b9f0-06b0f1597060 None admin] RBAC: Authorizing `identity:get_user(user_id=bcd0526261c74eed94ccb694b9d5b203)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:56.487346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265e358-04a3-44ff-b9f0-06b0f1597060 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:56.488961 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 581/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:49:56 2022] GET /identity/v3/users/bcd0526261c74eed94ccb694b9d5b203 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:56.497267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc18aa3-f636-4bc6-8e19-2ce5ed77a655 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:56.612146 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc18aa3-f636-4bc6-8e19-2ce5ed77a655 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:56.647374 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165ef2d-fe17-4c52-a326-adcb8d9c6ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:56.648018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165ef2d-fe17-4c52-a326-adcb8d9c6ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:56.648296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165ef2d-fe17-4c52-a326-adcb8d9c6ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:56.648573 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165ef2d-fe17-4c52-a326-adcb8d9c6ed1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:56.651631 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:56.735988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165ef2d-fe17-4c52-a326-adcb8d9c6ed1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:56.738582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165ef2d-fe17-4c52-a326-adcb8d9c6ed1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:56.858122 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 602/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:49:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 18:49:56.866017 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265e358-04a3-44ff-b9f0-06b0f1597060 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:56.880464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:56.983962 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265e358-04a3-44ff-b9f0-06b0f1597060 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:57.023916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b0efe-6981-45cf-b814-422498331bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:57.024674 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b0efe-6981-45cf-b814-422498331bae None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:57.024920 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b0efe-6981-45cf-b814-422498331bae None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:57.025211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b0efe-6981-45cf-b814-422498331bae None admin] PATH_INFO: `/v3/projects/d5cb9e9c1c5b4f81bc6905008f98234b` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:57.026558 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b0efe-6981-45cf-b814-422498331bae None admin] RBAC: Authorizing `identity:get_project(project_id=d5cb9e9c1c5b4f81bc6905008f98234b)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:57.027988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b0efe-6981-45cf-b814-422498331bae None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:57.029707 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 582/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:49:56 2022] GET /identity/v3/projects/d5cb9e9c1c5b4f81bc6905008f98234b => generated 361 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:57.037065 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165ef2d-fe17-4c52-a326-adcb8d9c6ed1 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:57.078249 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:57.154069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165ef2d-fe17-4c52-a326-adcb8d9c6ed1 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:57.191328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbe4d6-e2c1-4ad3-9185-553ff4014b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:57.191987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbe4d6-e2c1-4ad3-9185-553ff4014b54 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:57.192269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbe4d6-e2c1-4ad3-9185-553ff4014b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:57.192528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbe4d6-e2c1-4ad3-9185-553ff4014b54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:57.193349 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbe4d6-e2c1-4ad3-9185-553ff4014b54 None admin] RBAC: Adding query filter params (role.id=8560bac1acf74dce81ea6a76f751b641, scope.project.id=d5cb9e9c1c5b4f81bc6905008f98234b, user.id=bcd0526261c74eed94ccb694b9d5b203) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:57.193666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbe4d6-e2c1-4ad3-9185-553ff4014b54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:57.195178 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbe4d6-e2c1-4ad3-9185-553ff4014b54 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:57.201879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 603/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:49:57 2022] GET /identity/v3/role_assignments?user.id=bcd0526261c74eed94ccb694b9d5b203&scope.project.id=d5cb9e9c1c5b4f81bc6905008f98234b&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:59.451637 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7742a-81ec-49d4-8658-c15439888002 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:59.452234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7742a-81ec-49d4-8658-c15439888002 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:59.452234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7742a-81ec-49d4-8658-c15439888002 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:59.453573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 583/1186] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:49:59.460281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb164e7-0146-446c-ae19-18745a4750a9 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:59.461037 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb164e7-0146-446c-ae19-18745a4750a9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:59.461154 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb164e7-0146-446c-ae19-18745a4750a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:59.480764 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6eb164e7-0146-446c-ae19-18745a4750a9 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:49:59.482006 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6eb164e7-0146-446c-ae19-18745a4750a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:49:59.558910 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 604/1187] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:49:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:49:59.583076 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7742a-81ec-49d4-8658-c15439888002 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:59.669926 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:59.696853 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7742a-81ec-49d4-8658-c15439888002 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:59.734106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4bcbc-a1e0-457d-86c4-b9a446d71841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:59.734832 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4bcbc-a1e0-457d-86c4-b9a446d71841 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:59.735110 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4bcbc-a1e0-457d-86c4-b9a446d71841 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:59.735380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4bcbc-a1e0-457d-86c4-b9a446d71841 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:59.746366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4bcbc-a1e0-457d-86c4-b9a446d71841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:49:59.753921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-8cb4bcbc-a1e0-457d-86c4-b9a446d71841 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:49:59.753921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:49:59.753921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:49:59.753921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:49:59.753921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:49:59.753921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:49:59.753921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:49:59.753921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:49:59.753921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:49:59.753921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:49:59.753921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:49:59.753921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:49:59.753921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:49:59.753921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:49:59.753921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:49:59.753921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:49:59.754881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:49:59.754881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:49:59.754881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:49:59.754881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:49:59.754881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:49:59.754881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:49:59.754881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:49:59.754881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:49:59.754881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:49:59.754881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:49:59.754881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:49:59.754881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:49:59.754881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:49:59.754881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:49:59.754881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:49:59.754881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:49:59.755824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:49:59.755824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:49:59.755824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:49:59.755824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:49:59.755824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:49:59.755824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:49:59.755824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:49:59.755824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:49:59.755824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:49:59.755824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:49:59.755824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:49:59.755824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:49:59.755824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 584/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:49:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:49:59.762209 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb164e7-0146-446c-ae19-18745a4750a9 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:49:59.798941 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:49:59.872432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb164e7-0146-446c-ae19-18745a4750a9 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:49:59.908092 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056c4c5-dfdf-4e07-889f-bb11f2d07f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:49:59.908750 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056c4c5-dfdf-4e07-889f-bb11f2d07f96 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:49:59.909029 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056c4c5-dfdf-4e07-889f-bb11f2d07f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:49:59.909302 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056c4c5-dfdf-4e07-889f-bb11f2d07f96 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:49:59.910077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056c4c5-dfdf-4e07-889f-bb11f2d07f96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:49:59.910386 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056c4c5-dfdf-4e07-889f-bb11f2d07f96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:49:59.911760 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056c4c5-dfdf-4e07-889f-bb11f2d07f96 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:49:59.919982 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 605/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:49:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:49:59.926363 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4bcbc-a1e0-457d-86c4-b9a446d71841 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:50:00.063419 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4bcbc-a1e0-457d-86c4-b9a446d71841 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:50:00.099087 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab72f0e-e4c8-444a-a161-41ac4b19cf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:50:00.099956 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab72f0e-e4c8-444a-a161-41ac4b19cf25 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:50:00.100233 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab72f0e-e4c8-444a-a161-41ac4b19cf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:50:00.100500 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab72f0e-e4c8-444a-a161-41ac4b19cf25 None admin] PATH_INFO: `/v3/users/bcd0526261c74eed94ccb694b9d5b203` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:50:00.101836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab72f0e-e4c8-444a-a161-41ac4b19cf25 None admin] RBAC: Authorizing `identity:get_user(user_id=bcd0526261c74eed94ccb694b9d5b203)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:50:00.103281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab72f0e-e4c8-444a-a161-41ac4b19cf25 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:50:00.104947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 585/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:49:59 2022] GET /identity/v3/users/bcd0526261c74eed94ccb694b9d5b203 => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:50:00.111776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056c4c5-dfdf-4e07-889f-bb11f2d07f96 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:50:00.212754 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:50:00.222937 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056c4c5-dfdf-4e07-889f-bb11f2d07f96 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:50:00.257624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debcad8e-62a1-4b1b-8241-5cdf8caf36e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:50:00.258517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcad8e-62a1-4b1b-8241-5cdf8caf36e1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:50:00.258792 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcad8e-62a1-4b1b-8241-5cdf8caf36e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:50:00.259045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcad8e-62a1-4b1b-8241-5cdf8caf36e1 None admin] PATH_INFO: `/v3/projects/d5cb9e9c1c5b4f81bc6905008f98234b` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:50:00.260770 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debcad8e-62a1-4b1b-8241-5cdf8caf36e1 None admin] RBAC: Authorizing `identity:get_project(project_id=d5cb9e9c1c5b4f81bc6905008f98234b)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:50:00.262244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debcad8e-62a1-4b1b-8241-5cdf8caf36e1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:50:00.263939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 606/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:50:00 2022] GET /identity/v3/projects/d5cb9e9c1c5b4f81bc6905008f98234b => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:50:00.270068 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab72f0e-e4c8-444a-a161-41ac4b19cf25 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:50:00.273079 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:50:00.382068 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab72f0e-e4c8-444a-a161-41ac4b19cf25 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:50:00.417713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae13be5-bcce-4302-89c7-d5b69f102dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:50:00.418638 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae13be5-bcce-4302-89c7-d5b69f102dbf None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:50:00.418915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae13be5-bcce-4302-89c7-d5b69f102dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:50:00.419189 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae13be5-bcce-4302-89c7-d5b69f102dbf None admin] PATH_INFO: `/v3/projects/d5cb9e9c1c5b4f81bc6905008f98234b/users/bcd0526261c74eed94ccb694b9d5b203/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:50:00.421431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae13be5-bcce-4302-89c7-d5b69f102dbf None admin] RBAC: Authorizing `identity:create_grant(project_id=d5cb9e9c1c5b4f81bc6905008f98234b, user_id=bcd0526261c74eed94ccb694b9d5b203, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:50:00.422914 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae13be5-bcce-4302-89c7-d5b69f102dbf None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:50:00.439587 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 586/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:50:00 2022] PUT /identity/v3/projects/d5cb9e9c1c5b4f81bc6905008f98234b/users/bcd0526261c74eed94ccb694b9d5b203/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:50:02.651257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a3b1e-a25a-4e77-8615-d41e563eca66 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:50:02.651821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a3b1e-a25a-4e77-8615-d41e563eca66 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:50:02.651821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a3b1e-a25a-4e77-8615-d41e563eca66 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:50:02.653963 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 607/1193] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:50:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:50:02.662094 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce51a8-5ef7-4a68-97b6-ef2a404af6e0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:50:02.662538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce51a8-5ef7-4a68-97b6-ef2a404af6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:50:02.662644 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce51a8-5ef7-4a68-97b6-ef2a404af6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:50:02.681404 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-64ce51a8-5ef7-4a68-97b6-ef2a404af6e0 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:50:02.682818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-64ce51a8-5ef7-4a68-97b6-ef2a404af6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:50:02.740389 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:50:02.753344 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 587/1194] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:50:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:50:02.777591 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a3b1e-a25a-4e77-8615-d41e563eca66 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:50:02.886337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a3b1e-a25a-4e77-8615-d41e563eca66 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:50:02.924863 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f701f5-afb0-43ce-bae2-dafba67f44f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:50:02.925651 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f701f5-afb0-43ce-bae2-dafba67f44f9 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:50:02.925959 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f701f5-afb0-43ce-bae2-dafba67f44f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:50:02.926231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f701f5-afb0-43ce-bae2-dafba67f44f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:50:02.938019 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f701f5-afb0-43ce-bae2-dafba67f44f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:50:02.945501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-83f701f5-afb0-43ce-bae2-dafba67f44f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:50:02.945501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:50:02.945501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:50:02.945501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:50:02.945501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:50:02.945501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:50:02.945501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:50:02.945501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:50:02.945501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:50:02.945501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:50:02.945501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:50:02.945501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:50:02.945501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:50:02.945501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:50:02.945501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:50:02.945501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:50:02.946560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:50:02.946560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:50:02.946560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:50:02.946560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:50:02.946560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:50:02.946560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:50:02.946560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:50:02.946560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:50:02.946560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:50:02.946560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:50:02.946560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:50:02.946560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:50:02.946560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:50:02.946560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:50:02.946560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:50:02.946560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:50:02.947665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:50:02.947665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:50:02.947665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:50:02.947665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:50:02.947665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:50:02.947665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:50:02.947665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:50:02.947665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:50:02.947665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:50:02.947665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:50:02.947665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:50:02.947665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:50:02.947665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 608/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:50:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:50:02.953113 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce51a8-5ef7-4a68-97b6-ef2a404af6e0 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:50:03.055413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce51a8-5ef7-4a68-97b6-ef2a404af6e0 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:50:03.099177 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cb386-b387-4648-b156-b86b3de258cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:50:03.099840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cb386-b387-4648-b156-b86b3de258cc None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:50:03.100120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cb386-b387-4648-b156-b86b3de258cc None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:50:03.100390 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cb386-b387-4648-b156-b86b3de258cc None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:50:03.101130 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cb386-b387-4648-b156-b86b3de258cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:50:03.101438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cb386-b387-4648-b156-b86b3de258cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:50:03.102845 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cb386-b387-4648-b156-b86b3de258cc None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:50:03.111539 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 588/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:50:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:50:03.120100 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f701f5-afb0-43ce-bae2-dafba67f44f9 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:50:03.140119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:50:03.226733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f701f5-afb0-43ce-bae2-dafba67f44f9 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:50:03.262782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6215f5-c9b1-434d-b5c5-7421f9ee208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:50:03.263645 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6215f5-c9b1-434d-b5c5-7421f9ee208e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:50:03.263917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6215f5-c9b1-434d-b5c5-7421f9ee208e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:50:03.264185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6215f5-c9b1-434d-b5c5-7421f9ee208e None admin] PATH_INFO: `/v3/users/bcd0526261c74eed94ccb694b9d5b203` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:50:03.265444 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6215f5-c9b1-434d-b5c5-7421f9ee208e None admin] RBAC: Authorizing `identity:get_user(user_id=bcd0526261c74eed94ccb694b9d5b203)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:50:03.266905 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6215f5-c9b1-434d-b5c5-7421f9ee208e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:50:03.268542 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 609/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 2 18:50:03 2022] GET /identity/v3/users/bcd0526261c74eed94ccb694b9d5b203 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:50:03.275340 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cb386-b387-4648-b156-b86b3de258cc None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:50:03.337300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:50:03.398619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cb386-b387-4648-b156-b86b3de258cc None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:50:03.436631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32966688-64ac-4ebf-8b1a-c552c137a954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:50:03.437281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32966688-64ac-4ebf-8b1a-c552c137a954 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:50:03.437556 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32966688-64ac-4ebf-8b1a-c552c137a954 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:50:03.437838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32966688-64ac-4ebf-8b1a-c552c137a954 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:50:03.503458 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32966688-64ac-4ebf-8b1a-c552c137a954 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:50:03.504908 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32966688-64ac-4ebf-8b1a-c552c137a954 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:50:03.559101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:50:03.607414 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 589/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:50:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 18:50:03.616617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6215f5-c9b1-434d-b5c5-7421f9ee208e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:50:03.710213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:50:03.727442 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6215f5-c9b1-434d-b5c5-7421f9ee208e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:50:03.762686 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502c55a-b3fe-45dc-919e-407167f49862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:50:03.763542 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502c55a-b3fe-45dc-919e-407167f49862 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:50:03.763821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502c55a-b3fe-45dc-919e-407167f49862 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:50:03.764081 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502c55a-b3fe-45dc-919e-407167f49862 None admin] PATH_INFO: `/v3/projects/d5cb9e9c1c5b4f81bc6905008f98234b` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:50:03.765382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502c55a-b3fe-45dc-919e-407167f49862 None admin] RBAC: Authorizing `identity:get_project(project_id=d5cb9e9c1c5b4f81bc6905008f98234b)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:50:03.766852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502c55a-b3fe-45dc-919e-407167f49862 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:50:03.768529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 610/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 2 18:50:03 2022] GET /identity/v3/projects/d5cb9e9c1c5b4f81bc6905008f98234b => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:50:03.775978 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32966688-64ac-4ebf-8b1a-c552c137a954 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:50:03.893899 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32966688-64ac-4ebf-8b1a-c552c137a954 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:50:03.929586 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87ab49-dfe2-45dd-a6f4-ec055740e4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:50:03.930266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87ab49-dfe2-45dd-a6f4-ec055740e4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:50:03.930542 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87ab49-dfe2-45dd-a6f4-ec055740e4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:50:03.930813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87ab49-dfe2-45dd-a6f4-ec055740e4b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:50:03.931713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87ab49-dfe2-45dd-a6f4-ec055740e4b4 None admin] RBAC: Adding query filter params (role.id=8560bac1acf74dce81ea6a76f751b641, scope.project.id=d5cb9e9c1c5b4f81bc6905008f98234b, user.id=bcd0526261c74eed94ccb694b9d5b203) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:50:03.932022 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87ab49-dfe2-45dd-a6f4-ec055740e4b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:50:03.933457 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87ab49-dfe2-45dd-a6f4-ec055740e4b4 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:50:03.939400 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 590/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:50:03 2022] GET /identity/v3/role_assignments?user.id=bcd0526261c74eed94ccb694b9d5b203&scope.project.id=d5cb9e9c1c5b4f81bc6905008f98234b&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:50:13.757312 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=23 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:50:13.937099 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:05.391744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2d33e-3a2d-49d7-bc66-af9c518a85f0 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:05.391744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2d33e-3a2d-49d7-bc66-af9c518a85f0 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:05.391744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2d33e-3a2d-49d7-bc66-af9c518a85f0 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:05.391744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 611/1201] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:51:05.398129 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713e17a-fc53-4a29-aa93-d8fea8df5d8e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:05.398980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713e17a-fc53-4a29-aa93-d8fea8df5d8e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:05.399305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713e17a-fc53-4a29-aa93-d8fea8df5d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:05.417990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-9713e17a-fc53-4a29-aa93-d8fea8df5d8e None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:51:05.419252 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9713e17a-fc53-4a29-aa93-d8fea8df5d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:51:05.511720 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 591/1202] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:51:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:51:05.538150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2d33e-3a2d-49d7-bc66-af9c518a85f0 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:05.680819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2d33e-3a2d-49d7-bc66-af9c518a85f0 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:05.733374 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499654af-f06e-4d7d-a11b-4603726353e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:05.734697 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499654af-f06e-4d7d-a11b-4603726353e5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:05.735198 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499654af-f06e-4d7d-a11b-4603726353e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:05.735691 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499654af-f06e-4d7d-a11b-4603726353e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:05.747781 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499654af-f06e-4d7d-a11b-4603726353e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:05.749257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499654af-f06e-4d7d-a11b-4603726353e5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:05.767281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-499654af-f06e-4d7d-a11b-4603726353e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:05.767281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:05.767281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:05.767281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:05.767281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:05.767281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:05.767281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:05.767281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:05.767281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:05.767281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:05.767281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:05.767281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:05.767281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:51:05.767281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:51:05.767281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:51:05.768420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:51:05.768420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:05.768420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:05.768420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:05.768420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:05.768420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:05.768420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:05.768420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:05.768420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:05.768420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:05.768420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:05.768420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:05.768420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:05.768420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:05.768420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:05.768420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:05.768420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:05.769925 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:51:05.769925 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:51:05.769925 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:05.769925 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:51:05.769925 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 612/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:05.775411 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713e17a-fc53-4a29-aa93-d8fea8df5d8e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:05.901109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713e17a-fc53-4a29-aa93-d8fea8df5d8e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:05.932826 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:05.940792 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a60172-ce5f-4bfc-94bd-e3b0137d2e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:05.941837 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a60172-ce5f-4bfc-94bd-e3b0137d2e29 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:05.942420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a60172-ce5f-4bfc-94bd-e3b0137d2e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:05.942736 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a60172-ce5f-4bfc-94bd-e3b0137d2e29 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:05.943666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a60172-ce5f-4bfc-94bd-e3b0137d2e29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:05.943965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a60172-ce5f-4bfc-94bd-e3b0137d2e29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:05.945584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a60172-ce5f-4bfc-94bd-e3b0137d2e29 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:05.966830 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 592/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:51:05.968112 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499654af-f06e-4d7d-a11b-4603726353e5 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:06.036295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:06.092935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499654af-f06e-4d7d-a11b-4603726353e5 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:06.149073 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b0233-3cfa-49d9-a9c0-b52797cda721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:06.149759 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b0233-3cfa-49d9-a9c0-b52797cda721 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:06.150126 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b0233-3cfa-49d9-a9c0-b52797cda721 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:06.150398 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b0233-3cfa-49d9-a9c0-b52797cda721 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:06.151117 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b0233-3cfa-49d9-a9c0-b52797cda721 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:06.152557 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b0233-3cfa-49d9-a9c0-b52797cda721 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:06.181994 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 613/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 2 18:51:05 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:51:08.659393 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36203b8f-196c-4664-bccb-f020af12da31 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:08.660030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36203b8f-196c-4664-bccb-f020af12da31 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:08.660030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36203b8f-196c-4664-bccb-f020af12da31 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:08.661818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 593/1206] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:51:08.668271 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc6c71-a0a7-45c9-9725-02e92c5790c8 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:08.668790 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc6c71-a0a7-45c9-9725-02e92c5790c8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:08.668915 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc6c71-a0a7-45c9-9725-02e92c5790c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:08.687573 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-29bc6c71-a0a7-45c9-9725-02e92c5790c8 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:51:08.688896 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-29bc6c71-a0a7-45c9-9725-02e92c5790c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:51:08.772450 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 614/1207] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:51:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:51:08.798138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36203b8f-196c-4664-bccb-f020af12da31 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:08.913214 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36203b8f-196c-4664-bccb-f020af12da31 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:08.949894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971abe7-88d3-4674-81e0-40c7d28a247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:08.950707 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971abe7-88d3-4674-81e0-40c7d28a247f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:08.950991 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971abe7-88d3-4674-81e0-40c7d28a247f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:08.951403 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971abe7-88d3-4674-81e0-40c7d28a247f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:08.964989 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971abe7-88d3-4674-81e0-40c7d28a247f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:51:08.973343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-f971abe7-88d3-4674-81e0-40c7d28a247f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:51:08.973343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:08.973343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:08.973343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:08.973343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:08.973343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:08.973343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:08.973343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:08.973343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:08.973343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:08.973343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:08.973343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:08.973343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:51:08.973343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:51:08.973343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:51:08.973343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:51:08.974535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:51:08.974535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:51:08.974535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:51:08.974535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:51:08.974535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:08.974535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:08.974535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:08.974535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:08.974535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:08.974535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:08.974535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:08.974535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:08.974535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:08.974535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:08.974535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:08.974535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:08.975460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:08.975460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:08.975460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:08.975460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:08.975460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:51:08.975460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:51:08.975460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:51:08.975460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:51:08.975460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:51:08.975460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:51:08.975460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:51:08.975460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:08.975460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 594/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:51:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:08.982182 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc6c71-a0a7-45c9-9725-02e92c5790c8 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:09.028841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:09.101735 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc6c71-a0a7-45c9-9725-02e92c5790c8 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:09.143924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c917765-b91a-46cd-b07b-f1f7cd225ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:09.144607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c917765-b91a-46cd-b07b-f1f7cd225ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:09.144939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c917765-b91a-46cd-b07b-f1f7cd225ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:09.145216 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c917765-b91a-46cd-b07b-f1f7cd225ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:09.146195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c917765-b91a-46cd-b07b-f1f7cd225ad0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:09.146626 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c917765-b91a-46cd-b07b-f1f7cd225ad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:09.148211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c917765-b91a-46cd-b07b-f1f7cd225ad0 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:09.158991 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 615/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:51:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:09.165342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971abe7-88d3-4674-81e0-40c7d28a247f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:09.227055 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:09.292598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971abe7-88d3-4674-81e0-40c7d28a247f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:09.334387 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7f738-ff7e-4139-8f3f-e5856b158bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:09.335323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7f738-ff7e-4139-8f3f-e5856b158bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:09.335616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7f738-ff7e-4139-8f3f-e5856b158bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:09.335938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7f738-ff7e-4139-8f3f-e5856b158bb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:09.346725 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7f738-ff7e-4139-8f3f-e5856b158bb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:09.348316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7f738-ff7e-4139-8f3f-e5856b158bb8 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:09.367903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-34d7f738-ff7e-4139-8f3f-e5856b158bb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:09.367903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:09.367903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:09.367903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:09.367903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:09.367903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:09.367903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:09.367903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:09.367903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:09.367903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:09.367903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:09.367903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:09.367903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:51:09.367903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:51:09.367903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:51:09.369267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:51:09.369267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:09.369267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:09.369267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:09.369267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:09.369267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:09.369267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:09.369267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:09.369267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:09.369267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:09.369267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:09.369267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:09.369267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:09.369267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:09.369267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:09.369267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:09.369267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:09.370599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:51:09.370599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:51:09.370599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:09.370599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:09.370599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 595/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:09.375234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c917765-b91a-46cd-b07b-f1f7cd225ad0 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:09.486348 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:09.492091 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c917765-b91a-46cd-b07b-f1f7cd225ad0 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:09.530585 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c893ef-3b9e-4a10-945a-cb10749a85f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:09.531337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c893ef-3b9e-4a10-945a-cb10749a85f2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:09.531614 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c893ef-3b9e-4a10-945a-cb10749a85f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:09.531939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c893ef-3b9e-4a10-945a-cb10749a85f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:09.532703 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c893ef-3b9e-4a10-945a-cb10749a85f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:09.533001 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c893ef-3b9e-4a10-945a-cb10749a85f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:09.534526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c893ef-3b9e-4a10-945a-cb10749a85f2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:09.548449 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 616/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:09.554218 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7f738-ff7e-4139-8f3f-e5856b158bb8 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:09.665590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7f738-ff7e-4139-8f3f-e5856b158bb8 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:09.667263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:09.702895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989198f5-0e9d-413b-8052-2d0512d4d0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:09.703762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989198f5-0e9d-413b-8052-2d0512d4d0aa None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:09.704061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989198f5-0e9d-413b-8052-2d0512d4d0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:09.704330 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989198f5-0e9d-413b-8052-2d0512d4d0aa None admin] PATH_INFO: `/v3/users/placement` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:09.714083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989198f5-0e9d-413b-8052-2d0512d4d0aa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:09.715640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989198f5-0e9d-413b-8052-2d0512d4d0aa None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:09.732293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-989198f5-0e9d-413b-8052-2d0512d4d0aa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 18:51:09.732293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:09.732293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:09.732293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:09.732293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:09.732293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:09.732293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:09.732293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:09.732293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:09.732293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:09.732293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:09.732293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:09.732293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:51:09.732293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:51:09.732293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:51:09.732293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:51:09.733609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:09.733609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:09.733609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:51:09.733609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:51:09.733609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:51:09.733609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:51:09.733609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:09.733609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:09.733609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:09.733609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:09.733609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:09.733609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:09.733609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:09.733609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:09.733609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:09.733609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:09.733609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:09.733609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:09.734784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:09.734784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:09.734784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:51:09.734784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:51:09.734784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:51:09.734784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:51:09.734784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:51:09.734784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:51:09.734784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 18:51:09.734784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:09.734784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 596/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:51:09.740086 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c893ef-3b9e-4a10-945a-cb10749a85f2 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:09.866151 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c893ef-3b9e-4a10-945a-cb10749a85f2 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:09.908734 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdf75d-0bec-4b73-ace6-0e8786d7cf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:09.909432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdf75d-0bec-4b73-ace6-0e8786d7cf02 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:09.909722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdf75d-0bec-4b73-ace6-0e8786d7cf02 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:09.910025 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdf75d-0bec-4b73-ace6-0e8786d7cf02 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:09.911086 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdf75d-0bec-4b73-ace6-0e8786d7cf02 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:09.911440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdf75d-0bec-4b73-ace6-0e8786d7cf02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:09.913135 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdf75d-0bec-4b73-ace6-0e8786d7cf02 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:09.934665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 617/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Jun 2 18:51:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:09.940926 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989198f5-0e9d-413b-8052-2d0512d4d0aa None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:10.067064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989198f5-0e9d-413b-8052-2d0512d4d0aa None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:10.111180 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712ab51-53e5-405f-b020-39b81a9b7210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:10.111850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712ab51-53e5-405f-b020-39b81a9b7210 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:10.112131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712ab51-53e5-405f-b020-39b81a9b7210 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:10.112412 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712ab51-53e5-405f-b020-39b81a9b7210 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:10.147749 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:10.191962 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712ab51-53e5-405f-b020-39b81a9b7210 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:10.193455 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712ab51-53e5-405f-b020-39b81a9b7210 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:10.306814 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 597/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:51:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 18:51:10.310666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdf75d-0bec-4b73-ace6-0e8786d7cf02 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:10.332113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:10.419842 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdf75d-0bec-4b73-ace6-0e8786d7cf02 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:10.456665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce823dc-d38e-4196-946e-bb146a1a1299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:10.457634 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce823dc-d38e-4196-946e-bb146a1a1299 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:10.457768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce823dc-d38e-4196-946e-bb146a1a1299 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:10.458117 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce823dc-d38e-4196-946e-bb146a1a1299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:10.468813 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce823dc-d38e-4196-946e-bb146a1a1299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:10.470326 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce823dc-d38e-4196-946e-bb146a1a1299 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:10.488692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-9ce823dc-d38e-4196-946e-bb146a1a1299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:10.488692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:10.488692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:10.488692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:10.488692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:10.488692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:10.488692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:10.488692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:10.488692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:10.488692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:10.488692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:10.488692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:10.488692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:51:10.488692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:51:10.488692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:51:10.489738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:51:10.489738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:10.489738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:10.489738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:10.489738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:10.489738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:10.489738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:10.489738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:10.489738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:10.489738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:10.489738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:10.489738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:10.489738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:10.489738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:10.489738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:10.489738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:10.489738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:10.496149 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:51:10.496149 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:51:10.496149 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:10.496149 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:51:10.496149 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 618/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:51:10.496446 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712ab51-53e5-405f-b020-39b81a9b7210 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:10.566915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:10.615709 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712ab51-53e5-405f-b020-39b81a9b7210 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:10.657451 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c3fb2-0352-4637-9431-f40c44fc4e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:10.658156 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c3fb2-0352-4637-9431-f40c44fc4e08 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:10.658433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c3fb2-0352-4637-9431-f40c44fc4e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:10.658701 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c3fb2-0352-4637-9431-f40c44fc4e08 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:10.659418 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c3fb2-0352-4637-9431-f40c44fc4e08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:10.659718 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c3fb2-0352-4637-9431-f40c44fc4e08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:10.661114 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c3fb2-0352-4637-9431-f40c44fc4e08 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:10.675517 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 598/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:10.681564 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce823dc-d38e-4196-946e-bb146a1a1299 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:10.763247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:10.809627 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce823dc-d38e-4196-946e-bb146a1a1299 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:10.857068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e577e-0bac-49c8-976e-a1a7d2a6a784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:10.857904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e577e-0bac-49c8-976e-a1a7d2a6a784 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:10.858292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e577e-0bac-49c8-976e-a1a7d2a6a784 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:10.858564 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e577e-0bac-49c8-976e-a1a7d2a6a784 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:10.865910 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e577e-0bac-49c8-976e-a1a7d2a6a784 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:10.867513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e577e-0bac-49c8-976e-a1a7d2a6a784 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:10.882752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-dd4e577e-0bac-49c8-976e-a1a7d2a6a784 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:51:10.882752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:10.882752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:10.882752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:10.882752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:10.882752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:10.882752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:10.882752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:10.882752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:10.882752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:10.882752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:10.882752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:10.882752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:51:10.882752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:51:10.882752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:51:10.883693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:51:10.883693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:10.883693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:10.883693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:10.883693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:10.883693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:10.883693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:10.883693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:10.883693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:10.883693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:10.883693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:10.883693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:10.883693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:10.883693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:10.883693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:10.883693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:10.883693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:10.884667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:51:10.884667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:51:10.884667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:51:10.884667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:51:10.884667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:51:10.884667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:51:10.884667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:51:10.884667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:51:10.884667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 619/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:51:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:10.890615 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c3fb2-0352-4637-9431-f40c44fc4e08 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:11.006923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c3fb2-0352-4637-9431-f40c44fc4e08 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:11.031895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:11.050995 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2efb5-8df9-48a4-a4f5-10c35173df90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:11.051667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2efb5-8df9-48a4-a4f5-10c35173df90 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:11.051938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2efb5-8df9-48a4-a4f5-10c35173df90 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:11.052203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2efb5-8df9-48a4-a4f5-10c35173df90 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:11.052988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2efb5-8df9-48a4-a4f5-10c35173df90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:11.053297 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2efb5-8df9-48a4-a4f5-10c35173df90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:11.055207 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2efb5-8df9-48a4-a4f5-10c35173df90 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:11.069109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 599/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:51:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:11.075655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e577e-0bac-49c8-976e-a1a7d2a6a784 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:11.210617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e577e-0bac-49c8-976e-a1a7d2a6a784 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:11.247712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:11.255387 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb438dc-affd-4c4f-8ba3-b0a307d803dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:11.256150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb438dc-affd-4c4f-8ba3-b0a307d803dd None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:11.256442 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb438dc-affd-4c4f-8ba3-b0a307d803dd None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:11.256778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb438dc-affd-4c4f-8ba3-b0a307d803dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:11.257909 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb438dc-affd-4c4f-8ba3-b0a307d803dd None admin] RBAC: Adding query filter params (role.id=d3525fac5dcc418cbf1bc53ab83dbec6, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=11a4152a82e1486887541afab2d4e5cd) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:11.258305 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb438dc-affd-4c4f-8ba3-b0a307d803dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:11.260115 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb438dc-affd-4c4f-8ba3-b0a307d803dd None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:11.267725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 620/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:51:11 2022] GET /identity/v3/role_assignments?user.id=11a4152a82e1486887541afab2d4e5cd&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=d3525fac5dcc418cbf1bc53ab83dbec6 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:51:13.779568 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b5f5f-65e1-4421-ae1e-aa198556486b None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:13.780174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b5f5f-65e1-4421-ae1e-aa198556486b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:13.780293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b5f5f-65e1-4421-ae1e-aa198556486b None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:13.781640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 600/1220] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:51:13.788234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d62b1-b8a9-4128-a504-b457536843e7 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:13.788893 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d62b1-b8a9-4128-a504-b457536843e7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:13.788893 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d62b1-b8a9-4128-a504-b457536843e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:13.808636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4f2d62b1-b8a9-4128-a504-b457536843e7 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:51:13.810403 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4f2d62b1-b8a9-4128-a504-b457536843e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:51:13.890193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 621/1221] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:51:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:51:13.912935 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b5f5f-65e1-4421-ae1e-aa198556486b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:14.031408 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b5f5f-65e1-4421-ae1e-aa198556486b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:14.069951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb09e91-d1d4-44d7-914f-3847df6db7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:14.070693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb09e91-d1d4-44d7-914f-3847df6db7ad None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:14.070970 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb09e91-d1d4-44d7-914f-3847df6db7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:14.071238 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb09e91-d1d4-44d7-914f-3847df6db7ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:14.083147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb09e91-d1d4-44d7-914f-3847df6db7ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:51:14.091987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-0cb09e91-d1d4-44d7-914f-3847df6db7ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:51:14.091987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:14.091987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:14.091987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:14.091987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:14.091987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:14.091987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:14.091987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:14.091987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:14.091987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:14.091987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:14.091987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:14.091987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:51:14.091987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:51:14.091987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:51:14.091987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:51:14.093049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:51:14.093049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:51:14.093049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:51:14.093049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:51:14.093049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:14.093049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:14.093049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:14.093049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:14.093049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:14.093049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:14.093049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:14.093049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:14.093049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:14.093049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:14.093049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:14.093049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:14.093952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:14.093952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:14.093952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:14.093952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:14.093952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:51:14.093952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:51:14.093952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:51:14.093952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:51:14.093952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:51:14.093952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:51:14.093952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:51:14.093952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:14.093952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 601/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:51:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:14.101291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d62b1-b8a9-4128-a504-b457536843e7 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:14.220899 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d62b1-b8a9-4128-a504-b457536843e7 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:14.251192 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:14.263490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab07c9e-2ff1-43d6-a1df-613b44a00a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:14.264283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab07c9e-2ff1-43d6-a1df-613b44a00a13 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:14.264649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab07c9e-2ff1-43d6-a1df-613b44a00a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:14.264938 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab07c9e-2ff1-43d6-a1df-613b44a00a13 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:14.265689 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab07c9e-2ff1-43d6-a1df-613b44a00a13 None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:14.266047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab07c9e-2ff1-43d6-a1df-613b44a00a13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:14.267819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab07c9e-2ff1-43d6-a1df-613b44a00a13 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:14.279775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 622/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:51:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:14.288341 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb09e91-d1d4-44d7-914f-3847df6db7ad None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:14.339388 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:14.414381 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb09e91-d1d4-44d7-914f-3847df6db7ad None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:14.451182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fd38a-5c74-486d-8fac-b1c3ef5d69e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:14.452053 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fd38a-5c74-486d-8fac-b1c3ef5d69e7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:14.452412 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fd38a-5c74-486d-8fac-b1c3ef5d69e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:14.452668 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fd38a-5c74-486d-8fac-b1c3ef5d69e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:14.468793 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fd38a-5c74-486d-8fac-b1c3ef5d69e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:14.471732 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fd38a-5c74-486d-8fac-b1c3ef5d69e7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:14.493007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-8e6fd38a-5c74-486d-8fac-b1c3ef5d69e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:14.493007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:14.493007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:14.493007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:14.493007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:14.493007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:14.493007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:14.493007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:14.493007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:14.493007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:14.493007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:14.493007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:14.493007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:51:14.493007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:51:14.493007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:51:14.494106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:51:14.494106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:14.494106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:14.494106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:14.494106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:14.494106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:14.494106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:14.494106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:14.494106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:14.494106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:14.494106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:14.494106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:14.494106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:14.494106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:14.494106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:14.494106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:14.494106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:14.495372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:51:14.495372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:51:14.495372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:14.495372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:14.495372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 602/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:51:14.500160 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab07c9e-2ff1-43d6-a1df-613b44a00a13 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:14.607248 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab07c9e-2ff1-43d6-a1df-613b44a00a13 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:14.642989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4feb4-e076-4e8e-a7f7-30ae2288c8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:14.644111 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4feb4-e076-4e8e-a7f7-30ae2288c8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:14.644445 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4feb4-e076-4e8e-a7f7-30ae2288c8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:14.644749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4feb4-e076-4e8e-a7f7-30ae2288c8b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:14.645484 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4feb4-e076-4e8e-a7f7-30ae2288c8b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:14.645786 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4feb4-e076-4e8e-a7f7-30ae2288c8b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:14.647522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4feb4-e076-4e8e-a7f7-30ae2288c8b8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:14.661876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 623/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:14.668558 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fd38a-5c74-486d-8fac-b1c3ef5d69e7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:14.774726 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:14.782777 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fd38a-5c74-486d-8fac-b1c3ef5d69e7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:14.820089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf62a0-1fe9-4976-80b1-7c13f1be886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:14.821002 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf62a0-1fe9-4976-80b1-7c13f1be886c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:14.821302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf62a0-1fe9-4976-80b1-7c13f1be886c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:14.821552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf62a0-1fe9-4976-80b1-7c13f1be886c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:14.830726 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf62a0-1fe9-4976-80b1-7c13f1be886c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:14.832198 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf62a0-1fe9-4976-80b1-7c13f1be886c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:14.846992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-bacf62a0-1fe9-4976-80b1-7c13f1be886c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 18:51:14.846992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:14.846992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:14.846992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:14.846992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:14.846992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:14.846992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:14.846992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:14.846992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:14.846992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:14.846992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:14.846992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:14.846992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:51:14.846992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:51:14.846992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:51:14.846992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:51:14.848173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:14.848173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:14.848173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:51:14.848173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:51:14.848173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:51:14.848173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:51:14.848173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:14.848173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:14.848173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:14.848173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:14.848173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:14.848173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:14.848173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:14.848173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:14.848173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:14.848173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:14.848173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:14.848173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:14.849300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:14.849300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:14.849300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:51:14.849300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:51:14.849300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:51:14.849300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:51:14.849300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:51:14.849300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:51:14.849300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 18:51:14.849300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:14.849300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 603/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:14.854305 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4feb4-e076-4e8e-a7f7-30ae2288c8b8 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:14.909131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:14.965212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4feb4-e076-4e8e-a7f7-30ae2288c8b8 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:15.001291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505be8e-26b9-4c6d-8201-3edd35c2eec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:15.002017 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505be8e-26b9-4c6d-8201-3edd35c2eec4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:15.002302 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505be8e-26b9-4c6d-8201-3edd35c2eec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:15.002574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505be8e-26b9-4c6d-8201-3edd35c2eec4 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:15.003414 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505be8e-26b9-4c6d-8201-3edd35c2eec4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:15.003723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505be8e-26b9-4c6d-8201-3edd35c2eec4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:15.005179 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505be8e-26b9-4c6d-8201-3edd35c2eec4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:15.024012 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 624/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Jun 2 18:51:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:15.029866 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf62a0-1fe9-4976-80b1-7c13f1be886c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:15.134381 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf62a0-1fe9-4976-80b1-7c13f1be886c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:15.173183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff0b10-3d05-44f4-a46b-b7bfec706356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:15.173940 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff0b10-3d05-44f4-a46b-b7bfec706356 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:15.174228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff0b10-3d05-44f4-a46b-b7bfec706356 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:15.174488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff0b10-3d05-44f4-a46b-b7bfec706356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:15.186455 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff0b10-3d05-44f4-a46b-b7bfec706356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:15.187914 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff0b10-3d05-44f4-a46b-b7bfec706356 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:15.205481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-f9ff0b10-3d05-44f4-a46b-b7bfec706356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:15.205481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:15.205481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:15.205481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:15.205481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:15.205481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:15.205481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:15.205481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:15.205481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:15.205481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:15.205481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:15.205481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:15.205481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:51:15.205481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:51:15.205481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:51:15.206617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:51:15.206617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:15.206617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:15.206617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:15.206617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:15.206617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:15.206617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:15.206617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:15.206617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:15.206617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:15.206617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:15.206617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:15.206617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:15.206617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:15.206617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:15.206617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:15.206617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:15.211815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:51:15.211815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:51:15.211815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:15.211815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:15.211815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 604/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:15.212925 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505be8e-26b9-4c6d-8201-3edd35c2eec4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:15.326739 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505be8e-26b9-4c6d-8201-3edd35c2eec4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:15.329103 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:15.362748 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7b9b0-cdea-435d-a142-ab13893f9216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:15.363428 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7b9b0-cdea-435d-a142-ab13893f9216 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:15.363712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7b9b0-cdea-435d-a142-ab13893f9216 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:15.363989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7b9b0-cdea-435d-a142-ab13893f9216 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:15.366320 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7b9b0-cdea-435d-a142-ab13893f9216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:15.366702 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7b9b0-cdea-435d-a142-ab13893f9216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:15.368096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7b9b0-cdea-435d-a142-ab13893f9216 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:15.379930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 625/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:15.385991 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff0b10-3d05-44f4-a46b-b7bfec706356 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:15.396978 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:15.498740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff0b10-3d05-44f4-a46b-b7bfec706356 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:15.550293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01464b03-471d-4a52-91c6-e636e367f223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:15.551537 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01464b03-471d-4a52-91c6-e636e367f223 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:15.551948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01464b03-471d-4a52-91c6-e636e367f223 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:15.552413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01464b03-471d-4a52-91c6-e636e367f223 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:15.562179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01464b03-471d-4a52-91c6-e636e367f223 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:15.564197 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01464b03-471d-4a52-91c6-e636e367f223 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:15.582464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-01464b03-471d-4a52-91c6-e636e367f223 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:51:15.582464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:15.582464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:15.582464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:15.582464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:15.582464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:15.582464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:15.582464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:15.582464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:15.582464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:15.582464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:15.582464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:15.582464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:51:15.582464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:51:15.582464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:51:15.583560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:51:15.583560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:15.583560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:15.583560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:15.583560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:15.583560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:15.583560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:15.583560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:15.583560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:15.583560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:15.583560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:15.583560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:15.583560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:15.583560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:15.583560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:15.583560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:15.583560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:15.584632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:51:15.584632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:51:15.584632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:51:15.584632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:51:15.584632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:51:15.584632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:51:15.584632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:51:15.584632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:15.584632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 605/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:51:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:15.590317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7b9b0-cdea-435d-a142-ab13893f9216 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:15.691360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7b9b0-cdea-435d-a142-ab13893f9216 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:15.726922 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec20872-8cd1-4744-9110-6c3dc2dfb640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:15.727590 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec20872-8cd1-4744-9110-6c3dc2dfb640 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:15.727873 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec20872-8cd1-4744-9110-6c3dc2dfb640 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:15.728138 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec20872-8cd1-4744-9110-6c3dc2dfb640 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:15.728910 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec20872-8cd1-4744-9110-6c3dc2dfb640 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:15.729210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec20872-8cd1-4744-9110-6c3dc2dfb640 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:15.730672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec20872-8cd1-4744-9110-6c3dc2dfb640 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:15.743046 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 626/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:51:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:15.749737 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01464b03-471d-4a52-91c6-e636e367f223 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:15.820976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:15.860804 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01464b03-471d-4a52-91c6-e636e367f223 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:15.899378 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04a553-b3b2-4b84-82d7-8edcee948cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:15.900290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04a553-b3b2-4b84-82d7-8edcee948cd8 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:15.900562 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04a553-b3b2-4b84-82d7-8edcee948cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:15.900838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04a553-b3b2-4b84-82d7-8edcee948cd8 None admin] PATH_INFO: `/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/11a4152a82e1486887541afab2d4e5cd/roles/d3525fac5dcc418cbf1bc53ab83dbec6` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:15.917274 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04a553-b3b2-4b84-82d7-8edcee948cd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a3d8f5b51ff4201b3968c9173ae06a7, user_id=11a4152a82e1486887541afab2d4e5cd, role_id=d3525fac5dcc418cbf1bc53ab83dbec6)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:15.919003 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04a553-b3b2-4b84-82d7-8edcee948cd8 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:15.933609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 606/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:51:15 2022] PUT /identity/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/11a4152a82e1486887541afab2d4e5cd/roles/d3525fac5dcc418cbf1bc53ab83dbec6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:51:18.232444 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b902347-1b99-4c5b-9d52-fecb9aab8439 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:18.233211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b902347-1b99-4c5b-9d52-fecb9aab8439 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:18.233211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b902347-1b99-4c5b-9d52-fecb9aab8439 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:18.234364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 627/1233] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:51:18.239789 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8769f-f4b7-4864-a336-bbda743fe8b7 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:18.240481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8769f-f4b7-4864-a336-bbda743fe8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:18.240481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8769f-f4b7-4864-a336-bbda743fe8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:18.259347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a7f8769f-f4b7-4864-a336-bbda743fe8b7 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:51:18.260627 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a7f8769f-f4b7-4864-a336-bbda743fe8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:51:18.337554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 607/1234] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:51:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:51:18.362386 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b902347-1b99-4c5b-9d52-fecb9aab8439 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:18.393612 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:18.489461 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b902347-1b99-4c5b-9d52-fecb9aab8439 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:18.529240 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e8393-0681-456f-8321-148d3a940f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:18.530451 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e8393-0681-456f-8321-148d3a940f4f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:18.530831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e8393-0681-456f-8321-148d3a940f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:18.531213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e8393-0681-456f-8321-148d3a940f4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:18.543725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e8393-0681-456f-8321-148d3a940f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:51:18.551810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-8f4e8393-0681-456f-8321-148d3a940f4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:51:18.551810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:18.551810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:18.551810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:18.551810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:18.551810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:18.551810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:18.551810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:18.551810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:18.551810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:18.551810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:18.551810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:18.551810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:51:18.551810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:51:18.551810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:51:18.551810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:51:18.552752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:51:18.552752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:51:18.552752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:51:18.552752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:51:18.552752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:18.552752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:18.552752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:18.552752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:18.552752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:18.552752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:18.552752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:18.552752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:18.552752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:18.552752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:18.552752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:18.552752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:18.553818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:18.553818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:18.553818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:18.553818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:18.553818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:51:18.553818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:51:18.553818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:51:18.553818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:51:18.553818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:51:18.553818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:51:18.553818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 18:51:18.553818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:51:18.553818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 628/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 2 18:51:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:18.561091 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8769f-f4b7-4864-a336-bbda743fe8b7 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:18.609592 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:18.671141 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8769f-f4b7-4864-a336-bbda743fe8b7 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:18.708886 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9068a1-496c-4187-b8e0-839592e83fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:18.710225 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9068a1-496c-4187-b8e0-839592e83fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:18.710756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9068a1-496c-4187-b8e0-839592e83fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:18.711077 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9068a1-496c-4187-b8e0-839592e83fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:18.712119 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9068a1-496c-4187-b8e0-839592e83fc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:18.712438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9068a1-496c-4187-b8e0-839592e83fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:18.714502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9068a1-496c-4187-b8e0-839592e83fc9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:18.723522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 608/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 2 18:51:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:18.730620 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e8393-0681-456f-8321-148d3a940f4f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:18.825280 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:18.843535 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e8393-0681-456f-8321-148d3a940f4f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:18.883379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02294f88-82d8-46f2-9da5-020ef6a73cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:18.884185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02294f88-82d8-46f2-9da5-020ef6a73cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:18.884466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02294f88-82d8-46f2-9da5-020ef6a73cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:18.884735 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02294f88-82d8-46f2-9da5-020ef6a73cf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:18.896225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02294f88-82d8-46f2-9da5-020ef6a73cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:18.897745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02294f88-82d8-46f2-9da5-020ef6a73cf6 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:18.915251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-02294f88-82d8-46f2-9da5-020ef6a73cf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:18.915251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:18.915251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:18.915251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:18.915251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:18.915251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:18.915251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:18.915251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:18.915251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:18.915251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:18.915251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:18.915251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:18.915251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:51:18.915251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:51:18.915251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:51:18.916371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:51:18.916371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:18.916371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:18.916371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:18.916371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:18.916371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:18.916371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:18.916371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:18.916371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:18.916371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:18.916371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:18.916371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:18.916371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:18.916371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:18.916371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:18.916371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:18.916371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:18.917865 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:51:18.917865 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:51:18.917865 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:18.917865 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:51:18.917865 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 629/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:18.922344 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9068a1-496c-4187-b8e0-839592e83fc9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:19.033714 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9068a1-496c-4187-b8e0-839592e83fc9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:19.044748 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:19.071896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744292ff-85d9-4f31-a375-85c630dd7841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:19.073175 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744292ff-85d9-4f31-a375-85c630dd7841 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:19.073454 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744292ff-85d9-4f31-a375-85c630dd7841 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:19.073752 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744292ff-85d9-4f31-a375-85c630dd7841 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:19.074611 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744292ff-85d9-4f31-a375-85c630dd7841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:19.075004 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744292ff-85d9-4f31-a375-85c630dd7841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:19.076774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744292ff-85d9-4f31-a375-85c630dd7841 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:19.090402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 609/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:51:19.096429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02294f88-82d8-46f2-9da5-020ef6a73cf6 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:19.203630 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02294f88-82d8-46f2-9da5-020ef6a73cf6 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:19.244118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afacc8-3273-4546-accf-f506acaaeaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:19.244937 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afacc8-3273-4546-accf-f506acaaeaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:19.245211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afacc8-3273-4546-accf-f506acaaeaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:19.245481 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afacc8-3273-4546-accf-f506acaaeaf1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:19.249092 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:19.255311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afacc8-3273-4546-accf-f506acaaeaf1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:19.257103 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afacc8-3273-4546-accf-f506acaaeaf1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:19.274665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-51afacc8-3273-4546-accf-f506acaaeaf1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 18:51:19.274665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:19.274665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:19.274665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:19.274665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:19.274665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:19.274665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:19.274665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:19.274665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:19.274665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:19.274665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:19.274665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:19.274665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:51:19.274665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:51:19.274665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:51:19.274665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:51:19.275752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:19.275752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:19.275752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:51:19.275752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:51:19.275752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:51:19.275752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:51:19.275752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:19.275752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:19.275752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:19.275752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:19.275752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:19.275752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:19.275752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:19.275752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:19.275752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:19.275752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:19.275752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:19.275752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:19.276685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:19.276685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:19.276685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:51:19.276685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:51:19.276685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:51:19.276685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:51:19.276685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:51:19.276685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:51:19.276685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 18:51:19.276685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:51:19.276685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 630/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:19.282516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744292ff-85d9-4f31-a375-85c630dd7841 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:19.398527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744292ff-85d9-4f31-a375-85c630dd7841 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:19.437471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe501f1-50d8-4487-8f7d-ae3565017ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:19.438182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe501f1-50d8-4487-8f7d-ae3565017ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:19.438457 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe501f1-50d8-4487-8f7d-ae3565017ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:19.438727 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe501f1-50d8-4487-8f7d-ae3565017ff2 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:19.439552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe501f1-50d8-4487-8f7d-ae3565017ff2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:19.439927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe501f1-50d8-4487-8f7d-ae3565017ff2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:19.441424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe501f1-50d8-4487-8f7d-ae3565017ff2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:19.461753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 610/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Jun 2 18:51:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:19.468303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afacc8-3273-4546-accf-f506acaaeaf1 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:19.577785 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afacc8-3273-4546-accf-f506acaaeaf1 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:19.617462 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23bc6a-dac6-4f91-a26d-a4596ec56823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:19.618154 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23bc6a-dac6-4f91-a26d-a4596ec56823 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:19.618437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23bc6a-dac6-4f91-a26d-a4596ec56823 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:19.618711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23bc6a-dac6-4f91-a26d-a4596ec56823 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:19.695258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:19.703056 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23bc6a-dac6-4f91-a26d-a4596ec56823 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:19.705130 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23bc6a-dac6-4f91-a26d-a4596ec56823 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:19.813069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 631/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:51:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 18:51:19.819251 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe501f1-50d8-4487-8f7d-ae3565017ff2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:19.847463 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:19.925924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe501f1-50d8-4487-8f7d-ae3565017ff2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:19.963922 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82c619-8dd5-474b-acf4-7769dc39220f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:19.964835 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82c619-8dd5-474b-acf4-7769dc39220f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:19.965154 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82c619-8dd5-474b-acf4-7769dc39220f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:19.965501 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82c619-8dd5-474b-acf4-7769dc39220f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:19.976940 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82c619-8dd5-474b-acf4-7769dc39220f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:19.978582 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82c619-8dd5-474b-acf4-7769dc39220f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:19.997877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-ad82c619-8dd5-474b-acf4-7769dc39220f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:19.997877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:19.997877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:19.997877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:19.997877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:19.997877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:19.997877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:19.997877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:19.997877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:19.997877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:19.997877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:19.997877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:19.997877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:51:19.997877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:51:19.997877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:51:19.999066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:51:19.999066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:19.999066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:19.999066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:19.999066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:19.999066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:19.999066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:19.999066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:19.999066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:19.999066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:19.999066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:19.999066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:19.999066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:19.999066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:19.999066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:19.999066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:19.999066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:20.000178 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:51:20.000178 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:51:20.000178 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:20.000178 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:20.000178 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 611/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:20.005156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23bc6a-dac6-4f91-a26d-a4596ec56823 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:20.103779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:20.110251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23bc6a-dac6-4f91-a26d-a4596ec56823 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:20.146642 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8ffec-f474-4836-bd80-79025c6d5292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:20.147375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8ffec-f474-4836-bd80-79025c6d5292 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:20.147648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8ffec-f474-4836-bd80-79025c6d5292 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:20.147922 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8ffec-f474-4836-bd80-79025c6d5292 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:20.148637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8ffec-f474-4836-bd80-79025c6d5292 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:20.148938 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8ffec-f474-4836-bd80-79025c6d5292 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:20.150538 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8ffec-f474-4836-bd80-79025c6d5292 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:20.162168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 632/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:20.168325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82c619-8dd5-474b-acf4-7769dc39220f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:20.257648 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:20.281965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82c619-8dd5-474b-acf4-7769dc39220f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:20.317377 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036989a-b428-4c5e-9614-0a97f360f607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:20.318344 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036989a-b428-4c5e-9614-0a97f360f607 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:20.318622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036989a-b428-4c5e-9614-0a97f360f607 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:20.318891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036989a-b428-4c5e-9614-0a97f360f607 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:20.325956 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036989a-b428-4c5e-9614-0a97f360f607 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:20.327418 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036989a-b428-4c5e-9614-0a97f360f607 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:20.341915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-a036989a-b428-4c5e-9614-0a97f360f607 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:51:20.341915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:20.341915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:20.341915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:20.341915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:20.341915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:20.341915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:20.341915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:20.341915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:20.341915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:20.341915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:20.341915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:20.341915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:51:20.341915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:51:20.341915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:51:20.342878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:51:20.342878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:20.342878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:20.342878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:20.342878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:20.342878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:20.342878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:20.342878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:20.342878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:20.342878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:20.342878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:20.342878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:20.342878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:20.342878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:20.342878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:20.342878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:20.342878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:20.343798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:51:20.343798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:51:20.343798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:51:20.343798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:51:20.343798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:51:20.343798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:51:20.343798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:51:20.343798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:20.343798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 612/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:51:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:20.349380 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8ffec-f474-4836-bd80-79025c6d5292 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:20.457111 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8ffec-f474-4836-bd80-79025c6d5292 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:20.491259 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d769188-038d-450b-bf51-c83f610a46c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:20.491923 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d769188-038d-450b-bf51-c83f610a46c8 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:20.492258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d769188-038d-450b-bf51-c83f610a46c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:20.492464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d769188-038d-450b-bf51-c83f610a46c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:20.493242 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d769188-038d-450b-bf51-c83f610a46c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:20.493552 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d769188-038d-450b-bf51-c83f610a46c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:20.495034 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d769188-038d-450b-bf51-c83f610a46c8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:20.509434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 633/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:51:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:20.515668 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036989a-b428-4c5e-9614-0a97f360f607 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:20.629333 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036989a-b428-4c5e-9614-0a97f360f607 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:20.666443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d1c63-2963-4f1e-b841-7ef1cee669e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:20.667101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d1c63-2963-4f1e-b841-7ef1cee669e2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:20.667384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d1c63-2963-4f1e-b841-7ef1cee669e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:20.667647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d1c63-2963-4f1e-b841-7ef1cee669e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:20.668469 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d1c63-2963-4f1e-b841-7ef1cee669e2 None admin] RBAC: Adding query filter params (role.id=d3525fac5dcc418cbf1bc53ab83dbec6, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=11a4152a82e1486887541afab2d4e5cd) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:20.668775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d1c63-2963-4f1e-b841-7ef1cee669e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:20.670252 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d1c63-2963-4f1e-b841-7ef1cee669e2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:20.676757 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 613/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:51:20 2022] GET /identity/v3/role_assignments?user.id=11a4152a82e1486887541afab2d4e5cd&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=d3525fac5dcc418cbf1bc53ab83dbec6 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:23.146749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1696ab-6961-4e4c-b96b-6ae649c536e6 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:23.147529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1696ab-6961-4e4c-b96b-6ae649c536e6 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:23.147529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1696ab-6961-4e4c-b96b-6ae649c536e6 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:23.148791 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 634/1247] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:51:23.154433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcddc2-8ff9-4d65-ac0a-bbd85186cf9a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:23.154902 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcddc2-8ff9-4d65-ac0a-bbd85186cf9a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:23.154984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcddc2-8ff9-4d65-ac0a-bbd85186cf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:23.160971 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:23.175361 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-cfdcddc2-8ff9-4d65-ac0a-bbd85186cf9a None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:51:23.176655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-cfdcddc2-8ff9-4d65-ac0a-bbd85186cf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:51:23.254797 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 614/1248] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:51:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:51:23.279503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1696ab-6961-4e4c-b96b-6ae649c536e6 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:23.308463 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:23.401961 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1696ab-6961-4e4c-b96b-6ae649c536e6 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:23.438438 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13662731-5847-40d2-980e-253af6cb1526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:23.439246 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13662731-5847-40d2-980e-253af6cb1526 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:23.439519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13662731-5847-40d2-980e-253af6cb1526 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:23.439799 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13662731-5847-40d2-980e-253af6cb1526 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:23.450264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13662731-5847-40d2-980e-253af6cb1526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:51:23.458184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-13662731-5847-40d2-980e-253af6cb1526 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:51:23.458184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:23.458184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:23.458184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:23.458184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:23.458184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:23.458184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:23.458184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:23.458184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:23.458184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:23.458184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:23.458184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:23.458184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:51:23.458184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:51:23.458184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:51:23.458184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:51:23.459321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:51:23.459321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:51:23.459321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:51:23.459321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:51:23.459321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:23.459321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:23.459321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:23.459321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:23.459321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:23.459321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:23.459321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:23.459321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:23.459321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:23.459321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:23.459321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:23.459321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:23.460811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:23.460811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:23.460811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:23.460811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:23.460811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:51:23.460811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:51:23.460811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:51:23.460811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:51:23.460811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:51:23.460811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:51:23.460811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:51:23.460811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:51:23.460811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 635/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:51:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:23.466480 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcddc2-8ff9-4d65-ac0a-bbd85186cf9a None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:23.579787 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcddc2-8ff9-4d65-ac0a-bbd85186cf9a None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:23.611436 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:23.616933 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f5359-a2f1-4b35-b52c-ee2fb4a16cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:23.617811 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f5359-a2f1-4b35-b52c-ee2fb4a16cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:23.618109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f5359-a2f1-4b35-b52c-ee2fb4a16cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:23.618387 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f5359-a2f1-4b35-b52c-ee2fb4a16cb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:23.619400 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f5359-a2f1-4b35-b52c-ee2fb4a16cb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:23.619747 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f5359-a2f1-4b35-b52c-ee2fb4a16cb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:23.621147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f5359-a2f1-4b35-b52c-ee2fb4a16cb3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:23.630076 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 615/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:51:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:23.636312 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13662731-5847-40d2-980e-253af6cb1526 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:23.721677 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:23.751138 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13662731-5847-40d2-980e-253af6cb1526 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:23.789056 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20042605-eb42-47fd-ad64-46d12554e73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:23.789908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20042605-eb42-47fd-ad64-46d12554e73b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:23.790189 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20042605-eb42-47fd-ad64-46d12554e73b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:23.790460 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20042605-eb42-47fd-ad64-46d12554e73b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:23.803153 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20042605-eb42-47fd-ad64-46d12554e73b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:23.805113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20042605-eb42-47fd-ad64-46d12554e73b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:23.825431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-20042605-eb42-47fd-ad64-46d12554e73b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:23.825431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:23.825431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:23.825431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:23.825431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:23.825431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:23.825431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:23.825431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:23.825431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:23.825431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:23.825431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:23.825431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:23.825431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:51:23.825431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:51:23.825431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:51:23.826454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:51:23.826454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:23.826454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:23.826454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:23.826454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:23.826454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:23.826454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:23.826454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:23.826454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:23.826454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:23.826454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:23.826454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:23.826454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:23.826454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:23.826454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:23.826454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:23.826454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:23.827351 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:51:23.827351 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:51:23.827351 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:23.827351 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:51:23.827351 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 636/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:23.833295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f5359-a2f1-4b35-b52c-ee2fb4a16cb3 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:23.946255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f5359-a2f1-4b35-b52c-ee2fb4a16cb3 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:23.986069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd94fef-9d0e-4951-80f6-ee576dd66f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:23.986754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd94fef-9d0e-4951-80f6-ee576dd66f01 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:23.987137 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd94fef-9d0e-4951-80f6-ee576dd66f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:23.987418 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd94fef-9d0e-4951-80f6-ee576dd66f01 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:23.988279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd94fef-9d0e-4951-80f6-ee576dd66f01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:23.988626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd94fef-9d0e-4951-80f6-ee576dd66f01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:23.990046 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd94fef-9d0e-4951-80f6-ee576dd66f01 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:24.002997 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 616/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:24.009586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20042605-eb42-47fd-ad64-46d12554e73b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:24.118285 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20042605-eb42-47fd-ad64-46d12554e73b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:24.144631 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:24.153627 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497c0a0-1b65-4ced-ab10-ebd1897ef2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:24.154525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497c0a0-1b65-4ced-ab10-ebd1897ef2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:24.154775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497c0a0-1b65-4ced-ab10-ebd1897ef2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:24.155047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497c0a0-1b65-4ced-ab10-ebd1897ef2f8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:24.163969 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497c0a0-1b65-4ced-ab10-ebd1897ef2f8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:24.165426 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497c0a0-1b65-4ced-ab10-ebd1897ef2f8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:24.179889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-c497c0a0-1b65-4ced-ab10-ebd1897ef2f8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 18:51:24.179889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:24.179889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:24.179889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:24.179889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:24.179889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:24.179889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:24.179889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:24.179889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:24.179889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:24.179889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:24.179889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:24.179889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:51:24.179889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:51:24.179889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:51:24.179889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:51:24.181204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:24.181204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:24.181204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:51:24.181204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:51:24.181204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:51:24.181204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:51:24.181204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:24.181204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:24.181204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:24.181204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:24.181204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:24.181204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:24.181204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:24.181204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:24.181204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:24.181204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:24.181204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:24.181204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:24.182379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:24.182379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:24.182379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:51:24.182379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:51:24.182379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:51:24.182379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:51:24.182379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:51:24.182379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:51:24.182379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 18:51:24.182379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:51:24.182379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 637/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:24.187406 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd94fef-9d0e-4951-80f6-ee576dd66f01 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:24.247628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:24.300294 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd94fef-9d0e-4951-80f6-ee576dd66f01 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:24.334335 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8fc18-6e8e-4eb9-9e89-bdd7369b7c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:24.335591 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8fc18-6e8e-4eb9-9e89-bdd7369b7c2e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:24.335915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8fc18-6e8e-4eb9-9e89-bdd7369b7c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:24.336141 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8fc18-6e8e-4eb9-9e89-bdd7369b7c2e None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:24.336982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8fc18-6e8e-4eb9-9e89-bdd7369b7c2e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:24.337292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8fc18-6e8e-4eb9-9e89-bdd7369b7c2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:24.338762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8fc18-6e8e-4eb9-9e89-bdd7369b7c2e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:24.357075 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 617/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Jun 2 18:51:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:24.363248 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497c0a0-1b65-4ced-ab10-ebd1897ef2f8 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:24.482155 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497c0a0-1b65-4ced-ab10-ebd1897ef2f8 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:24.521783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d1f1e-6ef9-4309-8f78-7b40c82d7162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:24.523174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d1f1e-6ef9-4309-8f78-7b40c82d7162 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:24.523460 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d1f1e-6ef9-4309-8f78-7b40c82d7162 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:24.523767 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d1f1e-6ef9-4309-8f78-7b40c82d7162 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:24.584955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:24.598068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d1f1e-6ef9-4309-8f78-7b40c82d7162 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:24.599594 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d1f1e-6ef9-4309-8f78-7b40c82d7162 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:24.706537 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 638/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:51:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 18:51:24.713763 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8fc18-6e8e-4eb9-9e89-bdd7369b7c2e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:24.823266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8fc18-6e8e-4eb9-9e89-bdd7369b7c2e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:24.837455 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:24.864494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980b4e2-00a8-4fdd-b058-f3817756fe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:24.865268 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980b4e2-00a8-4fdd-b058-f3817756fe38 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:24.865546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980b4e2-00a8-4fdd-b058-f3817756fe38 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:24.866021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980b4e2-00a8-4fdd-b058-f3817756fe38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:24.877293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980b4e2-00a8-4fdd-b058-f3817756fe38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:24.878811 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980b4e2-00a8-4fdd-b058-f3817756fe38 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:24.900380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-d980b4e2-00a8-4fdd-b058-f3817756fe38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:24.900380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:24.900380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:24.900380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:24.900380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:24.900380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:24.900380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:24.900380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:24.900380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:24.900380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:24.900380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:24.900380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:24.900380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:51:24.900380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:51:24.900380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:51:24.901512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:51:24.901512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:24.901512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:24.901512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:24.901512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:24.901512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:24.901512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:24.901512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:24.901512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:24.901512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:24.901512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:24.901512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:24.901512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:24.901512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:24.901512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:24.901512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:24.901512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:24.902568 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:51:24.902568 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:51:24.902568 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:24.902568 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:24.902568 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 618/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:24.907642 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d1f1e-6ef9-4309-8f78-7b40c82d7162 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:25.015831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:25.032819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d1f1e-6ef9-4309-8f78-7b40c82d7162 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:25.073973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd024e-7e19-42ad-b82d-cad559309e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:25.074745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd024e-7e19-42ad-b82d-cad559309e93 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:25.075044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd024e-7e19-42ad-b82d-cad559309e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:25.075418 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd024e-7e19-42ad-b82d-cad559309e93 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:25.076334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd024e-7e19-42ad-b82d-cad559309e93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:25.076644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd024e-7e19-42ad-b82d-cad559309e93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:25.078415 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd024e-7e19-42ad-b82d-cad559309e93 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:25.092462 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 639/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:25.099249 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980b4e2-00a8-4fdd-b058-f3817756fe38 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:25.227723 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980b4e2-00a8-4fdd-b058-f3817756fe38 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:25.271300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd56526-8a01-4dd4-81b9-4a5c999f6b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:25.272456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56526-8a01-4dd4-81b9-4a5c999f6b16 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:25.272802 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56526-8a01-4dd4-81b9-4a5c999f6b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:25.273045 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56526-8a01-4dd4-81b9-4a5c999f6b16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:25.281179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd56526-8a01-4dd4-81b9-4a5c999f6b16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:25.282939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd56526-8a01-4dd4-81b9-4a5c999f6b16 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:25.299044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-9cd56526-8a01-4dd4-81b9-4a5c999f6b16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:51:25.299044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:25.299044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:25.299044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:25.299044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:25.299044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:25.299044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:25.299044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:25.299044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:25.299044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:25.299044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:25.299044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:25.299044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:51:25.299044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:51:25.299044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:51:25.300142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:51:25.300142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:25.300142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:25.300142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:25.300142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:25.300142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:25.300142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:25.300142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:25.300142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:25.300142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:25.300142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:25.300142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:25.300142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:25.300142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:25.300142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:25.300142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:25.300142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:25.301202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:51:25.301202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:51:25.301202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:51:25.301202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:51:25.301202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:51:25.301202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:51:25.301202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:51:25.301202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:25.301202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 619/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:51:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:51:25.306888 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd024e-7e19-42ad-b82d-cad559309e93 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:25.418169 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd024e-7e19-42ad-b82d-cad559309e93 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:25.460256 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d226ce-e05a-4dcb-9d0b-7ea466db66fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:25.460954 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d226ce-e05a-4dcb-9d0b-7ea466db66fa None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:25.461259 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d226ce-e05a-4dcb-9d0b-7ea466db66fa None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:25.461532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d226ce-e05a-4dcb-9d0b-7ea466db66fa None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:25.462373 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d226ce-e05a-4dcb-9d0b-7ea466db66fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:25.462721 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d226ce-e05a-4dcb-9d0b-7ea466db66fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:25.464213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d226ce-e05a-4dcb-9d0b-7ea466db66fa None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:25.485463 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 640/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:51:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:25.492537 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd56526-8a01-4dd4-81b9-4a5c999f6b16 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:25.520230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:25.604486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd56526-8a01-4dd4-81b9-4a5c999f6b16 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:25.641467 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11aec1d-6bc9-423b-b79b-856203aa34e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:25.642219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11aec1d-6bc9-423b-b79b-856203aa34e1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:25.642473 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11aec1d-6bc9-423b-b79b-856203aa34e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:25.642758 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11aec1d-6bc9-423b-b79b-856203aa34e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:25.643636 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11aec1d-6bc9-423b-b79b-856203aa34e1 None admin] RBAC: Adding query filter params (role.id=8560bac1acf74dce81ea6a76f751b641, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=11a4152a82e1486887541afab2d4e5cd) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:25.643965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11aec1d-6bc9-423b-b79b-856203aa34e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:25.645479 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11aec1d-6bc9-423b-b79b-856203aa34e1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:25.651849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 620/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:51:25 2022] GET /identity/v3/role_assignments?user.id=11a4152a82e1486887541afab2d4e5cd&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:51:27.889933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189ee63-ee8e-4a04-8393-5d6fe0cade21 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:27.890487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189ee63-ee8e-4a04-8393-5d6fe0cade21 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:27.890487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189ee63-ee8e-4a04-8393-5d6fe0cade21 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:27.891865 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 641/1261] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:51:27.897299 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfb320-f822-4382-aeb8-78fa7e932309 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:27.897732 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfb320-f822-4382-aeb8-78fa7e932309 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:27.897854 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfb320-f822-4382-aeb8-78fa7e932309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:27.916290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-fadfb320-f822-4382-aeb8-78fa7e932309 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:51:27.917457 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-fadfb320-f822-4382-aeb8-78fa7e932309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:51:27.986350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 621/1262] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:51:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:51:28.009700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189ee63-ee8e-4a04-8393-5d6fe0cade21 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:28.027307 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:28.139286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189ee63-ee8e-4a04-8393-5d6fe0cade21 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:28.174156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe6e8c-53f0-4592-a6d9-de13cbe43998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:28.174871 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe6e8c-53f0-4592-a6d9-de13cbe43998 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:28.175144 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe6e8c-53f0-4592-a6d9-de13cbe43998 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:28.175413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe6e8c-53f0-4592-a6d9-de13cbe43998 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:28.186538 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe6e8c-53f0-4592-a6d9-de13cbe43998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:51:28.194237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-b0fe6e8c-53f0-4592-a6d9-de13cbe43998 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:51:28.194237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:28.194237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:28.194237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:28.194237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:28.194237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:28.194237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:28.194237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:28.194237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:28.194237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:28.194237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:28.194237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:28.194237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:51:28.194237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:51:28.194237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:51:28.194237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:51:28.195290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:51:28.195290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:51:28.195290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:51:28.195290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:51:28.195290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:28.195290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:28.195290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:28.195290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:28.195290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:28.195290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:28.195290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:28.195290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:28.195290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:28.195290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:28.195290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:28.195290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:28.196432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:28.196432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:28.196432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:28.196432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:28.196432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:51:28.196432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:51:28.196432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:51:28.196432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:51:28.196432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:51:28.196432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:51:28.196432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:51:28.196432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:51:28.196432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 642/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:51:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:28.201657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfb320-f822-4382-aeb8-78fa7e932309 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:28.221200 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:28.306742 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfb320-f822-4382-aeb8-78fa7e932309 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:28.343818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a08e6-2f80-4ada-abf7-f85ed3389443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:28.344491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a08e6-2f80-4ada-abf7-f85ed3389443 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:28.344771 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a08e6-2f80-4ada-abf7-f85ed3389443 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:28.345046 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a08e6-2f80-4ada-abf7-f85ed3389443 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:28.345815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a08e6-2f80-4ada-abf7-f85ed3389443 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:28.346131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a08e6-2f80-4ada-abf7-f85ed3389443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:28.347545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a08e6-2f80-4ada-abf7-f85ed3389443 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:28.355550 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 622/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:51:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:28.361635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe6e8c-53f0-4592-a6d9-de13cbe43998 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:28.433194 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:28.472526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe6e8c-53f0-4592-a6d9-de13cbe43998 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:28.513836 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83abdb1-8fa9-4c95-8787-7e637d4f048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:28.514656 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83abdb1-8fa9-4c95-8787-7e637d4f048c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:28.514929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83abdb1-8fa9-4c95-8787-7e637d4f048c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:28.515202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83abdb1-8fa9-4c95-8787-7e637d4f048c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:28.527411 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83abdb1-8fa9-4c95-8787-7e637d4f048c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:28.528908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83abdb1-8fa9-4c95-8787-7e637d4f048c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:28.547129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-c83abdb1-8fa9-4c95-8787-7e637d4f048c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:28.547129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:28.547129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:28.547129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:28.547129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:28.547129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:28.547129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:28.547129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:28.547129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:28.547129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:28.547129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:28.547129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:28.547129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:51:28.547129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:51:28.547129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:51:28.548119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:51:28.548119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:28.548119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:28.548119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:28.548119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:28.548119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:28.548119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:28.548119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:28.548119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:28.548119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:28.548119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:28.548119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:28.548119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:28.548119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:28.548119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:28.548119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:28.548119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:28.549045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:51:28.549045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:51:28.549045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:28.549045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:51:28.549045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 643/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 18:51:28.554941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a08e6-2f80-4ada-abf7-f85ed3389443 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:28.649172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:28.675121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a08e6-2f80-4ada-abf7-f85ed3389443 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:28.714459 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4682c3-1ba8-4db3-854e-818932515636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:28.715053 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4682c3-1ba8-4db3-854e-818932515636 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:28.715332 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4682c3-1ba8-4db3-854e-818932515636 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:28.715607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4682c3-1ba8-4db3-854e-818932515636 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:28.716339 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4682c3-1ba8-4db3-854e-818932515636 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:28.716647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4682c3-1ba8-4db3-854e-818932515636 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:28.718069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4682c3-1ba8-4db3-854e-818932515636 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:28.730763 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 623/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:28.736821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83abdb1-8fa9-4c95-8787-7e637d4f048c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:28.856886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83abdb1-8fa9-4c95-8787-7e637d4f048c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:28.877121 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:28.895519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080ba24-239b-4b96-87e1-aebe17156e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:28.896326 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080ba24-239b-4b96-87e1-aebe17156e9a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:28.896601 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080ba24-239b-4b96-87e1-aebe17156e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:28.896865 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080ba24-239b-4b96-87e1-aebe17156e9a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:28.905589 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080ba24-239b-4b96-87e1-aebe17156e9a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:28.907074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080ba24-239b-4b96-87e1-aebe17156e9a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:28.922156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-1080ba24-239b-4b96-87e1-aebe17156e9a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 18:51:28.922156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:28.922156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:28.922156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:28.922156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:28.922156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:28.922156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:28.922156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:28.922156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:28.922156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:28.922156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:28.922156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:28.922156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:51:28.922156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:51:28.922156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:51:28.922156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:51:28.929038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:28.929038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:28.929038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:51:28.929038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:51:28.929038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:51:28.929038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:51:28.929038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:28.929038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:28.929038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:28.929038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:28.929038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:28.929038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:28.929038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:28.929038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:28.929038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:28.929038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:28.929038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:28.929038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:28.930250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:28.930250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:28.930250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:51:28.930250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:51:28.930250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:51:28.930250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:51:28.930250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:51:28.930250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:51:28.930250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 18:51:28.930250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:51:28.930250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 644/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:28.932510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4682c3-1ba8-4db3-854e-818932515636 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:29.038533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4682c3-1ba8-4db3-854e-818932515636 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:29.074086 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88d57b-0d3a-4e6b-8a87-b1d0c039656b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:29.074754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88d57b-0d3a-4e6b-8a87-b1d0c039656b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:29.075028 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88d57b-0d3a-4e6b-8a87-b1d0c039656b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:29.075291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88d57b-0d3a-4e6b-8a87-b1d0c039656b None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:29.076149 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88d57b-0d3a-4e6b-8a87-b1d0c039656b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:29.076442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88d57b-0d3a-4e6b-8a87-b1d0c039656b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:29.077906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88d57b-0d3a-4e6b-8a87-b1d0c039656b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:29.095306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 624/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Jun 2 18:51:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:29.095613 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:29.103707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080ba24-239b-4b96-87e1-aebe17156e9a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:29.206854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080ba24-239b-4b96-87e1-aebe17156e9a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:29.243188 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c18c1f-9395-4eda-badc-42f7d5f80dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:29.244017 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c18c1f-9395-4eda-badc-42f7d5f80dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:29.244273 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c18c1f-9395-4eda-badc-42f7d5f80dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:29.244574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c18c1f-9395-4eda-badc-42f7d5f80dc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:29.257938 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c18c1f-9395-4eda-badc-42f7d5f80dc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:29.259597 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c18c1f-9395-4eda-badc-42f7d5f80dc4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:29.280222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-50c18c1f-9395-4eda-badc-42f7d5f80dc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:29.280222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:29.280222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:29.280222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:29.280222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:29.280222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:29.280222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:29.280222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:29.280222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:29.280222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:29.280222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:29.280222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:29.280222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:51:29.280222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:51:29.280222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:51:29.281536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:51:29.281536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:29.281536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:29.281536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:29.281536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:29.281536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:29.281536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:29.281536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:29.281536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:29.281536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:29.281536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:29.281536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:29.281536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:29.281536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:29.281536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:29.281536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:29.281536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:29.282934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:51:29.282934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:51:29.282934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:29.282934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:51:29.282934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 645/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:29.287451 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88d57b-0d3a-4e6b-8a87-b1d0c039656b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:29.395915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88d57b-0d3a-4e6b-8a87-b1d0c039656b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:29.431609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550965c0-60f2-4d7e-8056-5e7d5b9443fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:29.432269 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550965c0-60f2-4d7e-8056-5e7d5b9443fd None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:29.432522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550965c0-60f2-4d7e-8056-5e7d5b9443fd None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:29.432797 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550965c0-60f2-4d7e-8056-5e7d5b9443fd None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:29.433544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550965c0-60f2-4d7e-8056-5e7d5b9443fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:29.433839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550965c0-60f2-4d7e-8056-5e7d5b9443fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:29.435252 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550965c0-60f2-4d7e-8056-5e7d5b9443fd None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:29.451382 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 625/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:29.457785 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c18c1f-9395-4eda-badc-42f7d5f80dc4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:29.496661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:29.570064 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c18c1f-9395-4eda-badc-42f7d5f80dc4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:29.610319 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e94b19-cbb4-4a5a-abf1-d5775619ad9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:29.611119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e94b19-cbb4-4a5a-abf1-d5775619ad9d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:29.611397 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e94b19-cbb4-4a5a-abf1-d5775619ad9d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:29.611674 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e94b19-cbb4-4a5a-abf1-d5775619ad9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:29.618745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e94b19-cbb4-4a5a-abf1-d5775619ad9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:29.620193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e94b19-cbb4-4a5a-abf1-d5775619ad9d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:29.634742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-70e94b19-cbb4-4a5a-abf1-d5775619ad9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:51:29.634742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:29.634742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:29.634742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:29.634742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:29.634742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:29.634742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:29.634742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:29.634742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:29.634742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:29.634742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:29.634742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:29.634742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:51:29.634742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:51:29.634742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:51:29.635753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:51:29.635753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:29.635753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:29.635753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:29.635753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:29.635753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:29.635753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:29.635753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:29.635753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:29.635753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:29.635753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:29.635753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:29.635753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:29.635753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:29.635753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:29.635753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:29.635753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:29.636724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:51:29.636724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:51:29.636724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:51:29.636724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:51:29.636724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:51:29.636724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:51:29.636724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:51:29.636724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:51:29.636724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 646/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:51:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:29.641966 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550965c0-60f2-4d7e-8056-5e7d5b9443fd None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:29.701148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:29.744459 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550965c0-60f2-4d7e-8056-5e7d5b9443fd None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:29.777444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e281178-9251-4b50-97d9-a62d6aedc713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:29.778131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e281178-9251-4b50-97d9-a62d6aedc713 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:29.778404 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e281178-9251-4b50-97d9-a62d6aedc713 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:29.778669 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e281178-9251-4b50-97d9-a62d6aedc713 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:29.779464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e281178-9251-4b50-97d9-a62d6aedc713 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:29.779767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e281178-9251-4b50-97d9-a62d6aedc713 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:29.781194 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e281178-9251-4b50-97d9-a62d6aedc713 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:29.792833 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 626/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:51:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:29.799728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e94b19-cbb4-4a5a-abf1-d5775619ad9d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:29.905075 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:29.914765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e94b19-cbb4-4a5a-abf1-d5775619ad9d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:29.956975 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3ac6a-6039-40b7-b7f5-98073e930783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:29.957840 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3ac6a-6039-40b7-b7f5-98073e930783 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:29.958122 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3ac6a-6039-40b7-b7f5-98073e930783 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:29.958400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3ac6a-6039-40b7-b7f5-98073e930783 None admin] PATH_INFO: `/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/11a4152a82e1486887541afab2d4e5cd/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:29.960655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3ac6a-6039-40b7-b7f5-98073e930783 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a3d8f5b51ff4201b3968c9173ae06a7, user_id=11a4152a82e1486887541afab2d4e5cd, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:29.962159 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3ac6a-6039-40b7-b7f5-98073e930783 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:29.981370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 647/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 2 18:51:29 2022] PUT /identity/v3/projects/3a3d8f5b51ff4201b3968c9173ae06a7/users/11a4152a82e1486887541afab2d4e5cd/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:51:32.203511 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1ad65-70b7-4d5a-909c-501fecb26818 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:32.204734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1ad65-70b7-4d5a-909c-501fecb26818 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:32.204734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1ad65-70b7-4d5a-909c-501fecb26818 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:32.206936 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 627/1274] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:51:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:51:32.213475 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f991de-225c-4d1e-95d2-dc8de39db5d0 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:32.213938 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f991de-225c-4d1e-95d2-dc8de39db5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:32.214057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f991de-225c-4d1e-95d2-dc8de39db5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:32.232741 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-82f991de-225c-4d1e-95d2-dc8de39db5d0 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:51:32.233974 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-82f991de-225c-4d1e-95d2-dc8de39db5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:51:32.314778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 648/1275] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:51:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:51:32.340655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1ad65-70b7-4d5a-909c-501fecb26818 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:32.457934 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1ad65-70b7-4d5a-909c-501fecb26818 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:32.475742 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:32.496392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9aec74-8749-4277-aa90-60c4676aa39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:32.497183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9aec74-8749-4277-aa90-60c4676aa39d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:32.497462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9aec74-8749-4277-aa90-60c4676aa39d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:32.497729 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9aec74-8749-4277-aa90-60c4676aa39d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:32.509208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9aec74-8749-4277-aa90-60c4676aa39d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 18:51:32.516687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-4a9aec74-8749-4277-aa90-60c4676aa39d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:51:32.516687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:32.516687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:32.516687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:32.516687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:32.516687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:32.516687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:32.516687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:32.516687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:32.516687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:32.516687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:32.516687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:32.516687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 18:51:32.516687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 18:51:32.516687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 18:51:32.516687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 18:51:32.517728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 18:51:32.517728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 18:51:32.517728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 18:51:32.517728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 18:51:32.517728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:32.517728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:32.517728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:32.517728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:32.517728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:32.517728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:32.517728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:32.517728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:32.517728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:32.517728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:32.517728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:32.517728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:32.518618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:32.518618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:32.518618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:32.518618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:32.518618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 18:51:32.518618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 18:51:32.518618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 18:51:32.518618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 18:51:32.518618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 18:51:32.518618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 18:51:32.518618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 18:51:32.518618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:32.518618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 628/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 2 18:51:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:32.524954 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f991de-225c-4d1e-95d2-dc8de39db5d0 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:32.612327 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:32.633609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f991de-225c-4d1e-95d2-dc8de39db5d0 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:32.669458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c4151-aee8-4acf-a512-cc98297a2333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:32.670146 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c4151-aee8-4acf-a512-cc98297a2333 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:32.670426 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c4151-aee8-4acf-a512-cc98297a2333 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:32.670695 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c4151-aee8-4acf-a512-cc98297a2333 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:32.671442 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c4151-aee8-4acf-a512-cc98297a2333 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:32.671749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c4151-aee8-4acf-a512-cc98297a2333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:32.673146 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c4151-aee8-4acf-a512-cc98297a2333 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:32.681718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 649/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 2 18:51:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 18:51:32.687759 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9aec74-8749-4277-aa90-60c4676aa39d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:32.791585 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9aec74-8749-4277-aa90-60c4676aa39d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:32.825848 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758aa6cb-fb4a-4762-8528-45ab1d6c7ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:32.826641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758aa6cb-fb4a-4762-8528-45ab1d6c7ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:32.826920 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758aa6cb-fb4a-4762-8528-45ab1d6c7ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:32.827191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758aa6cb-fb4a-4762-8528-45ab1d6c7ca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:32.837836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758aa6cb-fb4a-4762-8528-45ab1d6c7ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:32.839313 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758aa6cb-fb4a-4762-8528-45ab1d6c7ca9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:32.855867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-758aa6cb-fb4a-4762-8528-45ab1d6c7ca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:32.855867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:32.855867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:32.855867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:32.855867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:32.855867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:32.855867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:32.855867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:32.855867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:32.855867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:32.855867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:32.855867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:32.855867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:51:32.855867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:51:32.855867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:51:32.856879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:51:32.856879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:32.856879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:32.856879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:32.856879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:32.856879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:32.856879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:32.856879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:32.856879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:32.856879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:32.856879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:32.856879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:32.856879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:32.856879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:32.856879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:32.856879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:32.856879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:32.857851 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:51:32.857851 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:51:32.857851 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:32.857851 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:32.857851 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 629/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:32.863459 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c4151-aee8-4acf-a512-cc98297a2333 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:32.983526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c4151-aee8-4acf-a512-cc98297a2333 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:33.018408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d23ab0-4bbd-4645-b34f-43facc551f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:33.019074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d23ab0-4bbd-4645-b34f-43facc551f98 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:33.019350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d23ab0-4bbd-4645-b34f-43facc551f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:33.019626 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d23ab0-4bbd-4645-b34f-43facc551f98 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:33.020339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d23ab0-4bbd-4645-b34f-43facc551f98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:33.020643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d23ab0-4bbd-4645-b34f-43facc551f98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:33.022097 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d23ab0-4bbd-4645-b34f-43facc551f98 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:33.035207 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 650/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:33.041242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758aa6cb-fb4a-4762-8528-45ab1d6c7ca9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:33.074246 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:33.148547 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758aa6cb-fb4a-4762-8528-45ab1d6c7ca9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:33.183486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76253bab-0e3c-4a39-8d0c-d14484620562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:33.184281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76253bab-0e3c-4a39-8d0c-d14484620562 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:33.184564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76253bab-0e3c-4a39-8d0c-d14484620562 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:33.184834 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76253bab-0e3c-4a39-8d0c-d14484620562 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:33.195081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76253bab-0e3c-4a39-8d0c-d14484620562 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:33.196529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76253bab-0e3c-4a39-8d0c-d14484620562 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:33.211667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-76253bab-0e3c-4a39-8d0c-d14484620562 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 18:51:33.211667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:33.211667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:33.211667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:33.211667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:33.211667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:33.211667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:33.211667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:33.211667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:33.211667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:33.211667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:33.211667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:33.211667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 18:51:33.211667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 18:51:33.211667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 18:51:33.211667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 18:51:33.213219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:33.213219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:33.213219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 18:51:33.213219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:51:33.213219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 18:51:33.213219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 18:51:33.213219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:33.213219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:33.213219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:33.213219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:33.213219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:33.213219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:33.213219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:33.213219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:33.213219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:33.213219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:33.213219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:33.213219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:33.214402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:33.214402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:33.214402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 18:51:33.214402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 18:51:33.214402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 18:51:33.214402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 18:51:33.214402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 18:51:33.214402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 18:51:33.214402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 18:51:33.214402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:33.214402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 630/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:33.220175 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d23ab0-4bbd-4645-b34f-43facc551f98 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:33.224405 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:33.325357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d23ab0-4bbd-4645-b34f-43facc551f98 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:33.359931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7d900-6a7b-4218-ac95-dc9b01f21233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:33.360598 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7d900-6a7b-4218-ac95-dc9b01f21233 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:33.360871 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7d900-6a7b-4218-ac95-dc9b01f21233 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:33.361138 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7d900-6a7b-4218-ac95-dc9b01f21233 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:33.361998 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7d900-6a7b-4218-ac95-dc9b01f21233 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:33.362301 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7d900-6a7b-4218-ac95-dc9b01f21233 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:33.363732 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7d900-6a7b-4218-ac95-dc9b01f21233 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:33.380723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 651/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Jun 2 18:51:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:33.389386 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76253bab-0e3c-4a39-8d0c-d14484620562 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:33.486616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:33.497943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76253bab-0e3c-4a39-8d0c-d14484620562 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:33.536578 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48199f-b9d1-4dd4-92a3-53d954a0d37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:33.537515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48199f-b9d1-4dd4-92a3-53d954a0d37f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:33.537821 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48199f-b9d1-4dd4-92a3-53d954a0d37f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:33.538154 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48199f-b9d1-4dd4-92a3-53d954a0d37f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:33.618208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48199f-b9d1-4dd4-92a3-53d954a0d37f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:33.619591 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48199f-b9d1-4dd4-92a3-53d954a0d37f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:33.711834 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:33.723127 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 631/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 2 18:51:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 18:51:33.729270 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7d900-6a7b-4218-ac95-dc9b01f21233 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:33.799510 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:33.839579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7d900-6a7b-4218-ac95-dc9b01f21233 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:33.875221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe09b20-0519-4747-b722-7d06d2febbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:33.875948 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe09b20-0519-4747-b722-7d06d2febbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:33.876224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe09b20-0519-4747-b722-7d06d2febbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:33.876492 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe09b20-0519-4747-b722-7d06d2febbd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:33.887386 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe09b20-0519-4747-b722-7d06d2febbd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:33.888853 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe09b20-0519-4747-b722-7d06d2febbd0 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:33.906649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-dfe09b20-0519-4747-b722-7d06d2febbd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:33.906649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:33.906649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:33.906649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:33.906649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:33.906649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:33.906649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:33.906649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:33.906649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:33.906649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:33.906649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:33.906649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:33.906649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 18:51:33.906649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 18:51:33.906649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 18:51:33.907657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 18:51:33.907657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:33.907657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:33.907657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:33.907657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:33.907657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:33.907657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:33.907657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:33.907657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:33.907657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:33.907657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:33.907657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:33.907657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:33.907657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:33.907657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:33.907657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:33.907657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:33.909269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 18:51:33.909269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 18:51:33.909269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 18:51:33.909269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:51:33.909269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 652/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:33.915319 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48199f-b9d1-4dd4-92a3-53d954a0d37f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:34.025107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48199f-b9d1-4dd4-92a3-53d954a0d37f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:34.060986 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1fefd-a4ce-434e-b8ac-4dc02d1245a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:34.061631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1fefd-a4ce-434e-b8ac-4dc02d1245a4 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:34.061931 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1fefd-a4ce-434e-b8ac-4dc02d1245a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:34.062196 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1fefd-a4ce-434e-b8ac-4dc02d1245a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:34.062904 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1fefd-a4ce-434e-b8ac-4dc02d1245a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:34.063203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1fefd-a4ce-434e-b8ac-4dc02d1245a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:34.064559 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1fefd-a4ce-434e-b8ac-4dc02d1245a4 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:34.075891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 632/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 2 18:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:34.082052 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe09b20-0519-4747-b722-7d06d2febbd0 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:34.193273 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe09b20-0519-4747-b722-7d06d2febbd0 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:34.208337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:34.234495 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0a636-3702-48d2-b43f-8cb19ef9ca66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:34.235350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0a636-3702-48d2-b43f-8cb19ef9ca66 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:34.235722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0a636-3702-48d2-b43f-8cb19ef9ca66 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:34.236091 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0a636-3702-48d2-b43f-8cb19ef9ca66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:34.245193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0a636-3702-48d2-b43f-8cb19ef9ca66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:34.246779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0a636-3702-48d2-b43f-8cb19ef9ca66 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:34.262447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-b7a0a636-3702-48d2-b43f-8cb19ef9ca66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:51:34.262447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:34.262447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:34.262447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:34.262447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:34.262447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:34.262447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:34.262447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:34.262447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:34.262447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:34.262447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:34.262447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:34.262447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 18:51:34.262447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 18:51:34.262447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 18:51:34.263758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 18:51:34.263758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:34.263758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:34.263758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:34.263758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:34.263758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:34.263758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:34.263758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:34.263758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:34.263758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:34.263758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:34.263758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:34.263758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:34.263758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:34.263758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:34.263758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:34.263758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:34.264665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 18:51:34.264665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 18:51:34.264665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 18:51:34.264665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 18:51:34.264665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 18:51:34.264665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 18:51:34.264665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 18:51:34.264665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 18:51:34.264665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 653/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 2 18:51:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:34.269984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1fefd-a4ce-434e-b8ac-4dc02d1245a4 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:34.327894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:34.385094 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1fefd-a4ce-434e-b8ac-4dc02d1245a4 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:34.419066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27662be6-9c37-4e2d-9679-68e9c7d742a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:34.419719 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27662be6-9c37-4e2d-9679-68e9c7d742a0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:34.419992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27662be6-9c37-4e2d-9679-68e9c7d742a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:34.420257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27662be6-9c37-4e2d-9679-68e9c7d742a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:34.421035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27662be6-9c37-4e2d-9679-68e9c7d742a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:34.421339 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27662be6-9c37-4e2d-9679-68e9c7d742a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:34.422803 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27662be6-9c37-4e2d-9679-68e9c7d742a0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:34.442307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 633/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 2 18:51:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:34.449516 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0a636-3702-48d2-b43f-8cb19ef9ca66 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:34.561861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0a636-3702-48d2-b43f-8cb19ef9ca66 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:34.598411 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afb42a-4f5f-4d4f-8e78-1ed7170ccae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:34.599063 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afb42a-4f5f-4d4f-8e78-1ed7170ccae5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:34.599340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afb42a-4f5f-4d4f-8e78-1ed7170ccae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:34.599611 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afb42a-4f5f-4d4f-8e78-1ed7170ccae5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:34.600538 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afb42a-4f5f-4d4f-8e78-1ed7170ccae5 None admin] RBAC: Adding query filter params (role.id=8560bac1acf74dce81ea6a76f751b641, scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7, user.id=11a4152a82e1486887541afab2d4e5cd) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:34.600874 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afb42a-4f5f-4d4f-8e78-1ed7170ccae5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:34.602394 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afb42a-4f5f-4d4f-8e78-1ed7170ccae5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:34.608303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 654/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 2 18:51:34 2022] GET /identity/v3/role_assignments?user.id=11a4152a82e1486887541afab2d4e5cd&scope.project.id=3a3d8f5b51ff4201b3968c9173ae06a7&role.id=8560bac1acf74dce81ea6a76f751b641 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:36.867718 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caf06e-6c6c-4c6e-ad05-eb42370ea47f None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:36.868565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caf06e-6c6c-4c6e-ad05-eb42370ea47f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:36.868565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caf06e-6c6c-4c6e-ad05-eb42370ea47f None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:36.870771 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 634/1288] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:51:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:51:36.877182 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfb6cd-6453-48bd-b6b5-43940dbac24f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:36.877929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfb6cd-6453-48bd-b6b5-43940dbac24f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:36.878107 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfb6cd-6453-48bd-b6b5-43940dbac24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:36.897130 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-67dfb6cd-6453-48bd-b6b5-43940dbac24f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:51:36.898348 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-67dfb6cd-6453-48bd-b6b5-43940dbac24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:51:36.929289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:36.975443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 655/1289] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:51:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:51:37.011506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24caf06e-6c6c-4c6e-ad05-eb42370ea47f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:37.135691 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24caf06e-6c6c-4c6e-ad05-eb42370ea47f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:37.146816 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:37.173963 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020bd33-3d1b-41e3-b71e-3f7cb6710eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:37.174764 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020bd33-3d1b-41e3-b71e-3f7cb6710eeb None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:37.175038 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020bd33-3d1b-41e3-b71e-3f7cb6710eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:37.175317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020bd33-3d1b-41e3-b71e-3f7cb6710eeb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:37.175960 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020bd33-3d1b-41e3-b71e-3f7cb6710eeb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:37.177332 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020bd33-3d1b-41e3-b71e-3f7cb6710eeb None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:37.189445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-f020bd33-3d1b-41e3-b71e-3f7cb6710eeb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 18:51:37.189445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:37.189445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:51:37.189445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:51:37.189445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:51:37.189445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:51:37.189445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:51:37.189445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:51:37.189445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 18:51:37.189445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:37.189445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:51:37.189445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:37.189445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:37.189445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:37.189445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:37.189445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:37.189445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:37.190609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:37.190609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:37.190609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:37.190609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:37.190609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:37.190609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:37.190609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:51:37.190609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:51:37.190609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:51:37.190609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:51:37.190609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:37.190609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:37.190609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:37.190609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:37.190609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:37.190609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:37.191631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:37.191631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:37.191631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:37.191631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:37.191631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:37.191631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:37.191631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:37.191631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:37.191631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:37.191631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:37.191631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:51:37.191631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:51:37.191631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 18:51:37.191631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:37.191631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 635/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 2 18:51:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:37.197582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfb6cd-6453-48bd-b6b5-43940dbac24f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:37.310760 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfb6cd-6453-48bd-b6b5-43940dbac24f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:37.351157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfad05e-4a1b-4391-8258-ad5cd3b7807b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:37.351867 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfad05e-4a1b-4391-8258-ad5cd3b7807b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:37.352150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfad05e-4a1b-4391-8258-ad5cd3b7807b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:37.352421 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfad05e-4a1b-4391-8258-ad5cd3b7807b None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:37.353125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfad05e-4a1b-4391-8258-ad5cd3b7807b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:37.353434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfad05e-4a1b-4391-8258-ad5cd3b7807b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:37.354854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfad05e-4a1b-4391-8258-ad5cd3b7807b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:37.359994 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 656/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Jun 2 18:51:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:37.366363 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020bd33-3d1b-41e3-b71e-3f7cb6710eeb None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:37.469206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020bd33-3d1b-41e3-b71e-3f7cb6710eeb None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:37.504612 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334cc02-5f1b-44d3-907b-9b37783e54a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:37.505262 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334cc02-5f1b-44d3-907b-9b37783e54a5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:37.505539 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334cc02-5f1b-44d3-907b-9b37783e54a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:37.505838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334cc02-5f1b-44d3-907b-9b37783e54a5 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:37.506609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334cc02-5f1b-44d3-907b-9b37783e54a5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:37.506914 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334cc02-5f1b-44d3-907b-9b37783e54a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:37.508286 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334cc02-5f1b-44d3-907b-9b37783e54a5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:37.513035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 636/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Jun 2 18:51:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:39.741626 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85287ca-b7bb-44ff-a8cc-d687b5198582 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:39.742639 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85287ca-b7bb-44ff-a8cc-d687b5198582 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:39.742639 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85287ca-b7bb-44ff-a8cc-d687b5198582 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:39.744779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 657/1293] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:51:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:51:39.750253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10aec76-d7da-4d11-96a1-de6d165493cb None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:39.750703 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10aec76-d7da-4d11-96a1-de6d165493cb None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:39.750801 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10aec76-d7da-4d11-96a1-de6d165493cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:39.769465 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-c10aec76-d7da-4d11-96a1-de6d165493cb None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:51:39.770700 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c10aec76-d7da-4d11-96a1-de6d165493cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:51:39.800274 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:39.842608 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 637/1294] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:51:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:51:39.871795 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85287ca-b7bb-44ff-a8cc-d687b5198582 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:39.911610 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:39.983490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85287ca-b7bb-44ff-a8cc-d687b5198582 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:40.020027 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686c05c-61bc-478b-b4ea-6a8e3b8b150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:40.020681 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686c05c-61bc-478b-b4ea-6a8e3b8b150f None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:40.020961 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686c05c-61bc-478b-b4ea-6a8e3b8b150f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:40.021228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686c05c-61bc-478b-b4ea-6a8e3b8b150f None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:40.022021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686c05c-61bc-478b-b4ea-6a8e3b8b150f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:40.023389 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686c05c-61bc-478b-b4ea-6a8e3b8b150f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:40.040626 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 658/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 2 18:51:39 2022] POST /identity/v3/services => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:51:42.271343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834eb55-a00e-4a34-9dbd-8c9c8aa5b9ca None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:42.272177 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834eb55-a00e-4a34-9dbd-8c9c8aa5b9ca None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:42.272177 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834eb55-a00e-4a34-9dbd-8c9c8aa5b9ca None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:42.274006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 638/1296] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:51:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:51:42.283021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0f9e3-e06e-4808-ab51-9de041fbc569 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:42.283494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0f9e3-e06e-4808-ab51-9de041fbc569 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:42.283607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0f9e3-e06e-4808-ab51-9de041fbc569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:42.304079 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a5a0f9e3-e06e-4808-ab51-9de041fbc569 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:51:42.305504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a5a0f9e3-e06e-4808-ab51-9de041fbc569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:51:42.393818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 659/1297] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:51:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 18:51:42.425060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834eb55-a00e-4a34-9dbd-8c9c8aa5b9ca None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:42.531508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834eb55-a00e-4a34-9dbd-8c9c8aa5b9ca None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:42.570297 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182d2a8-1cc9-425b-a46c-b2facd36fac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:42.571097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182d2a8-1cc9-425b-a46c-b2facd36fac9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:42.571372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182d2a8-1cc9-425b-a46c-b2facd36fac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:42.571639 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182d2a8-1cc9-425b-a46c-b2facd36fac9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:42.572342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182d2a8-1cc9-425b-a46c-b2facd36fac9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:42.573724 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182d2a8-1cc9-425b-a46c-b2facd36fac9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:42.586351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-a182d2a8-1cc9-425b-a46c-b2facd36fac9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 18:51:42.586351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:42.586351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:51:42.586351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:51:42.586351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:51:42.586351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:51:42.586351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:51:42.586351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:51:42.586351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 18:51:42.586351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:42.586351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:51:42.586351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:42.586351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:42.586351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:42.586351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:42.586351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:42.586351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:42.587565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:42.587565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:42.587565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:42.587565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:42.587565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:42.587565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:42.587565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:51:42.587565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:51:42.587565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:51:42.587565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:51:42.587565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:42.587565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:42.587565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:42.587565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:42.587565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:42.587565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:42.588769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:42.588769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:42.588769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:42.588769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:42.588769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:42.588769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:42.588769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:42.588769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:42.588769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:42.588769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:42.588769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:51:42.588769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:51:42.588769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 18:51:42.588769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:42.589985 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 639/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 2 18:51:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:42.593725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0f9e3-e06e-4808-ab51-9de041fbc569 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:42.614378 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:42.706433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0f9e3-e06e-4808-ab51-9de041fbc569 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:42.742990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330100f1-1cf3-4edc-9c31-197023624558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:42.743650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330100f1-1cf3-4edc-9c31-197023624558 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:42.743938 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330100f1-1cf3-4edc-9c31-197023624558 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:42.744202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330100f1-1cf3-4edc-9c31-197023624558 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:42.744913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330100f1-1cf3-4edc-9c31-197023624558 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:42.745229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330100f1-1cf3-4edc-9c31-197023624558 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:42.746648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330100f1-1cf3-4edc-9c31-197023624558 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:42.752320 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 660/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Jun 2 18:51:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:42.758697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182d2a8-1cc9-425b-a46c-b2facd36fac9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:42.795186 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:42.869555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182d2a8-1cc9-425b-a46c-b2facd36fac9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:42.903605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfa526-509f-48d3-b755-2c2fa99aae9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:42.904260 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfa526-509f-48d3-b755-2c2fa99aae9f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:42.904542 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfa526-509f-48d3-b755-2c2fa99aae9f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:42.904813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfa526-509f-48d3-b755-2c2fa99aae9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:42.905605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfa526-509f-48d3-b755-2c2fa99aae9f None admin] RBAC: Adding query filter params (interface=public, service_id=2272e387a9ef4467a6758e259959f462, region_id=RegionOne) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:42.905950 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfa526-509f-48d3-b755-2c2fa99aae9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:42.907344 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfa526-509f-48d3-b755-2c2fa99aae9f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:42.912656 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 640/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jun 2 18:51:42 2022] GET /identity/v3/endpoints?service_id=2272e387a9ef4467a6758e259959f462&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:42.919071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330100f1-1cf3-4edc-9c31-197023624558 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:43.006317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:43.027024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330100f1-1cf3-4edc-9c31-197023624558 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:43.064071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399f21a-13b2-4f01-9949-50049ff74d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:43.064659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399f21a-13b2-4f01-9949-50049ff74d50 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:43.064933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399f21a-13b2-4f01-9949-50049ff74d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:43.065204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399f21a-13b2-4f01-9949-50049ff74d50 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:43.065966 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399f21a-13b2-4f01-9949-50049ff74d50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:43.067820 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399f21a-13b2-4f01-9949-50049ff74d50 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:43.075696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 661/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jun 2 18:51:42 2022] GET /identity/v3/services => generated 2191 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 18:51:45.301072 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f19f38-e940-454b-8b70-3ae7078bd19c None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:45.301640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f19f38-e940-454b-8b70-3ae7078bd19c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:45.301640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f19f38-e940-454b-8b70-3ae7078bd19c None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:45.303041 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 641/1302] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:51:45.309466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a901c5-c3dd-4b35-8ca0-d81e8d90bc0b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:45.310264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a901c5-c3dd-4b35-8ca0-d81e8d90bc0b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:45.310407 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a901c5-c3dd-4b35-8ca0-d81e8d90bc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:45.333368 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-83a901c5-c3dd-4b35-8ca0-d81e8d90bc0b None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:51:45.334590 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-83a901c5-c3dd-4b35-8ca0-d81e8d90bc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:51:45.418027 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 662/1303] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:51:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 18:51:45.441367 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f19f38-e940-454b-8b70-3ae7078bd19c None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:45.542123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:45.549884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f19f38-e940-454b-8b70-3ae7078bd19c None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:45.585334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4459d-6a52-4ae7-9d92-665a85a7bdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:45.586233 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4459d-6a52-4ae7-9d92-665a85a7bdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:45.586492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4459d-6a52-4ae7-9d92-665a85a7bdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:45.586760 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4459d-6a52-4ae7-9d92-665a85a7bdc1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:45.587401 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4459d-6a52-4ae7-9d92-665a85a7bdc1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:45.588774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4459d-6a52-4ae7-9d92-665a85a7bdc1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:45.600516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-1cf4459d-6a52-4ae7-9d92-665a85a7bdc1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 18:51:45.600516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:45.600516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 18:51:45.600516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 18:51:45.600516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 18:51:45.600516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 18:51:45.600516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 18:51:45.600516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:51:45.600516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 18:51:45.600516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:45.600516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 18:51:45.600516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:45.600516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 18:51:45.600516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 18:51:45.600516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 18:51:45.600516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 18:51:45.600516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 18:51:45.601653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 18:51:45.601653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 18:51:45.601653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 18:51:45.601653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 18:51:45.601653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 18:51:45.601653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 18:51:45.601653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 18:51:45.601653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 18:51:45.601653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 18:51:45.601653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 18:51:45.601653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 18:51:45.601653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 18:51:45.601653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 18:51:45.601653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 18:51:45.601653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 18:51:45.601653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 18:51:45.602610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 18:51:45.602610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 02 18:51:45.602610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 18:51:45.602610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 02 18:51:45.602610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 18:51:45.602610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 18:51:45.602610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 18:51:45.602610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 02 18:51:45.602610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 18:51:45.602610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 02 18:51:45.602610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 18:51:45.602610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 18:51:45.602610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 18:51:45.602610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 02 18:51:45.606135 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 642/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 2 18:51:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 18:51:45.608900 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a901c5-c3dd-4b35-8ca0-d81e8d90bc0b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:45.688662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:45.718229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a901c5-c3dd-4b35-8ca0-d81e8d90bc0b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:45.753550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a133d02-8fc7-43eb-9fde-aa7a348b5ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:45.754241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a133d02-8fc7-43eb-9fde-aa7a348b5ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:45.754528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a133d02-8fc7-43eb-9fde-aa7a348b5ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:45.754797 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a133d02-8fc7-43eb-9fde-aa7a348b5ba0 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:45.755494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a133d02-8fc7-43eb-9fde-aa7a348b5ba0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:51:45.755803 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a133d02-8fc7-43eb-9fde-aa7a348b5ba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:45.757185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a133d02-8fc7-43eb-9fde-aa7a348b5ba0 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:45.762592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 663/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Jun 2 18:51:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:51:45.768680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4459d-6a52-4ae7-9d92-665a85a7bdc1 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:51:45.871867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4459d-6a52-4ae7-9d92-665a85a7bdc1 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:51:45.910106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10866a-804f-4c44-83f2-41d5aeb6729c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:51:45.910754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10866a-804f-4c44-83f2-41d5aeb6729c None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:51:45.911034 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10866a-804f-4c44-83f2-41d5aeb6729c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:51:45.911306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10866a-804f-4c44-83f2-41d5aeb6729c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:51:45.912046 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10866a-804f-4c44-83f2-41d5aeb6729c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:51:45.913419 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10866a-804f-4c44-83f2-41d5aeb6729c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:51:45.936135 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 643/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jun 2 18:51:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 18:51:55.759553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=30 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:51:55.930630 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:52:50.410418 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d938d5-bd55-4122-bdf3-7ed08c5f42b9 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:52:50.411553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d938d5-bd55-4122-bdf3-7ed08c5f42b9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:52:50.412084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d938d5-bd55-4122-bdf3-7ed08c5f42b9 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:52:50.414652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 664/1307] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:52:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:52:50.419924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f350f-2270-42a9-b5f3-a6002eba757f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:52:50.420361 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f350f-2270-42a9-b5f3-a6002eba757f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:52:50.420458 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f350f-2270-42a9-b5f3-a6002eba757f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:52:50.498553 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2d8f350f-2270-42a9-b5f3-a6002eba757f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:52:50.500006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2d8f350f-2270-42a9-b5f3-a6002eba757f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:52:50.622738 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 644/1308] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:52:50.667268 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b24c4-585e-4ad8-b678-9c00e3680b33 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:52:50.668094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b24c4-585e-4ad8-b678-9c00e3680b33 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:52:50.668989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b24c4-585e-4ad8-b678-9c00e3680b33 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:52:50.672735 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 665/1309] 10.222.0.15 () {54 vars in 964 bytes} [Thu Jun 2 18:52:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:52:50.678353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bd1f8-50e2-486c-8ce5-a7351db26076 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:52:50.678674 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bd1f8-50e2-486c-8ce5-a7351db26076 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:52:50.678957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bd1f8-50e2-486c-8ce5-a7351db26076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:52:50.772660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f95bd1f8-50e2-486c-8ce5-a7351db26076 None None] MFA Rules not processed for user `e7714d3ad1d849f5a398fc1843f22e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:52:50.774039 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f95bd1f8-50e2-486c-8ce5-a7351db26076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:52:50.797449 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:52:50.889157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 645/1310] 10.222.0.15 () {58 vars in 1061 bytes} [Thu Jun 2 18:52:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:52:50.898755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b24c4-585e-4ad8-b678-9c00e3680b33 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:52:50.900581 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-611b24c4-585e-4ad8-b678-9c00e3680b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:52:51.060250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b24c4-585e-4ad8-b678-9c00e3680b33 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:52:51.146095 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca3abc-5fa3-4b7c-8d55-093329de6240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:52:51.147039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca3abc-5fa3-4b7c-8d55-093329de6240 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:52:51.147603 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca3abc-5fa3-4b7c-8d55-093329de6240 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:52:51.148106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca3abc-5fa3-4b7c-8d55-093329de6240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:52:51.150084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e5ca3abc-5fa3-4b7c-8d55-093329de6240 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:52:51.215032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:52:51.276892 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca3abc-5fa3-4b7c-8d55-093329de6240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:52:51.278384 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca3abc-5fa3-4b7c-8d55-093329de6240 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:52:51.314311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 666/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:52:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:52:53.848179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea671b-08de-4eaa-adb2-c51bbaee6896 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:52:53.848761 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea671b-08de-4eaa-adb2-c51bbaee6896 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:52:53.849013 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea671b-08de-4eaa-adb2-c51bbaee6896 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:52:53.850936 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 646/1312] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:52:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:52:53.856557 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a845b1-b368-49f3-8e3d-2d30a34ed171 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:52:53.856987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a845b1-b368-49f3-8e3d-2d30a34ed171 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:52:53.857087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a845b1-b368-49f3-8e3d-2d30a34ed171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:52:53.947180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c6a845b1-b368-49f3-8e3d-2d30a34ed171 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:52:53.948401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c6a845b1-b368-49f3-8e3d-2d30a34ed171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:52:54.093771 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 667/1313] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:52:54.133602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea671b-08de-4eaa-adb2-c51bbaee6896 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:52:54.135113 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-23ea671b-08de-4eaa-adb2-c51bbaee6896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:52:54.252296 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea671b-08de-4eaa-adb2-c51bbaee6896 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:52:54.338305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5b368-8c6e-42b8-8bb7-c019eb8f6d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:52:54.338967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5b368-8c6e-42b8-8bb7-c019eb8f6d3c service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:52:54.339590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:52:54.340202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5b368-8c6e-42b8-8bb7-c019eb8f6d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:52:54.340397 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5b368-8c6e-42b8-8bb7-c019eb8f6d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:52:54.342222 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-70a5b368-8c6e-42b8-8bb7-c019eb8f6d3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:52:54.460835 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5b368-8c6e-42b8-8bb7-c019eb8f6d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:52:54.462313 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5b368-8c6e-42b8-8bb7-c019eb8f6d3c service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:52:54.481474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 647/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:52:57.035102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e7a19-ce99-4058-aed9-1bd84acfb76b None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:52:57.035642 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e7a19-ce99-4058-aed9-1bd84acfb76b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:52:57.035642 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e7a19-ce99-4058-aed9-1bd84acfb76b None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:52:57.036934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 668/1315] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:52:57.043669 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd65eb-77fa-4b1e-b2bf-7cad6f4b287e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:52:57.044373 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd65eb-77fa-4b1e-b2bf-7cad6f4b287e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:52:57.044519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd65eb-77fa-4b1e-b2bf-7cad6f4b287e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:52:57.118839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-68bd65eb-77fa-4b1e-b2bf-7cad6f4b287e None None] MFA Rules not processed for user `3356491ab76f4af58ad2cc7077ba8a43`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:52:57.120113 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-68bd65eb-77fa-4b1e-b2bf-7cad6f4b287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:52:57.174785 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:52:57.223025 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 648/1316] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:52:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:52:57.268436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e7a19-ce99-4058-aed9-1bd84acfb76b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:52:57.270050 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-542e7a19-ce99-4058-aed9-1bd84acfb76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:52:57.280277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:52:57.386716 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e7a19-ce99-4058-aed9-1bd84acfb76b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:52:57.468628 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6feb8d-04f5-4a71-a5cf-b316d66aa7a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:52:57.469258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6feb8d-04f5-4a71-a5cf-b316d66aa7a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:52:57.469543 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6feb8d-04f5-4a71-a5cf-b316d66aa7a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:52:57.469822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6feb8d-04f5-4a71-a5cf-b316d66aa7a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:52:57.471492 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-cf6feb8d-04f5-4a71-a5cf-b316d66aa7a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:52:57.540027 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:52:57.588961 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6feb8d-04f5-4a71-a5cf-b316d66aa7a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:52:57.590430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6feb8d-04f5-4a71-a5cf-b316d66aa7a7 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:52:57.609286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 669/1317] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:52:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:53:00.595023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac54fe-5bc5-4500-892a-c451dc332c8b None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:00.595622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac54fe-5bc5-4500-892a-c451dc332c8b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:00.595622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac54fe-5bc5-4500-892a-c451dc332c8b None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:00.596983 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 649/1318] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:00.603541 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24166caf-df2f-4782-ae7c-aa6b32124ce0 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:00.604304 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24166caf-df2f-4782-ae7c-aa6b32124ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:00.604452 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24166caf-df2f-4782-ae7c-aa6b32124ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:00.686317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-24166caf-df2f-4782-ae7c-aa6b32124ce0 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:00.688181 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-24166caf-df2f-4782-ae7c-aa6b32124ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:00.799744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 670/1319] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:53:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:00.841369 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac54fe-5bc5-4500-892a-c451dc332c8b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:53:00.842989 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-bbac54fe-5bc5-4500-892a-c451dc332c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:00.966700 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac54fe-5bc5-4500-892a-c451dc332c8b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:53:01.044185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c848a-37a5-4db7-8604-5f073186e80f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:53:01.044828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c848a-37a5-4db7-8604-5f073186e80f service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:01.045102 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c848a-37a5-4db7-8604-5f073186e80f service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:01.045371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c848a-37a5-4db7-8604-5f073186e80f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:01.047027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-835c848a-37a5-4db7-8604-5f073186e80f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:01.054847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:01.177197 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c848a-37a5-4db7-8604-5f073186e80f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:53:01.178685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c848a-37a5-4db7-8604-5f073186e80f service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:53:01.197469 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 650/1320] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:53:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:53:04.172129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733f6ba-3aec-44b8-a03a-c3cd6e4e84ea None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:04.172679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733f6ba-3aec-44b8-a03a-c3cd6e4e84ea None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:04.172679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733f6ba-3aec-44b8-a03a-c3cd6e4e84ea None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:04.174106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 671/1321] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:04.179566 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff1abf-8244-417b-a09d-b929b08cb0db None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:04.180040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff1abf-8244-417b-a09d-b929b08cb0db None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:04.180137 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff1abf-8244-417b-a09d-b929b08cb0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:04.245048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e9ff1abf-8244-417b-a09d-b929b08cb0db None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:04.246266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e9ff1abf-8244-417b-a09d-b929b08cb0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:04.304137 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:04.344457 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 651/1322] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:04.395082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad754121-6cae-4cf7-ba21-83866573b1b2 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:04.395471 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad754121-6cae-4cf7-ba21-83866573b1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:04.395812 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad754121-6cae-4cf7-ba21-83866573b1b2 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:04.397231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 672/1323] 10.222.0.15 () {54 vars in 964 bytes} [Thu Jun 2 18:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:04.403704 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dab9cd-f396-40cb-b4aa-854cf8f3e490 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:04.403993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dab9cd-f396-40cb-b4aa-854cf8f3e490 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:04.404270 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dab9cd-f396-40cb-b4aa-854cf8f3e490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:04.628821 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-66dab9cd-f396-40cb-b4aa-854cf8f3e490 None None] MFA Rules not processed for user `e7714d3ad1d849f5a398fc1843f22e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:04.630076 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-66dab9cd-f396-40cb-b4aa-854cf8f3e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:04.709923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 652/1324] 10.222.0.15 () {58 vars in 1061 bytes} [Thu Jun 2 18:53:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 18:53:04.719615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad754121-6cae-4cf7-ba21-83866573b1b2 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:53:04.721227 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ad754121-6cae-4cf7-ba21-83866573b1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:04.740803 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:04.826185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad754121-6cae-4cf7-ba21-83866573b1b2 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:53:04.904846 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e284b-c15f-4e0d-bc66-4f4f3dee9747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:53:04.905498 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e284b-c15f-4e0d-bc66-4f4f3dee9747 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:04.905774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e284b-c15f-4e0d-bc66-4f4f3dee9747 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:04.906075 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e284b-c15f-4e0d-bc66-4f4f3dee9747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:04.907724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3a3e284b-c15f-4e0d-bc66-4f4f3dee9747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:04.981910 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:05.025459 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e284b-c15f-4e0d-bc66-4f4f3dee9747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:53:05.026985 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e284b-c15f-4e0d-bc66-4f4f3dee9747 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:53:05.048979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 673/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:53:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:53:07.617085 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac50cf-2ccd-4cf7-b93f-e83384f3a0de None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:07.617675 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac50cf-2ccd-4cf7-b93f-e83384f3a0de None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:07.617675 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac50cf-2ccd-4cf7-b93f-e83384f3a0de None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:07.619080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 653/1326] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:07.625006 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9021c-49c1-4714-bde5-cb5fa5a0c9c0 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:07.625471 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9021c-49c1-4714-bde5-cb5fa5a0c9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:07.625575 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9021c-49c1-4714-bde5-cb5fa5a0c9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:07.694698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-93b9021c-49c1-4714-bde5-cb5fa5a0c9c0 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:07.695983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-93b9021c-49c1-4714-bde5-cb5fa5a0c9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:07.798756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 674/1327] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:07.834540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac50cf-2ccd-4cf7-b93f-e83384f3a0de None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:53:07.836832 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b4ac50cf-2ccd-4cf7-b93f-e83384f3a0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:07.901705 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:07.948930 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac50cf-2ccd-4cf7-b93f-e83384f3a0de None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:53:08.027855 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32666fb1-cbb8-4232-8ba0-9839e1f63704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:53:08.028827 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32666fb1-cbb8-4232-8ba0-9839e1f63704 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:08.029106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32666fb1-cbb8-4232-8ba0-9839e1f63704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:08.029374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32666fb1-cbb8-4232-8ba0-9839e1f63704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:08.031042 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-32666fb1-cbb8-4232-8ba0-9839e1f63704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:08.140568 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:08.143103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32666fb1-cbb8-4232-8ba0-9839e1f63704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:53:08.144525 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32666fb1-cbb8-4232-8ba0-9839e1f63704 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:53:08.166245 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 654/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:53:10.552835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d789ff3-4771-428b-a338-e6e8ba660089 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:10.553335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d789ff3-4771-428b-a338-e6e8ba660089 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:10.553335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d789ff3-4771-428b-a338-e6e8ba660089 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:10.555393 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 675/1329] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:10.560774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fb96f-daf9-4f87-94c1-622a7bf28d95 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:10.561228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fb96f-daf9-4f87-94c1-622a7bf28d95 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:10.561322 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fb96f-daf9-4f87-94c1-622a7bf28d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:10.629491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-637fb96f-daf9-4f87-94c1-622a7bf28d95 None None] MFA Rules not processed for user `3356491ab76f4af58ad2cc7077ba8a43`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:10.630725 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-637fb96f-daf9-4f87-94c1-622a7bf28d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:10.730420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 655/1330] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:53:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:10.767811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d789ff3-4771-428b-a338-e6e8ba660089 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:53:10.769353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-0d789ff3-4771-428b-a338-e6e8ba660089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:10.801023 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:10.878566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d789ff3-4771-428b-a338-e6e8ba660089 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:53:10.956101 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102af15-f6eb-49c1-a8ce-a7a269b929d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:53:10.956752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102af15-f6eb-49c1-a8ce-a7a269b929d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:10.957026 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102af15-f6eb-49c1-a8ce-a7a269b929d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:10.957290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102af15-f6eb-49c1-a8ce-a7a269b929d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:10.958959 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-0102af15-f6eb-49c1-a8ce-a7a269b929d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:11.037496 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:11.077299 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102af15-f6eb-49c1-a8ce-a7a269b929d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:53:11.078705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102af15-f6eb-49c1-a8ce-a7a269b929d7 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:53:11.099760 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 676/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:53:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:53:13.638585 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fd2aa-c921-4de7-a150-7e6c424721c8 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:13.639072 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fd2aa-c921-4de7-a150-7e6c424721c8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:13.639072 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fd2aa-c921-4de7-a150-7e6c424721c8 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:13.640518 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 656/1332] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:13.646034 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138002b-5d2a-490b-93c8-27b97f5b73f0 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:13.646513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138002b-5d2a-490b-93c8-27b97f5b73f0 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:13.646614 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138002b-5d2a-490b-93c8-27b97f5b73f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:13.712792 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c138002b-5d2a-490b-93c8-27b97f5b73f0 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:13.713950 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c138002b-5d2a-490b-93c8-27b97f5b73f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:13.813429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 677/1333] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:13.850267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fd2aa-c921-4de7-a150-7e6c424721c8 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:53:13.851998 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d84fd2aa-c921-4de7-a150-7e6c424721c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:13.919225 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:13.955867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fd2aa-c921-4de7-a150-7e6c424721c8 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:53:14.030655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f9dd2-7061-40be-95c6-80d02774175f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:53:14.031220 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f9dd2-7061-40be-95c6-80d02774175f service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:14.031495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f9dd2-7061-40be-95c6-80d02774175f service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:14.031769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f9dd2-7061-40be-95c6-80d02774175f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:14.033411 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-094f9dd2-7061-40be-95c6-80d02774175f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:14.146470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f9dd2-7061-40be-95c6-80d02774175f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:53:14.148932 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f9dd2-7061-40be-95c6-80d02774175f service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:53:14.160422 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:14.171043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 657/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:53:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:53:16.473193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94eda63-706e-4031-bbb4-f38dda5e678a None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:16.474141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94eda63-706e-4031-bbb4-f38dda5e678a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:16.474141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94eda63-706e-4031-bbb4-f38dda5e678a None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:16.476899 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 678/1335] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:53:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:16.482502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a5f85-8e8a-4636-a1f3-e6a5c4c88b85 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:16.482906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a5f85-8e8a-4636-a1f3-e6a5c4c88b85 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:16.483056 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a5f85-8e8a-4636-a1f3-e6a5c4c88b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:16.552394 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4d3a5f85-8e8a-4636-a1f3-e6a5c4c88b85 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:16.553589 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4d3a5f85-8e8a-4636-a1f3-e6a5c4c88b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:16.666247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 658/1336] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:16.709193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94eda63-706e-4031-bbb4-f38dda5e678a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:53:16.711012 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d94eda63-706e-4031-bbb4-f38dda5e678a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:16.754059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:16.819315 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94eda63-706e-4031-bbb4-f38dda5e678a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:53:16.908037 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4468f-0698-4a05-ad2d-0e4f810b17e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:53:16.908916 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4468f-0698-4a05-ad2d-0e4f810b17e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:16.909244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4468f-0698-4a05-ad2d-0e4f810b17e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:16.909511 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4468f-0698-4a05-ad2d-0e4f810b17e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:16.912218 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f1c4468f-0698-4a05-ad2d-0e4f810b17e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:17.010934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:17.039709 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4468f-0698-4a05-ad2d-0e4f810b17e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:53:17.041157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4468f-0698-4a05-ad2d-0e4f810b17e3 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:53:17.061039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 679/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:53:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:53:19.663043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1968e79-fd8c-4412-a0fe-bc89c4fcdd9f None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:19.664195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1968e79-fd8c-4412-a0fe-bc89c4fcdd9f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:19.664195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1968e79-fd8c-4412-a0fe-bc89c4fcdd9f None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:19.665146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 659/1338] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:19.671621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e1b3b-2633-4cbc-8101-bfb0bd1df6a5 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:19.672333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e1b3b-2633-4cbc-8101-bfb0bd1df6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:19.672479 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e1b3b-2633-4cbc-8101-bfb0bd1df6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:19.750616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-042e1b3b-2633-4cbc-8101-bfb0bd1df6a5 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:19.751861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-042e1b3b-2633-4cbc-8101-bfb0bd1df6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:20.026167 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 680/1339] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:53:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:20.065168 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1968e79-fd8c-4412-a0fe-bc89c4fcdd9f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:53:20.066670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a1968e79-fd8c-4412-a0fe-bc89c4fcdd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:20.153349 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:20.186095 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1968e79-fd8c-4412-a0fe-bc89c4fcdd9f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:53:20.266808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdd566-4711-41d0-92f3-7871b64b2f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:53:20.267745 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdd566-4711-41d0-92f3-7871b64b2f5e service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:20.268162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdd566-4711-41d0-92f3-7871b64b2f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:20.268497 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdd566-4711-41d0-92f3-7871b64b2f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:20.270521 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c2bdd566-4711-41d0-92f3-7871b64b2f5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:20.403083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bdd566-4711-41d0-92f3-7871b64b2f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:53:20.404528 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bdd566-4711-41d0-92f3-7871b64b2f5e service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:53:20.423537 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 660/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:53:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:53:24.654370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82593ca0-c055-4acd-ae71-259223317347 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:24.654916 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82593ca0-c055-4acd-ae71-259223317347 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:24.654916 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82593ca0-c055-4acd-ae71-259223317347 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:24.656287 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 681/1341] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:24.661841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de43b4-9929-4776-b5e2-4eae2d93a046 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:24.662308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de43b4-9929-4776-b5e2-4eae2d93a046 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:24.662404 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de43b4-9929-4776-b5e2-4eae2d93a046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:24.670071 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:24.739673 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-99de43b4-9929-4776-b5e2-4eae2d93a046 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:24.740874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-99de43b4-9929-4776-b5e2-4eae2d93a046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:24.846907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 661/1342] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:24.887095 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82593ca0-c055-4acd-ae71-259223317347 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:53:24.889571 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-82593ca0-c055-4acd-ae71-259223317347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:24.942752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:24.991799 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82593ca0-c055-4acd-ae71-259223317347 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:53:24.995504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c19434-f407-4456-9fab-829b016aa61b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:53:24.996157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c19434-f407-4456-9fab-829b016aa61b service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:24.996435 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c19434-f407-4456-9fab-829b016aa61b service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:24.996709 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c19434-f407-4456-9fab-829b016aa61b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:25.006216 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c19434-f407-4456-9fab-829b016aa61b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:53:25.007681 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c19434-f407-4456-9fab-829b016aa61b service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:53:25.017157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 682/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:53:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:53:27.909100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acc0af-af57-42ed-90b3-735979d46bd0 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:27.909688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acc0af-af57-42ed-90b3-735979d46bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:27.909688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acc0af-af57-42ed-90b3-735979d46bd0 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:27.911045 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 662/1344] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:27.916479 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a191157-5cf7-48fa-953d-4f11317a1fa8 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:27.916916 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a191157-5cf7-48fa-953d-4f11317a1fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:27.917086 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a191157-5cf7-48fa-953d-4f11317a1fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:27.947311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-3a191157-5cf7-48fa-953d-4f11317a1fa8 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:27.948488 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3a191157-5cf7-48fa-953d-4f11317a1fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:28.029666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 683/1345] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:53:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:28.066178 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acc0af-af57-42ed-90b3-735979d46bd0 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:53:28.068030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-83acc0af-af57-42ed-90b3-735979d46bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:28.081943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acc0af-af57-42ed-90b3-735979d46bd0 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:53:28.085519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a854e9-41d4-42db-8dae-f1c138a6192d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:53:28.086194 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a854e9-41d4-42db-8dae-f1c138a6192d service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:28.086464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a854e9-41d4-42db-8dae-f1c138a6192d service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:28.086733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a854e9-41d4-42db-8dae-f1c138a6192d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:28.096053 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a854e9-41d4-42db-8dae-f1c138a6192d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:53:28.097480 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a854e9-41d4-42db-8dae-f1c138a6192d service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:53:28.107125 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 663/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:53:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:53:32.895889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb38c2-96c4-4b63-8820-8cd7797553ef None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:32.896446 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb38c2-96c4-4b63-8820-8cd7797553ef None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:32.896446 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb38c2-96c4-4b63-8820-8cd7797553ef None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:32.898080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 684/1347] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:32.914574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00a0b8-b46b-49e6-b50e-7b20686c2293 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:32.914574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00a0b8-b46b-49e6-b50e-7b20686c2293 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:32.914574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00a0b8-b46b-49e6-b50e-7b20686c2293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:32.934278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-9e00a0b8-b46b-49e6-b50e-7b20686c2293 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:32.935506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9e00a0b8-b46b-49e6-b50e-7b20686c2293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:32.944607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 664/1348] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:32.982702 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb38c2-96c4-4b63-8820-8cd7797553ef None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:53:32.994723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb38c2-96c4-4b63-8820-8cd7797553ef None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:53:32.999080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5414100-8843-4661-8a2a-e5fd28154ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:53:32.999767 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5414100-8843-4661-8a2a-e5fd28154ccb service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:33.000101 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5414100-8843-4661-8a2a-e5fd28154ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:33.000436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5414100-8843-4661-8a2a-e5fd28154ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:33.010582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5414100-8843-4661-8a2a-e5fd28154ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:53:33.012048 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5414100-8843-4661-8a2a-e5fd28154ccb service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:53:33.021465 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 685/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:53:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 18:53:38.471092 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd010c03-ece9-4ee9-b2ce-377866b99469 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:38.472178 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd010c03-ece9-4ee9-b2ce-377866b99469 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:38.472672 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd010c03-ece9-4ee9-b2ce-377866b99469 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:38.474654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 665/1350] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 2 18:53:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:38.479944 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084ef96-a740-487c-8499-33f8bbbebae7 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:38.480405 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084ef96-a740-487c-8499-33f8bbbebae7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:38.480519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084ef96-a740-487c-8499-33f8bbbebae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:38.561385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b084ef96-a740-487c-8499-33f8bbbebae7 None None] MFA Rules not processed for user `11a4152a82e1486887541afab2d4e5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:38.562950 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b084ef96-a740-487c-8499-33f8bbbebae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:38.592080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:38.648087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 686/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 2 18:53:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:42.927706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=72 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:43.197717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaad09a-b378-4773-8472-b54aace326c9 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:43.197962 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaad09a-b378-4773-8472-b54aace326c9 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:43.198277 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaad09a-b378-4773-8472-b54aace326c9 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:43.200091 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 666/1352] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 2 18:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:43.205610 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d9d3-581e-4dd8-add6-3d1b7ea17651 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:43.206112 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d9d3-581e-4dd8-add6-3d1b7ea17651 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:43.206198 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d9d3-581e-4dd8-add6-3d1b7ea17651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:43.225474 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-7548d9d3-581e-4dd8-add6-3d1b7ea17651 None None] MFA Rules not processed for user `11a4152a82e1486887541afab2d4e5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:43.226768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7548d9d3-581e-4dd8-add6-3d1b7ea17651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:43.235894 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 687/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 2 18:53:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 18:53:44.658791 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145abc0-e184-4d86-974d-e57eb6b93ead None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:44.659350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145abc0-e184-4d86-974d-e57eb6b93ead None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:44.659350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145abc0-e184-4d86-974d-e57eb6b93ead None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:44.660909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 667/1354] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 2 18:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:44.666018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee95ac-b0cf-4c2f-802f-398137ddf27a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:44.666448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee95ac-b0cf-4c2f-802f-398137ddf27a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:44.666566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee95ac-b0cf-4c2f-802f-398137ddf27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:44.686028 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e1ee95ac-b0cf-4c2f-802f-398137ddf27a None None] MFA Rules not processed for user `11a4152a82e1486887541afab2d4e5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:44.687243 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e1ee95ac-b0cf-4c2f-802f-398137ddf27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:44.697771 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 688/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 2 18:53:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:48.433300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dff7c-af17-4cf6-b231-323660006386 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:48.434380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dff7c-af17-4cf6-b231-323660006386 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:48.434659 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dff7c-af17-4cf6-b231-323660006386 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:48.436040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 668/1356] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:53:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:48.441898 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213680e-3487-4c1b-9169-60315b5837cc None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:48.442326 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213680e-3487-4c1b-9169-60315b5837cc None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:48.442464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213680e-3487-4c1b-9169-60315b5837cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:48.461946 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f213680e-3487-4c1b-9169-60315b5837cc None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:48.463285 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f213680e-3487-4c1b-9169-60315b5837cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:48.471778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 689/1357] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:48.538025 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdfdc2-db8b-4e56-ae43-8d0e1e84649c None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:48.539216 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdfdc2-db8b-4e56-ae43-8d0e1e84649c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:48.539602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdfdc2-db8b-4e56-ae43-8d0e1e84649c None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:48.541310 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 669/1358] 10.222.0.15 () {54 vars in 961 bytes} [Thu Jun 2 18:53:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:48.548422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a89066-9c6c-4271-8520-c39f51545011 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:48.548984 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a89066-9c6c-4271-8520-c39f51545011 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:48.549660 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a89066-9c6c-4271-8520-c39f51545011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:48.600687 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-34a89066-9c6c-4271-8520-c39f51545011 None None] MFA Rules not processed for user `6b8ff9f5032e498db3c70c79cc11989b`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:48.602050 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-34a89066-9c6c-4271-8520-c39f51545011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:48.696402 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 690/1359] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Jun 2 18:53:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 18:53:48.703037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdfdc2-db8b-4e56-ae43-8d0e1e84649c None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:53:48.718574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdfdc2-db8b-4e56-ae43-8d0e1e84649c None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:53:48.724073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2813d-a810-41a1-9fb5-7d0a1705e32b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:53:48.724908 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2813d-a810-41a1-9fb5-7d0a1705e32b service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:48.725283 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2813d-a810-41a1-9fb5-7d0a1705e32b service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:48.725908 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2813d-a810-41a1-9fb5-7d0a1705e32b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:48.747980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2813d-a810-41a1-9fb5-7d0a1705e32b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:53:48.749851 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2813d-a810-41a1-9fb5-7d0a1705e32b service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:53:48.763690 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 670/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:53:51.271119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e80f41-bd08-42fa-8d63-102b83326659 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:51.271733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e80f41-bd08-42fa-8d63-102b83326659 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:51.271733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e80f41-bd08-42fa-8d63-102b83326659 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:51.273269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 691/1361] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:51.278645 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050163de-1d30-4375-9ad5-36466e53f5c8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:51.279517 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050163de-1d30-4375-9ad5-36466e53f5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:51.279759 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050163de-1d30-4375-9ad5-36466e53f5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:51.299125 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-050163de-1d30-4375-9ad5-36466e53f5c8 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:51.300654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-050163de-1d30-4375-9ad5-36466e53f5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:51.309664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 671/1362] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:51.364583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e80f41-bd08-42fa-8d63-102b83326659 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:53:51.379704 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e80f41-bd08-42fa-8d63-102b83326659 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:53:51.386197 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5cbd3-28c9-4a78-83bc-afc9c865c5a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:53:51.386837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5cbd3-28c9-4a78-83bc-afc9c865c5a4 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:51.387131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5cbd3-28c9-4a78-83bc-afc9c865c5a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:51.387360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5cbd3-28c9-4a78-83bc-afc9c865c5a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:51.396199 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5cbd3-28c9-4a78-83bc-afc9c865c5a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:53:51.398230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5cbd3-28c9-4a78-83bc-afc9c865c5a4 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:53:51.408657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 692/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:53:53.984623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80849c58-98a4-4c26-82ed-ccdc4f7b48cd None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:53.985608 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80849c58-98a4-4c26-82ed-ccdc4f7b48cd None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:53.986151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80849c58-98a4-4c26-82ed-ccdc4f7b48cd None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:53.988052 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 672/1364] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:53.994045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4dcce-65c1-4770-9cb8-f73b4eac8fad None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:53.994534 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4dcce-65c1-4770-9cb8-f73b4eac8fad None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:53.994613 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4dcce-65c1-4770-9cb8-f73b4eac8fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:54.012800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4cb4dcce-65c1-4770-9cb8-f73b4eac8fad None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:54.014032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4cb4dcce-65c1-4770-9cb8-f73b4eac8fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:54.022336 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 693/1365] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:54.069312 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbc8d3-ee3e-4535-8d09-49040b52cdd7 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:54.069626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbc8d3-ee3e-4535-8d09-49040b52cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:54.070044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbc8d3-ee3e-4535-8d09-49040b52cdd7 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:54.071289 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 673/1366] 10.222.0.15 () {54 vars in 961 bytes} [Thu Jun 2 18:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:54.076639 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b382e4a-205f-47e1-bcd4-ea28878b7a30 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:54.076925 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b382e4a-205f-47e1-bcd4-ea28878b7a30 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:54.077196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b382e4a-205f-47e1-bcd4-ea28878b7a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:54.097325 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-3b382e4a-205f-47e1-bcd4-ea28878b7a30 None None] MFA Rules not processed for user `6b8ff9f5032e498db3c70c79cc11989b`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:54.098550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3b382e4a-205f-47e1-bcd4-ea28878b7a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:54.108646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 694/1367] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Jun 2 18:53:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:54.117536 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbc8d3-ee3e-4535-8d09-49040b52cdd7 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:53:54.132142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbc8d3-ee3e-4535-8d09-49040b52cdd7 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:53:54.137671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46cc56-a869-4849-b22a-bc0e960b1b3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:53:54.138330 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46cc56-a869-4849-b22a-bc0e960b1b3a service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:54.138607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46cc56-a869-4849-b22a-bc0e960b1b3a service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:54.138876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46cc56-a869-4849-b22a-bc0e960b1b3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:54.147699 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46cc56-a869-4849-b22a-bc0e960b1b3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:53:54.149354 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46cc56-a869-4849-b22a-bc0e960b1b3a service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:53:54.159545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 674/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:53:56.477232 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103a43a-bd7d-4690-abd8-4ba09af71953 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:56.478045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103a43a-bd7d-4690-abd8-4ba09af71953 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:56.478045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103a43a-bd7d-4690-abd8-4ba09af71953 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:56.479494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 695/1369] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:56.484820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d58bb-9e48-49c5-83f4-3994e35f7064 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:56.485582 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d58bb-9e48-49c5-83f4-3994e35f7064 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:56.486034 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d58bb-9e48-49c5-83f4-3994e35f7064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:56.508556 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-765d58bb-9e48-49c5-83f4-3994e35f7064 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:56.510698 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-765d58bb-9e48-49c5-83f4-3994e35f7064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:56.526478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 675/1370] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:56.571485 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103a43a-bd7d-4690-abd8-4ba09af71953 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:53:56.588314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103a43a-bd7d-4690-abd8-4ba09af71953 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:53:56.594558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546319f6-130f-4315-a634-3cc52ec37b03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:53:56.595427 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546319f6-130f-4315-a634-3cc52ec37b03 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:56.595806 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546319f6-130f-4315-a634-3cc52ec37b03 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:56.596175 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546319f6-130f-4315-a634-3cc52ec37b03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:56.606132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546319f6-130f-4315-a634-3cc52ec37b03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:53:56.608017 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546319f6-130f-4315-a634-3cc52ec37b03 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:53:56.619710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 696/1371] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:53:56.659461 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ad7c5-a344-4c5c-bf03-3c733c420d79 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:56.659784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ad7c5-a344-4c5c-bf03-3c733c420d79 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:56.660057 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ad7c5-a344-4c5c-bf03-3c733c420d79 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:56.661475 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 676/1372] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:56.667775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16036b0-73cd-4763-a3f4-35408e4467b8 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:56.668094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16036b0-73cd-4763-a3f4-35408e4467b8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:56.668377 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16036b0-73cd-4763-a3f4-35408e4467b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:56.687294 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c16036b0-73cd-4763-a3f4-35408e4467b8 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:56.688536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c16036b0-73cd-4763-a3f4-35408e4467b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:56.707194 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 697/1373] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:57.014964 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90e12c-3495-45eb-987f-a9afa261f79f None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:57.014964 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90e12c-3495-45eb-987f-a9afa261f79f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:57.016018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90e12c-3495-45eb-987f-a9afa261f79f None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:57.016956 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 677/1374] 10.222.0.15 () {54 vars in 963 bytes} [Thu Jun 2 18:53:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:57.021999 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af7ae2-d2a2-4049-b5b2-d5f3204c8127 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:57.022411 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af7ae2-d2a2-4049-b5b2-d5f3204c8127 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:57.023291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af7ae2-d2a2-4049-b5b2-d5f3204c8127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:57.031043 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:53:57.079512 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f2af7ae2-d2a2-4049-b5b2-d5f3204c8127 None None] MFA Rules not processed for user `e0141329b2cd4f668803a192d2b6cedb`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:57.081140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f2af7ae2-d2a2-4049-b5b2-d5f3204c8127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:57.147557 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 698/1375] 10.222.0.15 () {58 vars in 1060 bytes} [Thu Jun 2 18:53:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:53:57.153964 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90e12c-3495-45eb-987f-a9afa261f79f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:53:57.165540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90e12c-3495-45eb-987f-a9afa261f79f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:53:57.169445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f461c-9036-483c-b73e-75ca85f4c317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:53:57.170396 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f461c-9036-483c-b73e-75ca85f4c317 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:57.170883 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f461c-9036-483c-b73e-75ca85f4c317 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:57.171368 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f461c-9036-483c-b73e-75ca85f4c317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:57.183079 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f461c-9036-483c-b73e-75ca85f4c317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:53:57.184522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f461c-9036-483c-b73e-75ca85f4c317 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:53:57.194750 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 678/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:53:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:53:58.921274 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec3d11-990a-4fa6-9d44-343ce7a60b5d None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:58.921879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec3d11-990a-4fa6-9d44-343ce7a60b5d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:58.921879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec3d11-990a-4fa6-9d44-343ce7a60b5d None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:58.923246 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 699/1377] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:53:58.929322 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15e0ba-549e-4cca-a3b7-6e137181055a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:58.930136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15e0ba-549e-4cca-a3b7-6e137181055a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:58.930136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15e0ba-549e-4cca-a3b7-6e137181055a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:58.949637 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-9f15e0ba-549e-4cca-a3b7-6e137181055a None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:53:58.950920 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9f15e0ba-549e-4cca-a3b7-6e137181055a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:53:58.960548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 679/1378] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 18:53:59.005461 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec3d11-990a-4fa6-9d44-343ce7a60b5d None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:53:59.021707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec3d11-990a-4fa6-9d44-343ce7a60b5d None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:53:59.028423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3fce3-9312-42a3-bfee-58ba20659230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:53:59.029100 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3fce3-9312-42a3-bfee-58ba20659230 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:53:59.029382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3fce3-9312-42a3-bfee-58ba20659230 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:53:59.029655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3fce3-9312-42a3-bfee-58ba20659230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:53:59.039603 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3fce3-9312-42a3-bfee-58ba20659230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:53:59.042419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3fce3-9312-42a3-bfee-58ba20659230 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:53:59.056220 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 700/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:01.444682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e556fc0-9cbd-4bf2-b379-e60bf82030c5 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:01.445475 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e556fc0-9cbd-4bf2-b379-e60bf82030c5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:01.445475 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e556fc0-9cbd-4bf2-b379-e60bf82030c5 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:01.447520 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 680/1380] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:54:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:01.453262 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2ce86-41f4-466b-b892-29c113d70651 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:01.453748 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2ce86-41f4-466b-b892-29c113d70651 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:01.453882 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2ce86-41f4-466b-b892-29c113d70651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:01.474443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f4e2ce86-41f4-466b-b892-29c113d70651 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:01.475750 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f4e2ce86-41f4-466b-b892-29c113d70651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:01.484763 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 701/1381] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:01.531985 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e556fc0-9cbd-4bf2-b379-e60bf82030c5 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:01.550472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e556fc0-9cbd-4bf2-b379-e60bf82030c5 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:01.557192 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f501494-5004-443c-bf70-25826ca3efbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:01.557974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f501494-5004-443c-bf70-25826ca3efbb service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:01.558310 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f501494-5004-443c-bf70-25826ca3efbb service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:01.558657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f501494-5004-443c-bf70-25826ca3efbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:01.568906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f501494-5004-443c-bf70-25826ca3efbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:01.570923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f501494-5004-443c-bf70-25826ca3efbb service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:01.584332 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 681/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:03.899132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4875-c5e7-4f28-ac5b-1d191d503417 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:03.899808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4875-c5e7-4f28-ac5b-1d191d503417 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:03.899808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4875-c5e7-4f28-ac5b-1d191d503417 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:03.901034 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 702/1383] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:03.906677 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d42396-5b5d-47e5-8c52-eb7a6433c021 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:03.907131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d42396-5b5d-47e5-8c52-eb7a6433c021 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:03.907240 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d42396-5b5d-47e5-8c52-eb7a6433c021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:03.925742 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f6d42396-5b5d-47e5-8c52-eb7a6433c021 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:03.926973 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f6d42396-5b5d-47e5-8c52-eb7a6433c021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:03.935304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 682/1384] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:03.978226 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb4875-c5e7-4f28-ac5b-1d191d503417 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:03.993576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb4875-c5e7-4f28-ac5b-1d191d503417 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:03.999120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31612088-006d-4f99-ba09-5ced7768067b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:03.999766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31612088-006d-4f99-ba09-5ced7768067b service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:04.000047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31612088-006d-4f99-ba09-5ced7768067b service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:04.000413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31612088-006d-4f99-ba09-5ced7768067b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:04.010951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31612088-006d-4f99-ba09-5ced7768067b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:04.012465 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31612088-006d-4f99-ba09-5ced7768067b service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:04.023137 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 703/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:06.381763 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010928c-1558-45cc-90f1-6ed235cc0a11 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:06.382435 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010928c-1558-45cc-90f1-6ed235cc0a11 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:06.382890 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010928c-1558-45cc-90f1-6ed235cc0a11 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:06.385194 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 683/1386] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:54:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:06.393583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8c012-ced3-442f-9927-6a28449f0a54 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:06.394076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8c012-ced3-442f-9927-6a28449f0a54 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:06.394529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8c012-ced3-442f-9927-6a28449f0a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:06.414442 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e8d8c012-ced3-442f-9927-6a28449f0a54 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:06.415657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e8d8c012-ced3-442f-9927-6a28449f0a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:06.423464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 704/1387] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:06.471883 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010928c-1558-45cc-90f1-6ed235cc0a11 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:06.486586 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010928c-1558-45cc-90f1-6ed235cc0a11 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:06.493269 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02e3b9-600c-45f1-8144-8207ed84d039 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:06.493938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02e3b9-600c-45f1-8144-8207ed84d039 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:06.494242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02e3b9-600c-45f1-8144-8207ed84d039 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:06.494500 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02e3b9-600c-45f1-8144-8207ed84d039 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:06.503330 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02e3b9-600c-45f1-8144-8207ed84d039 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:06.504918 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02e3b9-600c-45f1-8144-8207ed84d039 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:06.514774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 684/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:08.795845 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f226d2-bd2f-4075-b280-abb2b292ba5f None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:08.796396 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f226d2-bd2f-4075-b280-abb2b292ba5f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:08.796396 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f226d2-bd2f-4075-b280-abb2b292ba5f None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:08.797676 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 705/1389] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:08.803010 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6c7a0-ca42-42c8-b2a4-dc5f881a320a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:08.803467 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6c7a0-ca42-42c8-b2a4-dc5f881a320a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:08.803597 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6c7a0-ca42-42c8-b2a4-dc5f881a320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:08.822060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-58c6c7a0-ca42-42c8-b2a4-dc5f881a320a None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:08.823267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-58c6c7a0-ca42-42c8-b2a4-dc5f881a320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:08.831461 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 685/1390] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:08.879001 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f226d2-bd2f-4075-b280-abb2b292ba5f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:08.896250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f226d2-bd2f-4075-b280-abb2b292ba5f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:08.903372 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09381bda-63e0-481d-add6-762127ed9fdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:08.904029 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09381bda-63e0-481d-add6-762127ed9fdf service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:08.904304 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09381bda-63e0-481d-add6-762127ed9fdf service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:08.904573 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09381bda-63e0-481d-add6-762127ed9fdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:08.913436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09381bda-63e0-481d-add6-762127ed9fdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:08.915742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09381bda-63e0-481d-add6-762127ed9fdf service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:08.928439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 706/1391] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:11.542361 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a533a01-3c02-4dee-8bac-198277b98746 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:11.542921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a533a01-3c02-4dee-8bac-198277b98746 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:11.542921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a533a01-3c02-4dee-8bac-198277b98746 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:11.544253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 686/1392] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:11.549636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2607d4-927d-4009-87a1-710ea91ec7ea None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:11.550131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2607d4-927d-4009-87a1-710ea91ec7ea None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:11.550238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2607d4-927d-4009-87a1-710ea91ec7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:11.568979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ee2607d4-927d-4009-87a1-710ea91ec7ea None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:11.570251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ee2607d4-927d-4009-87a1-710ea91ec7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:11.578672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 707/1393] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:11.623315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a533a01-3c02-4dee-8bac-198277b98746 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:11.638478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a533a01-3c02-4dee-8bac-198277b98746 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:11.644101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932df22-1283-41b4-a41e-66125048f867 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:11.644771 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932df22-1283-41b4-a41e-66125048f867 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:11.645051 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932df22-1283-41b4-a41e-66125048f867 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:11.645307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932df22-1283-41b4-a41e-66125048f867 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:11.653768 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932df22-1283-41b4-a41e-66125048f867 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:11.655394 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932df22-1283-41b4-a41e-66125048f867 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:11.665214 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 687/1394] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:13.117240 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fddb1-66a3-459f-acd4-d06a506c5491 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:13.117891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fddb1-66a3-459f-acd4-d06a506c5491 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:13.117891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fddb1-66a3-459f-acd4-d06a506c5491 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:13.119218 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 708/1395] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:13.124565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0cec5-2f73-4c25-9634-70c39692ffb4 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:13.125028 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0cec5-2f73-4c25-9634-70c39692ffb4 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:13.125132 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0cec5-2f73-4c25-9634-70c39692ffb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:13.132192 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=52 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:54:13.144359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-62c0cec5-2f73-4c25-9634-70c39692ffb4 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:13.145544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-62c0cec5-2f73-4c25-9634-70c39692ffb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:13.153872 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 688/1396] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:13.209352 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c428f-f7f4-470e-ae4c-6a26f9834cca None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:13.209641 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c428f-f7f4-470e-ae4c-6a26f9834cca None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:13.210041 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c428f-f7f4-470e-ae4c-6a26f9834cca None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:13.211447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 709/1397] 10.222.0.15 () {54 vars in 962 bytes} [Thu Jun 2 18:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:13.216571 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b8c7f-c4d5-4b6d-b4f8-d4ab76d1739d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:13.216858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b8c7f-c4d5-4b6d-b4f8-d4ab76d1739d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:13.217131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b8c7f-c4d5-4b6d-b4f8-d4ab76d1739d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:13.266771 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-599b8c7f-c4d5-4b6d-b4f8-d4ab76d1739d None None] MFA Rules not processed for user `8a1b010003c44dc19643558167424d13`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:13.268062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-599b8c7f-c4d5-4b6d-b4f8-d4ab76d1739d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:13.327211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 689/1398] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Jun 2 18:54:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:13.335557 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c428f-f7f4-470e-ae4c-6a26f9834cca None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:13.347588 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c428f-f7f4-470e-ae4c-6a26f9834cca None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:13.351763 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170db4c-fcb1-46b7-8480-87ace4a2d275 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1b010003c44dc19643558167424d13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:13.352410 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170db4c-fcb1-46b7-8480-87ace4a2d275 service glance] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:13.352685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170db4c-fcb1-46b7-8480-87ace4a2d275 service glance] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:13.352949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170db4c-fcb1-46b7-8480-87ace4a2d275 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:13.364255 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170db4c-fcb1-46b7-8480-87ace4a2d275 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:13.365704 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170db4c-fcb1-46b7-8480-87ace4a2d275 service glance] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:13.376411 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 710/1399] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:13.905414 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7368c9-f0f6-4c29-9e2e-4df06f78beec None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:13.905780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7368c9-f0f6-4c29-9e2e-4df06f78beec None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:13.906085 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7368c9-f0f6-4c29-9e2e-4df06f78beec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:13.955921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-db7368c9-f0f6-4c29-9e2e-4df06f78beec None None] MFA Rules not processed for user `23aa142375c54b94ad276d1a4b9031e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:13.957128 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-db7368c9-f0f6-4c29-9e2e-4df06f78beec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:14.001111 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405082d1-3b19-4b15-a38b-31a5e5668c12 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:14.001396 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405082d1-3b19-4b15-a38b-31a5e5668c12 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:14.001672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405082d1-3b19-4b15-a38b-31a5e5668c12 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:14.003245 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 711/1400] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:54:14.008577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac63b1-31b3-41ec-b821-171b98a957a8 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:14.008856 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac63b1-31b3-41ec-b821-171b98a957a8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:14.009128 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac63b1-31b3-41ec-b821-171b98a957a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:14.025019 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 690/1401] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 2 18:54:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:14.027652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-28ac63b1-31b3-41ec-b821-171b98a957a8 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:14.028852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-28ac63b1-31b3-41ec-b821-171b98a957a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:14.036928 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 712/1402] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:14.065751 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fca38b-3510-4598-91a5-ff621dd2aef2 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:14.066109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fca38b-3510-4598-91a5-ff621dd2aef2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:14.066376 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fca38b-3510-4598-91a5-ff621dd2aef2 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:14.068127 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 691/1403] 10.222.0.15 () {54 vars in 942 bytes} [Thu Jun 2 18:54:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:14.075265 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdfdb8-0fe0-447d-8e41-8fd6aaad358c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:14.075724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdfdb8-0fe0-447d-8e41-8fd6aaad358c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:14.075951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdfdb8-0fe0-447d-8e41-8fd6aaad358c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:14.082502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fca38b-3510-4598-91a5-ff621dd2aef2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:14.098440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fca38b-3510-4598-91a5-ff621dd2aef2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:14.105217 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a17be-fb14-4705-a73d-86e2ed99e9b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:14.106045 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a17be-fb14-4705-a73d-86e2ed99e9b1 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:14.106317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a17be-fb14-4705-a73d-86e2ed99e9b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:14.106584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a17be-fb14-4705-a73d-86e2ed99e9b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:14.115430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a17be-fb14-4705-a73d-86e2ed99e9b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:14.117265 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a17be-fb14-4705-a73d-86e2ed99e9b1 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:14.127965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 692/1404] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:14.129271 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b6cdfdb8-0fe0-447d-8e41-8fd6aaad358c None None] MFA Rules not processed for user `b4faac48f82244bebf039aab92898617`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:14.130574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b6cdfdb8-0fe0-447d-8e41-8fd6aaad358c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:14.166415 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:54:14.214969 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 713/1405] 10.222.0.15 () {58 vars in 1039 bytes} [Thu Jun 2 18:54:14 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:14.224815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a17be-fb14-4705-a73d-86e2ed99e9b1 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:14.237327 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a17be-fb14-4705-a73d-86e2ed99e9b1 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:14.245433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682c232-a7a6-463d-a5bf-d166bda37806 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4faac48f82244bebf039aab92898617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:14.246236 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682c232-a7a6-463d-a5bf-d166bda37806 service swift] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:14.246583 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682c232-a7a6-463d-a5bf-d166bda37806 service swift] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:14.246981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682c232-a7a6-463d-a5bf-d166bda37806 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:14.258221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682c232-a7a6-463d-a5bf-d166bda37806 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:14.259892 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682c232-a7a6-463d-a5bf-d166bda37806 service swift] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:14.270156 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 693/1406] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 2 18:54:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 18:54:16.537340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27fff3-f919-47da-a741-e9ec26e863a9 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:16.538001 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27fff3-f919-47da-a741-e9ec26e863a9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:16.538183 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27fff3-f919-47da-a741-e9ec26e863a9 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:16.542161 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 714/1407] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:54:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:16.545169 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d667a-0983-4aea-9308-860ba13f720f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:16.545645 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d667a-0983-4aea-9308-860ba13f720f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:16.545740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d667a-0983-4aea-9308-860ba13f720f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:16.564018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-bf4d667a-0983-4aea-9308-860ba13f720f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:16.565263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-bf4d667a-0983-4aea-9308-860ba13f720f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:16.576230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 694/1408] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:16.622835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27fff3-f919-47da-a741-e9ec26e863a9 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:16.640960 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27fff3-f919-47da-a741-e9ec26e863a9 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:16.646835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f186677-0bab-41b9-9954-3c36047d44e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:16.647963 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f186677-0bab-41b9-9954-3c36047d44e1 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:16.648316 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f186677-0bab-41b9-9954-3c36047d44e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:16.648656 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f186677-0bab-41b9-9954-3c36047d44e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:16.658111 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f186677-0bab-41b9-9954-3c36047d44e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:16.659721 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f186677-0bab-41b9-9954-3c36047d44e1 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:16.670122 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 715/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 18:54:26.558666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:54:26.665595 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=22 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:54:37.498020 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43ccc7-60c1-4e64-af83-3ce18c2d89e3 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:37.498628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43ccc7-60c1-4e64-af83-3ce18c2d89e3 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:37.498628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43ccc7-60c1-4e64-af83-3ce18c2d89e3 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:37.499938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 695/1410] 10.222.0.15 () {54 vars in 918 bytes} [Thu Jun 2 18:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:37.505263 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560ff5a-e2d1-4451-921a-e29965b32202 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:37.505731 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560ff5a-e2d1-4451-921a-e29965b32202 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:37.505866 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560ff5a-e2d1-4451-921a-e29965b32202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:37.531366 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9560ff5a-e2d1-4451-921a-e29965b32202 None None] MFA Rules not processed for user `11a4152a82e1486887541afab2d4e5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:37.532582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9560ff5a-e2d1-4451-921a-e29965b32202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:37.544158 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 716/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Jun 2 18:54:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:37.559690 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de217328-ff53-4dcc-b584-3bc0d785e5a8 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:37.560000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de217328-ff53-4dcc-b584-3bc0d785e5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:37.560274 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de217328-ff53-4dcc-b584-3bc0d785e5a8 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:37.562390 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 696/1412] 10.222.0.15 () {54 vars in 918 bytes} [Thu Jun 2 18:54:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:37.567252 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b60e2-ef80-43b8-940b-4b8e721d9475 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:37.567541 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b60e2-ef80-43b8-940b-4b8e721d9475 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:37.567816 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b60e2-ef80-43b8-940b-4b8e721d9475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:37.587736 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-0b4b60e2-ef80-43b8-940b-4b8e721d9475 None None] MFA Rules not processed for user `6b8ff9f5032e498db3c70c79cc11989b`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:37.588929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-0b4b60e2-ef80-43b8-940b-4b8e721d9475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:37.598984 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 717/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Jun 2 18:54:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:40.389841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1cd0e-cb15-428d-b9c2-1ffaa8309d60 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:40.390424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1cd0e-cb15-428d-b9c2-1ffaa8309d60 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:40.390424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1cd0e-cb15-428d-b9c2-1ffaa8309d60 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:40.391806 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 18:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:40.398313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e6a41-9236-45b1-9865-1910f40c0fce None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:40.399025 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e6a41-9236-45b1-9865-1910f40c0fce None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:40.399206 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e6a41-9236-45b1-9865-1910f40c0fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:40.428953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e93e6a41-9236-45b1-9865-1910f40c0fce None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:40.430186 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e93e6a41-9236-45b1-9865-1910f40c0fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:40.439573 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 18:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:40.490787 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1cd0e-cb15-428d-b9c2-1ffaa8309d60 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:40.506983 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1cd0e-cb15-428d-b9c2-1ffaa8309d60 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:40.513932 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cc4e4-df0e-4b4f-ab29-f8480c2ccef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:40.514574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cc4e4-df0e-4b4f-ab29-f8480c2ccef0 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:40.514883 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cc4e4-df0e-4b4f-ab29-f8480c2ccef0 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:40.515155 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cc4e4-df0e-4b4f-ab29-f8480c2ccef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:40.524353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609cc4e4-df0e-4b4f-ab29-f8480c2ccef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:40.525985 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609cc4e4-df0e-4b4f-ab29-f8480c2ccef0 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:40.535813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 698/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:41.547360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57225c2e-ac60-4419-b2d3-9bedbedf3eea None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:41.547905 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57225c2e-ac60-4419-b2d3-9bedbedf3eea None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:41.547905 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57225c2e-ac60-4419-b2d3-9bedbedf3eea None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:41.549265 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 18:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:41.557225 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa96cc5-ee01-4ef0-baa8-360d0ea745ea None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:41.557696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa96cc5-ee01-4ef0-baa8-360d0ea745ea None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:41.557843 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa96cc5-ee01-4ef0-baa8-360d0ea745ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:41.581267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-7fa96cc5-ee01-4ef0-baa8-360d0ea745ea None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:41.582500 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7fa96cc5-ee01-4ef0-baa8-360d0ea745ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:41.591796 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 18:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:41.761858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57225c2e-ac60-4419-b2d3-9bedbedf3eea None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:41.781991 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57225c2e-ac60-4419-b2d3-9bedbedf3eea None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:41.788243 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb906821-6c63-4e8f-aa30-7b112c3d8108 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:41.788903 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb906821-6c63-4e8f-aa30-7b112c3d8108 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:41.789180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb906821-6c63-4e8f-aa30-7b112c3d8108 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:41.789450 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb906821-6c63-4e8f-aa30-7b112c3d8108 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:41.797758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb906821-6c63-4e8f-aa30-7b112c3d8108 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:41.799355 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb906821-6c63-4e8f-aa30-7b112c3d8108 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:41.809282 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 720/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:42.756506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32016f-8285-4702-b5c8-2b5b7d460e2e None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:42.757168 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32016f-8285-4702-b5c8-2b5b7d460e2e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:42.757168 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32016f-8285-4702-b5c8-2b5b7d460e2e None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:42.758457 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 18:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:42.764593 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250e440-644e-4f31-ae10-df4a889a34dd None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:42.765331 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250e440-644e-4f31-ae10-df4a889a34dd None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:42.765505 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250e440-644e-4f31-ae10-df4a889a34dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:42.793754 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-2250e440-644e-4f31-ae10-df4a889a34dd None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:42.795468 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2250e440-644e-4f31-ae10-df4a889a34dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:42.807495 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 18:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:42.957425 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32016f-8285-4702-b5c8-2b5b7d460e2e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:42.983982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32016f-8285-4702-b5c8-2b5b7d460e2e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:42.993528 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4653bf-5202-4499-8c6d-abf11edebf7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:42.994542 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4653bf-5202-4499-8c6d-abf11edebf7d service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:42.994899 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4653bf-5202-4499-8c6d-abf11edebf7d service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:42.995239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4653bf-5202-4499-8c6d-abf11edebf7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:43.012260 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4653bf-5202-4499-8c6d-abf11edebf7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:43.014550 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4653bf-5202-4499-8c6d-abf11edebf7d service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:43.024707 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 701/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:43.957271 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df037956-167d-43eb-9056-32e30fe69074 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:43.957875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df037956-167d-43eb-9056-32e30fe69074 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:43.957875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df037956-167d-43eb-9056-32e30fe69074 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:43.959230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 18:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:43.964580 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beb733-fa15-4ace-827a-1f2e48259e50 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:43.965069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beb733-fa15-4ace-827a-1f2e48259e50 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:43.965069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beb733-fa15-4ace-827a-1f2e48259e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:43.985097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-03beb733-fa15-4ace-827a-1f2e48259e50 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:43.986333 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-03beb733-fa15-4ace-827a-1f2e48259e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:43.995706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 18:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:44.151816 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df037956-167d-43eb-9056-32e30fe69074 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:44.171398 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df037956-167d-43eb-9056-32e30fe69074 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:44.177493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539efbc4-3ea5-446b-8888-866283db37c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:44.178185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539efbc4-3ea5-446b-8888-866283db37c8 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:44.178586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539efbc4-3ea5-446b-8888-866283db37c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:44.178862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539efbc4-3ea5-446b-8888-866283db37c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:44.187344 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539efbc4-3ea5-446b-8888-866283db37c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:44.188944 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539efbc4-3ea5-446b-8888-866283db37c8 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:44.198918 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 723/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:45.132058 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45a57c-cc5e-422f-90be-d7aabcee8322 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:45.132794 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45a57c-cc5e-422f-90be-d7aabcee8322 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:45.133052 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45a57c-cc5e-422f-90be-d7aabcee8322 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:45.134389 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 18:54:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:45.142582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0e54f-a1c1-4a6c-9ce8-5a4595e372f3 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:45.143245 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0e54f-a1c1-4a6c-9ce8-5a4595e372f3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:45.143354 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0e54f-a1c1-4a6c-9ce8-5a4595e372f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:45.170423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-7be0e54f-a1c1-4a6c-9ce8-5a4595e372f3 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:45.171650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7be0e54f-a1c1-4a6c-9ce8-5a4595e372f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:45.181173 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 18:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:45.334051 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45a57c-cc5e-422f-90be-d7aabcee8322 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:45.356492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45a57c-cc5e-422f-90be-d7aabcee8322 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:45.363082 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e18162-d900-4d88-b0a5-aa08ad7e4dbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:45.363717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e18162-d900-4d88-b0a5-aa08ad7e4dbd service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:45.363998 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e18162-d900-4d88-b0a5-aa08ad7e4dbd service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:45.364276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e18162-d900-4d88-b0a5-aa08ad7e4dbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:45.373008 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e18162-d900-4d88-b0a5-aa08ad7e4dbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:45.374658 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e18162-d900-4d88-b0a5-aa08ad7e4dbd service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:45.384542 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 704/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:46.240763 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66451d7c-d4ae-4d31-b6be-d0ac3c1f6ef2 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:46.241339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66451d7c-d4ae-4d31-b6be-d0ac3c1f6ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:46.241339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66451d7c-d4ae-4d31-b6be-d0ac3c1f6ef2 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:46.243253 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 18:54:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:46.248494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c4ff0-5a1d-4553-85dd-1fdd8244e4f0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:46.248942 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c4ff0-5a1d-4553-85dd-1fdd8244e4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:46.249047 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c4ff0-5a1d-4553-85dd-1fdd8244e4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:46.268145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-aa6c4ff0-5a1d-4553-85dd-1fdd8244e4f0 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:46.269342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-aa6c4ff0-5a1d-4553-85dd-1fdd8244e4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:46.277918 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 18:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:46.431179 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66451d7c-d4ae-4d31-b6be-d0ac3c1f6ef2 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:46.447849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66451d7c-d4ae-4d31-b6be-d0ac3c1f6ef2 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:46.454317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e3505-18ef-4b2f-ba54-c59b0aa9f76e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:46.454954 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e3505-18ef-4b2f-ba54-c59b0aa9f76e service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:46.455234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e3505-18ef-4b2f-ba54-c59b0aa9f76e service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:46.455514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e3505-18ef-4b2f-ba54-c59b0aa9f76e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:46.464280 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e3505-18ef-4b2f-ba54-c59b0aa9f76e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:46.465894 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e3505-18ef-4b2f-ba54-c59b0aa9f76e service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:46.475469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 726/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:47.323107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dce7bd-d303-48d8-94e1-e8b8a6723ddf None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:47.324059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dce7bd-d303-48d8-94e1-e8b8a6723ddf None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:47.324059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dce7bd-d303-48d8-94e1-e8b8a6723ddf None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:47.326381 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 18:54:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:47.335407 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04828edf-03a2-4c43-8394-866ef487f206 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:47.336469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04828edf-03a2-4c43-8394-866ef487f206 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:47.336843 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04828edf-03a2-4c43-8394-866ef487f206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:47.363322 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-04828edf-03a2-4c43-8394-866ef487f206 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:47.364530 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-04828edf-03a2-4c43-8394-866ef487f206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:47.374148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 18:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:47.527175 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dce7bd-d303-48d8-94e1-e8b8a6723ddf None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:47.548042 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dce7bd-d303-48d8-94e1-e8b8a6723ddf None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:47.554626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f851c3c-d0c0-459a-9c4a-7b3e7e7f8a63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:47.555283 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f851c3c-d0c0-459a-9c4a-7b3e7e7f8a63 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:47.555564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f851c3c-d0c0-459a-9c4a-7b3e7e7f8a63 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:47.555838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f851c3c-d0c0-459a-9c4a-7b3e7e7f8a63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:47.563994 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f851c3c-d0c0-459a-9c4a-7b3e7e7f8a63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:47.565584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f851c3c-d0c0-459a-9c4a-7b3e7e7f8a63 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:47.576094 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 707/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:48.424506 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2a52e-6a9c-4817-a874-47910bb6d7ed None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:48.425090 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2a52e-6a9c-4817-a874-47910bb6d7ed None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:48.425090 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2a52e-6a9c-4817-a874-47910bb6d7ed None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:48.426442 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 18:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:48.432433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af2ffe-a30d-4527-9797-080a54c8786c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:48.432867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af2ffe-a30d-4527-9797-080a54c8786c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:48.432980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af2ffe-a30d-4527-9797-080a54c8786c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:48.453328 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d0af2ffe-a30d-4527-9797-080a54c8786c None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:48.454546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d0af2ffe-a30d-4527-9797-080a54c8786c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:48.463644 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 18:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:48.615652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2a52e-6a9c-4817-a874-47910bb6d7ed None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:48.633768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2a52e-6a9c-4817-a874-47910bb6d7ed None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:48.643095 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb2518-6187-4794-b58b-544937cd45d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:48.643962 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb2518-6187-4794-b58b-544937cd45d1 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:48.644314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb2518-6187-4794-b58b-544937cd45d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:48.644600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb2518-6187-4794-b58b-544937cd45d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:48.654688 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb2518-6187-4794-b58b-544937cd45d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:48.656279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb2518-6187-4794-b58b-544937cd45d1 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:48.678556 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 729/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:49.562704 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096f375-1d1f-4449-b133-92e63eae4761 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:49.563191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096f375-1d1f-4449-b133-92e63eae4761 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:49.563288 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096f375-1d1f-4449-b133-92e63eae4761 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:49.564664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 18:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:49.569837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41934c8-3d4e-4664-98bd-04fcfc4c9beb None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:49.570267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41934c8-3d4e-4664-98bd-04fcfc4c9beb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:49.570456 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41934c8-3d4e-4664-98bd-04fcfc4c9beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:49.593987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c41934c8-3d4e-4664-98bd-04fcfc4c9beb None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:49.595188 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c41934c8-3d4e-4664-98bd-04fcfc4c9beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:49.605709 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 18:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:49.754051 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096f375-1d1f-4449-b133-92e63eae4761 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:49.772142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096f375-1d1f-4449-b133-92e63eae4761 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:49.780688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080778fb-a8cd-4492-8628-db67e0dfbfb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:49.781682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080778fb-a8cd-4492-8628-db67e0dfbfb8 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:49.782139 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080778fb-a8cd-4492-8628-db67e0dfbfb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:49.782525 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080778fb-a8cd-4492-8628-db67e0dfbfb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:49.793539 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080778fb-a8cd-4492-8628-db67e0dfbfb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:49.795111 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080778fb-a8cd-4492-8628-db67e0dfbfb8 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:49.805446 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 710/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:51.936632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cc1b5-871a-466e-b23d-f061399645a8 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:51.937196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cc1b5-871a-466e-b23d-f061399645a8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:51.937196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cc1b5-871a-466e-b23d-f061399645a8 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:51.939354 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 18:54:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:51.947525 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391b9b5-f596-4f65-8177-a73962a34094 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:51.948030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391b9b5-f596-4f65-8177-a73962a34094 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:51.948145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391b9b5-f596-4f65-8177-a73962a34094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:51.966874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e391b9b5-f596-4f65-8177-a73962a34094 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:51.968111 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e391b9b5-f596-4f65-8177-a73962a34094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:51.977066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 18:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 18:54:52.019470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cc1b5-871a-466e-b23d-f061399645a8 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:52.038895 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cc1b5-871a-466e-b23d-f061399645a8 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:52.043521 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638780c2-51e2-44d7-a25b-f50d6001626b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:52.044156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638780c2-51e2-44d7-a25b-f50d6001626b service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:52.044430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638780c2-51e2-44d7-a25b-f50d6001626b service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:52.044697 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638780c2-51e2-44d7-a25b-f50d6001626b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:52.054624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638780c2-51e2-44d7-a25b-f50d6001626b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:52.056057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638780c2-51e2-44d7-a25b-f50d6001626b service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:52.065941 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 732/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:54.477774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305837d-df20-4fe7-ae1f-9a8beee7c974 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:54.478739 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305837d-df20-4fe7-ae1f-9a8beee7c974 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:54.478739 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305837d-df20-4fe7-ae1f-9a8beee7c974 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:54.481016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 18:54:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:54.487574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7d5e2-6669-46d5-8e74-10beddd65cd8 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:54.488017 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7d5e2-6669-46d5-8e74-10beddd65cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:54.488109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7d5e2-6669-46d5-8e74-10beddd65cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:54.509737 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6cd7d5e2-6669-46d5-8e74-10beddd65cd8 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:54.510985 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6cd7d5e2-6669-46d5-8e74-10beddd65cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:54.520582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 18:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:54.559842 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305837d-df20-4fe7-ae1f-9a8beee7c974 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:54.575430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305837d-df20-4fe7-ae1f-9a8beee7c974 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:54.582061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81942ef-6acb-4d53-8a9a-1c92e23dc629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:54.582950 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81942ef-6acb-4d53-8a9a-1c92e23dc629 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:54.583307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81942ef-6acb-4d53-8a9a-1c92e23dc629 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:54.583654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81942ef-6acb-4d53-8a9a-1c92e23dc629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:54.594312 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81942ef-6acb-4d53-8a9a-1c92e23dc629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:54.595753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81942ef-6acb-4d53-8a9a-1c92e23dc629 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:54.605066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 713/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:54:57.181555 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e9e19-95e9-41f2-8dc9-c1c00bae1009 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:57.182630 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e9e19-95e9-41f2-8dc9-c1c00bae1009 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:57.182630 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e9e19-95e9-41f2-8dc9-c1c00bae1009 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:57.184643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 18:54:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:57.193715 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f05981-a8db-41e9-a503-99299d135a6c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:57.194189 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f05981-a8db-41e9-a503-99299d135a6c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:57.194379 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f05981-a8db-41e9-a503-99299d135a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:57.213778 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-25f05981-a8db-41e9-a503-99299d135a6c None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:57.215016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-25f05981-a8db-41e9-a503-99299d135a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:57.223887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 18:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:57.264767 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e9e19-95e9-41f2-8dc9-c1c00bae1009 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:57.276526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e9e19-95e9-41f2-8dc9-c1c00bae1009 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:57.280524 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9730bf3-b69c-4480-891d-9ea2a9bcfa79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:57.281165 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9730bf3-b69c-4480-891d-9ea2a9bcfa79 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:57.281468 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9730bf3-b69c-4480-891d-9ea2a9bcfa79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:57.281738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9730bf3-b69c-4480-891d-9ea2a9bcfa79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:57.291419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9730bf3-b69c-4480-891d-9ea2a9bcfa79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:57.292842 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9730bf3-b69c-4480-891d-9ea2a9bcfa79 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:57.302593 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 735/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 18:54:59.697772 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6eb341-b3f4-45d8-b579-1254ee3ee319 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:59.698381 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6eb341-b3f4-45d8-b579-1254ee3ee319 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:59.698381 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6eb341-b3f4-45d8-b579-1254ee3ee319 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:59.700443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 18:54:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:54:59.709955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec18caa-50d6-4927-92c0-474357e730c7 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:59.710679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec18caa-50d6-4927-92c0-474357e730c7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:59.711005 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec18caa-50d6-4927-92c0-474357e730c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:59.730163 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9ec18caa-50d6-4927-92c0-474357e730c7 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:54:59.731366 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9ec18caa-50d6-4927-92c0-474357e730c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:54:59.740515 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 18:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:54:59.781646 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6eb341-b3f4-45d8-b579-1254ee3ee319 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:54:59.793720 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6eb341-b3f4-45d8-b579-1254ee3ee319 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:54:59.798094 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cfa74-3570-4314-8aab-6ca9c5dd3586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:54:59.798695 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cfa74-3570-4314-8aab-6ca9c5dd3586 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:54:59.798992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cfa74-3570-4314-8aab-6ca9c5dd3586 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:54:59.799260 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cfa74-3570-4314-8aab-6ca9c5dd3586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:54:59.808744 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cfa74-3570-4314-8aab-6ca9c5dd3586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:54:59.810221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cfa74-3570-4314-8aab-6ca9c5dd3586 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:54:59.819618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 716/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 18:55:02.153406 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6fa6b-9fb9-416b-af7c-6d09aa1390bb None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:02.155232 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6fa6b-9fb9-416b-af7c-6d09aa1390bb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:02.155232 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6fa6b-9fb9-416b-af7c-6d09aa1390bb None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:02.156444 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 18:55:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:55:02.163263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059c39f-7cbb-42af-8b1b-994a3d0e0c81 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:02.164743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059c39f-7cbb-42af-8b1b-994a3d0e0c81 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:02.164743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059c39f-7cbb-42af-8b1b-994a3d0e0c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:02.188333 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-5059c39f-7cbb-42af-8b1b-994a3d0e0c81 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:55:02.189538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5059c39f-7cbb-42af-8b1b-994a3d0e0c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:55:02.198420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 18:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:55:02.241143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6fa6b-9fb9-416b-af7c-6d09aa1390bb None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:55:02.254715 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6fa6b-9fb9-416b-af7c-6d09aa1390bb None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:55:02.260124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d80d4-e5e7-4076-adc5-d4ad0505b6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:55:02.261054 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d80d4-e5e7-4076-adc5-d4ad0505b6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:02.261411 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d80d4-e5e7-4076-adc5-d4ad0505b6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:02.261782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d80d4-e5e7-4076-adc5-d4ad0505b6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:02.275704 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d80d4-e5e7-4076-adc5-d4ad0505b6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:55:02.277722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d80d4-e5e7-4076-adc5-d4ad0505b6b4 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:55:02.289666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 738/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:55:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:55:04.624913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94b467-1700-4088-94a1-09a316bd162f None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:04.625620 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94b467-1700-4088-94a1-09a316bd162f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:04.625620 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94b467-1700-4088-94a1-09a316bd162f None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:04.627610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 18:55:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:55:04.635123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20c075-1581-44cb-b4e2-4240dae03174 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:04.635579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20c075-1581-44cb-b4e2-4240dae03174 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:04.635704 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20c075-1581-44cb-b4e2-4240dae03174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:04.654653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-cb20c075-1581-44cb-b4e2-4240dae03174 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:55:04.655852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-cb20c075-1581-44cb-b4e2-4240dae03174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:55:04.666112 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 18:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 18:55:04.713477 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94b467-1700-4088-94a1-09a316bd162f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:55:04.726020 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94b467-1700-4088-94a1-09a316bd162f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:55:04.730580 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac08d70-032b-4c34-861b-3ec1a5e8d09d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:55:04.731233 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08d70-032b-4c34-861b-3ec1a5e8d09d service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:04.731508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08d70-032b-4c34-861b-3ec1a5e8d09d service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:04.731777 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08d70-032b-4c34-861b-3ec1a5e8d09d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:04.741939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac08d70-032b-4c34-861b-3ec1a5e8d09d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:55:04.743401 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac08d70-032b-4c34-861b-3ec1a5e8d09d service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:55:04.752882 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 719/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:55:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:55:07.041756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028451bf-e25c-41ca-8c22-f0a605b1e016 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:07.042343 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028451bf-e25c-41ca-8c22-f0a605b1e016 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:07.042343 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028451bf-e25c-41ca-8c22-f0a605b1e016 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:07.043647 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 18:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:55:07.050168 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ae917-52fe-4e43-a431-802c76061c3d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:07.050872 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ae917-52fe-4e43-a431-802c76061c3d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:07.051051 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ae917-52fe-4e43-a431-802c76061c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:07.062122 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=70 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:55:07.079007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-7e7ae917-52fe-4e43-a431-802c76061c3d None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:55:07.080226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7e7ae917-52fe-4e43-a431-802c76061c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:55:07.090033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 18:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:55:07.128269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028451bf-e25c-41ca-8c22-f0a605b1e016 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:55:07.136021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=73 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:55:07.142851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028451bf-e25c-41ca-8c22-f0a605b1e016 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:55:07.146840 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf42e6-e533-434d-bcb0-42b7f40505a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:55:07.147478 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf42e6-e533-434d-bcb0-42b7f40505a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:07.148198 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf42e6-e533-434d-bcb0-42b7f40505a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:07.148324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf42e6-e533-434d-bcb0-42b7f40505a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:07.157528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf42e6-e533-434d-bcb0-42b7f40505a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:55:07.158982 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf42e6-e533-434d-bcb0-42b7f40505a0 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:55:07.168511 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 741/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:55:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:55:09.494772 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86019b-1e59-4be6-9a36-364191fa8b35 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:09.495720 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86019b-1e59-4be6-9a36-364191fa8b35 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:09.495720 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86019b-1e59-4be6-9a36-364191fa8b35 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:09.497950 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 18:55:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:55:09.503453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511778d-2c9f-42ff-9246-ed77331f03e3 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:09.503875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511778d-2c9f-42ff-9246-ed77331f03e3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:09.503989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511778d-2c9f-42ff-9246-ed77331f03e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:09.527496 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-7511778d-2c9f-42ff-9246-ed77331f03e3 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:55:09.528699 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7511778d-2c9f-42ff-9246-ed77331f03e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:55:09.536980 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 18:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:55:09.574399 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86019b-1e59-4be6-9a36-364191fa8b35 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:55:09.586888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86019b-1e59-4be6-9a36-364191fa8b35 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:55:09.590818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318fba1-c735-4cbe-a6c7-79fc91e6141c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:55:09.591461 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318fba1-c735-4cbe-a6c7-79fc91e6141c service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:09.591743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318fba1-c735-4cbe-a6c7-79fc91e6141c service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:09.592017 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318fba1-c735-4cbe-a6c7-79fc91e6141c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:09.602234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318fba1-c735-4cbe-a6c7-79fc91e6141c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:55:09.603679 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318fba1-c735-4cbe-a6c7-79fc91e6141c service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:55:09.613120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 722/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:55:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:55:11.873395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a104d5f-0bd3-4878-bf91-72e324cccaf3 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:11.874337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a104d5f-0bd3-4878-bf91-72e324cccaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:11.874337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a104d5f-0bd3-4878-bf91-72e324cccaf3 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:11.876346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 18:55:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:55:11.882860 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed6181-fee6-47c8-807c-abf7cb903204 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:11.883330 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed6181-fee6-47c8-807c-abf7cb903204 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:11.883429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed6181-fee6-47c8-807c-abf7cb903204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:11.907867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d1ed6181-fee6-47c8-807c-abf7cb903204 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:55:11.909083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d1ed6181-fee6-47c8-807c-abf7cb903204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:55:11.918186 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 18:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:55:11.954309 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a104d5f-0bd3-4878-bf91-72e324cccaf3 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:55:11.966165 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a104d5f-0bd3-4878-bf91-72e324cccaf3 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:55:11.969729 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90b5ae-3599-46c8-9be7-2f62423fa3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:55:11.970392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90b5ae-3599-46c8-9be7-2f62423fa3ef service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:11.970669 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90b5ae-3599-46c8-9be7-2f62423fa3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:11.970939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90b5ae-3599-46c8-9be7-2f62423fa3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:11.980568 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90b5ae-3599-46c8-9be7-2f62423fa3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:55:11.982039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90b5ae-3599-46c8-9be7-2f62423fa3ef service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:55:11.991113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 744/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:55:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:55:14.266097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05327072-f12e-4b3d-8896-d5e630747580 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:14.266990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05327072-f12e-4b3d-8896-d5e630747580 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:14.266990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05327072-f12e-4b3d-8896-d5e630747580 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:14.269367 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 18:55:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:55:14.275680 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ee01d-68ef-43b9-b4b9-e45a900643bb None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:14.276208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ee01d-68ef-43b9-b4b9-e45a900643bb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:14.276208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ee01d-68ef-43b9-b4b9-e45a900643bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:14.298674 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-368ee01d-68ef-43b9-b4b9-e45a900643bb None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:55:14.299873 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-368ee01d-68ef-43b9-b4b9-e45a900643bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:55:14.308955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 18:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:55:14.348837 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05327072-f12e-4b3d-8896-d5e630747580 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:55:14.361481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05327072-f12e-4b3d-8896-d5e630747580 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:55:14.365498 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1a47a-496c-4903-bcb1-962ee981e450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:55:14.366202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1a47a-496c-4903-bcb1-962ee981e450 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:14.366482 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1a47a-496c-4903-bcb1-962ee981e450 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:14.366750 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1a47a-496c-4903-bcb1-962ee981e450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:14.375910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1a47a-496c-4903-bcb1-962ee981e450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:55:14.377358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1a47a-496c-4903-bcb1-962ee981e450 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:55:14.386917 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 725/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:55:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:55:24.293194 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=17 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:55:24.382736 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=17 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:55:45.892956 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d2aab-a309-4240-b7af-c2fb3e7dc9c7 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:45.893573 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d2aab-a309-4240-b7af-c2fb3e7dc9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:45.893573 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d2aab-a309-4240-b7af-c2fb3e7dc9c7 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:45.894955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 746/1471] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:55:45.900655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242d762-3cf5-41a5-a072-412d3703b30b None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:45.901109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242d762-3cf5-41a5-a072-412d3703b30b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:45.901212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242d762-3cf5-41a5-a072-412d3703b30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:45.920156 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8242d762-3cf5-41a5-a072-412d3703b30b None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:55:45.921337 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8242d762-3cf5-41a5-a072-412d3703b30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:55:45.932739 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 726/1472] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:55:45.982006 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac1e2-fa6f-4cda-b17b-168adf7136ac None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:45.982410 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac1e2-fa6f-4cda-b17b-168adf7136ac None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:45.982819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac1e2-fa6f-4cda-b17b-168adf7136ac None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:45.984947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 747/1473] 10.222.0.15 () {54 vars in 962 bytes} [Thu Jun 2 18:55:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 18:55:45.990025 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b947f-e965-487b-8cef-4d2fbc8c989a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:45.990317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b947f-e965-487b-8cef-4d2fbc8c989a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:45.990597 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b947f-e965-487b-8cef-4d2fbc8c989a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:46.011194 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-6b5b947f-e965-487b-8cef-4d2fbc8c989a None None] MFA Rules not processed for user `8a1b010003c44dc19643558167424d13`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:55:46.012408 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6b5b947f-e965-487b-8cef-4d2fbc8c989a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:55:46.020288 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 727/1474] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Jun 2 18:55:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:55:46.027771 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbac1e2-fa6f-4cda-b17b-168adf7136ac None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:55:46.039973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbac1e2-fa6f-4cda-b17b-168adf7136ac None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:55:46.043884 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c047b-31f7-4d3a-a008-edf3bb80a8d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1b010003c44dc19643558167424d13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:55:46.044513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c047b-31f7-4d3a-a008-edf3bb80a8d0 service glance] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:46.044786 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c047b-31f7-4d3a-a008-edf3bb80a8d0 service glance] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:46.045063 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c047b-31f7-4d3a-a008-edf3bb80a8d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:46.054672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c047b-31f7-4d3a-a008-edf3bb80a8d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:55:46.056100 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c047b-31f7-4d3a-a008-edf3bb80a8d0 service glance] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:55:46.065854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 748/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:55:48.382293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978135fb-0ac5-4ced-bcc2-263fb9a58932 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:48.382904 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978135fb-0ac5-4ced-bcc2-263fb9a58932 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:48.382904 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978135fb-0ac5-4ced-bcc2-263fb9a58932 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:48.384270 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 728/1476] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:55:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:55:48.389784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323bd2f-fbb8-406b-a50e-a5613bc19f2d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:48.390253 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323bd2f-fbb8-406b-a50e-a5613bc19f2d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:48.390346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323bd2f-fbb8-406b-a50e-a5613bc19f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:48.408758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d323bd2f-fbb8-406b-a50e-a5613bc19f2d None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:55:48.409972 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d323bd2f-fbb8-406b-a50e-a5613bc19f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:55:48.418162 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 749/1477] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:55:48.441390 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978135fb-0ac5-4ced-bcc2-263fb9a58932 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:55:48.458284 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978135fb-0ac5-4ced-bcc2-263fb9a58932 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:55:48.463956 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f36d17-f3de-4f01-ad3a-4cf0d75c47e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:55:48.464613 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36d17-f3de-4f01-ad3a-4cf0d75c47e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:48.464891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36d17-f3de-4f01-ad3a-4cf0d75c47e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:48.465161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36d17-f3de-4f01-ad3a-4cf0d75c47e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:48.465925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f36d17-f3de-4f01-ad3a-4cf0d75c47e8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:55:48.467741 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: WARNING py.warnings [None req-25f36d17-f3de-4f01-ad3a-4cf0d75c47e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 18:55:48.467741 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: warnings.warn(msg) Jun 02 18:55:48.467741 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: Jun 02 18:55:48.468873 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f36d17-f3de-4f01-ad3a-4cf0d75c47e8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:55:48.488442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 729/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 2 18:55:48 2022] GET /identity/v3/projects => generated 2553 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 18:55:50.802770 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fc244-8391-4e1f-9887-fc94c64a97da None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:50.803462 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fc244-8391-4e1f-9887-fc94c64a97da None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:50.803804 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fc244-8391-4e1f-9887-fc94c64a97da None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:50.805224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 750/1479] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:55:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:55:50.811696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cff793-18fa-4dcc-b8c7-143e43ddc938 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:50.812485 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cff793-18fa-4dcc-b8c7-143e43ddc938 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:50.812657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cff793-18fa-4dcc-b8c7-143e43ddc938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:50.840241 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a6cff793-18fa-4dcc-b8c7-143e43ddc938 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:55:50.841456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a6cff793-18fa-4dcc-b8c7-143e43ddc938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:55:50.850773 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 730/1480] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:55:50.899124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fc244-8391-4e1f-9887-fc94c64a97da None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:55:50.914238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fc244-8391-4e1f-9887-fc94c64a97da None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:55:50.919791 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d41b47-7c2c-4e6a-9bd5-58ccc30c8078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:55:50.920432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d41b47-7c2c-4e6a-9bd5-58ccc30c8078 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:50.920705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d41b47-7c2c-4e6a-9bd5-58ccc30c8078 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:50.920972 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d41b47-7c2c-4e6a-9bd5-58ccc30c8078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:50.929832 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d41b47-7c2c-4e6a-9bd5-58ccc30c8078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:55:50.931406 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d41b47-7c2c-4e6a-9bd5-58ccc30c8078 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:55:50.941229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 751/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:55:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:55:53.369526 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b36a02-cc2b-41aa-a49e-25b1d42ff623 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:53.370493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b36a02-cc2b-41aa-a49e-25b1d42ff623 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:53.370493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b36a02-cc2b-41aa-a49e-25b1d42ff623 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:53.372721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 731/1482] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:55:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:55:53.379279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40f07e-5270-4633-85a4-3665df0ba2fb None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:53.380003 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40f07e-5270-4633-85a4-3665df0ba2fb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:53.380162 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40f07e-5270-4633-85a4-3665df0ba2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:53.399911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9e40f07e-5270-4633-85a4-3665df0ba2fb None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:55:53.401135 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9e40f07e-5270-4633-85a4-3665df0ba2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:55:53.410779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 752/1483] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:55:53.447940 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b36a02-cc2b-41aa-a49e-25b1d42ff623 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:55:53.462116 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b36a02-cc2b-41aa-a49e-25b1d42ff623 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:55:53.466334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451912d9-d4dd-49fc-9464-624a53f11744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:55:53.467002 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451912d9-d4dd-49fc-9464-624a53f11744 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:53.467281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451912d9-d4dd-49fc-9464-624a53f11744 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:53.467572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451912d9-d4dd-49fc-9464-624a53f11744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:53.477303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451912d9-d4dd-49fc-9464-624a53f11744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:55:53.478772 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451912d9-d4dd-49fc-9464-624a53f11744 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:55:53.488466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 732/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:55:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:55:55.778593 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdf8db-d3e2-4106-94ad-6b8015908645 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:55.779443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdf8db-d3e2-4106-94ad-6b8015908645 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:55.779443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdf8db-d3e2-4106-94ad-6b8015908645 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:55.781577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 753/1485] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:55:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:55:55.787138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70790d2b-7464-4fca-a749-e8016c0c7226 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:55.787670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70790d2b-7464-4fca-a749-e8016c0c7226 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:55.787670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70790d2b-7464-4fca-a749-e8016c0c7226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:55.806737 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-70790d2b-7464-4fca-a749-e8016c0c7226 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:55:55.807930 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-70790d2b-7464-4fca-a749-e8016c0c7226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:55:55.817664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 733/1486] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:55:55.858201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdf8db-d3e2-4106-94ad-6b8015908645 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:55:55.872211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdf8db-d3e2-4106-94ad-6b8015908645 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:55:55.879640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52e224-10ec-4afe-98be-da37f8c0658b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:55:55.880647 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52e224-10ec-4afe-98be-da37f8c0658b service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:55.881084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52e224-10ec-4afe-98be-da37f8c0658b service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:55.881543 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52e224-10ec-4afe-98be-da37f8c0658b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:55.897632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52e224-10ec-4afe-98be-da37f8c0658b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:55:55.899101 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52e224-10ec-4afe-98be-da37f8c0658b service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:55:55.909118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 754/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 18:55:58.302552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d1b04-df6e-4aa2-9482-c088e3a3644e None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:58.303190 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d1b04-df6e-4aa2-9482-c088e3a3644e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:58.303190 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d1b04-df6e-4aa2-9482-c088e3a3644e None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:58.304639 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 734/1488] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:55:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:55:58.309957 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238b558-8bd8-4277-af3c-021caec74a8d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:58.310398 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238b558-8bd8-4277-af3c-021caec74a8d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:58.310542 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238b558-8bd8-4277-af3c-021caec74a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:58.329134 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f238b558-8bd8-4277-af3c-021caec74a8d None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:55:58.330375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f238b558-8bd8-4277-af3c-021caec74a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:55:58.339202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 755/1489] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:55:58.384121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d1b04-df6e-4aa2-9482-c088e3a3644e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:55:58.397994 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d1b04-df6e-4aa2-9482-c088e3a3644e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:55:58.402185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce9867-f1f7-4d8e-bd73-7f49de428f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:55:58.402804 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce9867-f1f7-4d8e-bd73-7f49de428f45 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:55:58.403119 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce9867-f1f7-4d8e-bd73-7f49de428f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:55:58.403404 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce9867-f1f7-4d8e-bd73-7f49de428f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:55:58.413399 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce9867-f1f7-4d8e-bd73-7f49de428f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:55:58.414878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce9867-f1f7-4d8e-bd73-7f49de428f45 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:55:58.424772 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 735/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:56:00.855078 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87b139-2fd0-443a-a0bd-fe9d15641040 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:56:00.855661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87b139-2fd0-443a-a0bd-fe9d15641040 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:56:00.855661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87b139-2fd0-443a-a0bd-fe9d15641040 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:56:00.857008 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 756/1491] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 2 18:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:56:00.863502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8d957-b3ef-4404-8bdb-795d5886476c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:56:00.864280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8d957-b3ef-4404-8bdb-795d5886476c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:56:00.864459 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8d957-b3ef-4404-8bdb-795d5886476c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:56:00.890020 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-bca8d957-b3ef-4404-8bdb-795d5886476c None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:56:00.891265 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-bca8d957-b3ef-4404-8bdb-795d5886476c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:56:00.899730 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 736/1492] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 2 18:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:56:00.943126 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87b139-2fd0-443a-a0bd-fe9d15641040 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:56:00.958848 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87b139-2fd0-443a-a0bd-fe9d15641040 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:56:00.964040 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416fc66-1786-4425-ab5b-ab0d0976a1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:56:00.964684 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416fc66-1786-4425-ab5b-ab0d0976a1db service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:56:00.964962 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416fc66-1786-4425-ab5b-ab0d0976a1db service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:56:00.965229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416fc66-1786-4425-ab5b-ab0d0976a1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:56:00.976236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416fc66-1786-4425-ab5b-ab0d0976a1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:56:00.977675 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416fc66-1786-4425-ab5b-ab0d0976a1db service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:56:00.987218 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 757/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:56:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 18:56:10.884436 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=33 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:56:10.983069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=33 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:57:35.270348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9b2d9-ba1b-4ace-9341-8554d66744fd None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:57:35.270993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9b2d9-ba1b-4ace-9341-8554d66744fd None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:57:35.270993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9b2d9-ba1b-4ace-9341-8554d66744fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:57:35.292944 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-eea9b2d9-ba1b-4ace-9341-8554d66744fd None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:57:35.292944 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-eea9b2d9-ba1b-4ace-9341-8554d66744fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:57:35.301680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 737/1494] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 18:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 18:57:35.313945 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e362d-f1b9-4774-95d6-76be440eaa8a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:57:35.314576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e362d-f1b9-4774-95d6-76be440eaa8a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:57:35.314576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e362d-f1b9-4774-95d6-76be440eaa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:57:35.334513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-925e362d-f1b9-4774-95d6-76be440eaa8a None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:57:35.335780 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-925e362d-f1b9-4774-95d6-76be440eaa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:57:35.344104 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 758/1495] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 18:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:57:35.348903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9b2d9-ba1b-4ace-9341-8554d66744fd None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:57:35.359134 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9b2d9-ba1b-4ace-9341-8554d66744fd None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:57:35.364152 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e22ca4-71a7-4da2-a6cf-3ed7d4463a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:57:35.364813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e22ca4-71a7-4da2-a6cf-3ed7d4463a70 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:57:35.365096 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e22ca4-71a7-4da2-a6cf-3ed7d4463a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:57:35.365362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e22ca4-71a7-4da2-a6cf-3ed7d4463a70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:57:35.366124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e22ca4-71a7-4da2-a6cf-3ed7d4463a70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 18:57:35.366449 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e22ca4-71a7-4da2-a6cf-3ed7d4463a70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:57:35.367526 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: WARNING py.warnings [None req-00e22ca4-71a7-4da2-a6cf-3ed7d4463a70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 18:57:35.367526 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: warnings.warn(msg) Jun 02 18:57:35.367526 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: Jun 02 18:57:35.368402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e22ca4-71a7-4da2-a6cf-3ed7d4463a70 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:57:35.380838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 738/1496] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 18:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:57:35.389310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e362d-f1b9-4774-95d6-76be440eaa8a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:57:35.399374 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e362d-f1b9-4774-95d6-76be440eaa8a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:57:35.405073 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16831ded-8c9d-478a-9afe-60f2e2568dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:57:35.405750 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16831ded-8c9d-478a-9afe-60f2e2568dba admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:57:35.406064 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16831ded-8c9d-478a-9afe-60f2e2568dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:57:35.406368 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16831ded-8c9d-478a-9afe-60f2e2568dba admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:57:35.407070 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16831ded-8c9d-478a-9afe-60f2e2568dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:57:35.408881 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: WARNING py.warnings [None req-16831ded-8c9d-478a-9afe-60f2e2568dba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 18:57:35.408881 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: warnings.warn(msg) Jun 02 18:57:35.408881 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: Jun 02 18:57:35.410116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16831ded-8c9d-478a-9afe-60f2e2568dba admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:57:35.451467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 759/1497] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 18:57:35 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:57:35.456071 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e22ca4-71a7-4da2-a6cf-3ed7d4463a70 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:57:35.466790 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e22ca4-71a7-4da2-a6cf-3ed7d4463a70 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:57:35.529370 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f637824-c01f-4a07-add9-d9d722c8d701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:57:35.530058 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f637824-c01f-4a07-add9-d9d722c8d701 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:57:35.530334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f637824-c01f-4a07-add9-d9d722c8d701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:57:35.530602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f637824-c01f-4a07-add9-d9d722c8d701 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:57:35.531300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f637824-c01f-4a07-add9-d9d722c8d701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:57:35.532329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: WARNING py.warnings [None req-8f637824-c01f-4a07-add9-d9d722c8d701 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 18:57:35.532329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: warnings.warn(msg) Jun 02 18:57:35.532329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: Jun 02 18:57:35.533533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f637824-c01f-4a07-add9-d9d722c8d701 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:57:35.556166 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 739/1498] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 18:57:35 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 18:57:35.560551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16831ded-8c9d-478a-9afe-60f2e2568dba admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:57:35.572572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16831ded-8c9d-478a-9afe-60f2e2568dba admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:57:35.578657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f4c14-9c1a-48e1-8f0f-97a70c21a9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:57:35.579331 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f4c14-9c1a-48e1-8f0f-97a70c21a9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:57:35.579595 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f4c14-9c1a-48e1-8f0f-97a70c21a9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:57:35.579863 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f4c14-9c1a-48e1-8f0f-97a70c21a9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:57:35.580567 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f4c14-9c1a-48e1-8f0f-97a70c21a9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:57:35.581963 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: WARNING py.warnings [None req-d54f4c14-9c1a-48e1-8f0f-97a70c21a9d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 18:57:35.581963 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: warnings.warn(msg) Jun 02 18:57:35.581963 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: Jun 02 18:57:35.582841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f4c14-9c1a-48e1-8f0f-97a70c21a9d2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:57:35.596467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 760/1499] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 18:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 18:57:35.601181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f637824-c01f-4a07-add9-d9d722c8d701 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:57:35.612007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f637824-c01f-4a07-add9-d9d722c8d701 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:57:35.617081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ef44c-d383-456b-8e11-64720a027d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:57:35.617756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ef44c-d383-456b-8e11-64720a027d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:57:35.618062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ef44c-d383-456b-8e11-64720a027d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:57:35.618336 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ef44c-d383-456b-8e11-64720a027d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:57:35.619142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ef44c-d383-456b-8e11-64720a027d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:57:35.620165 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: WARNING py.warnings [None req-9a8ef44c-d383-456b-8e11-64720a027d42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 18:57:35.620165 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: warnings.warn(msg) Jun 02 18:57:35.620165 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: Jun 02 18:57:35.624545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ef44c-d383-456b-8e11-64720a027d42 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:57:35.640301 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 740/1500] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 18:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 18:57:35.645044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f4c14-9c1a-48e1-8f0f-97a70c21a9d2 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:57:35.656896 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f4c14-9c1a-48e1-8f0f-97a70c21a9d2 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:57:35.663299 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15dd114-eb41-4e65-bb41-fb718b668743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:57:35.664675 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dd114-eb41-4e65-bb41-fb718b668743 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:57:35.664960 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dd114-eb41-4e65-bb41-fb718b668743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:57:35.665264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dd114-eb41-4e65-bb41-fb718b668743 admin admin] PATH_INFO: `/v3/projects/a6ebc5456aac450397b949d529025684/users/2447184454ea4cddb36e4c678d355381/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:57:35.683097 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15dd114-eb41-4e65-bb41-fb718b668743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ebc5456aac450397b949d529025684, user_id=2447184454ea4cddb36e4c678d355381, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:57:35.684146 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: WARNING py.warnings [None req-b15dd114-eb41-4e65-bb41-fb718b668743 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 18:57:35.684146 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: warnings.warn(msg) Jun 02 18:57:35.684146 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: Jun 02 18:57:35.686228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15dd114-eb41-4e65-bb41-fb718b668743 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:57:35.705662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 761/1501] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 18:57:35 2022] PUT /identity/v3/projects/a6ebc5456aac450397b949d529025684/users/2447184454ea4cddb36e4c678d355381/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:57:35.725142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300b77a-3d0c-4d20-8754-eef57e1e6022 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:57:35.725492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300b77a-3d0c-4d20-8754-eef57e1e6022 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:57:35.726074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300b77a-3d0c-4d20-8754-eef57e1e6022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:57:35.754638 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-5300b77a-3d0c-4d20-8754-eef57e1e6022 None None] MFA Rules not processed for user `2447184454ea4cddb36e4c678d355381`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:57:35.755872 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5300b77a-3d0c-4d20-8754-eef57e1e6022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:57:35.832541 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 741/1502] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 18:57:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:57:35.847495 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d498cc-8c4d-4fca-b435-08b3cbe2b7f4 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:57:35.847761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d498cc-8c4d-4fca-b435-08b3cbe2b7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:57:35.848043 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d498cc-8c4d-4fca-b435-08b3cbe2b7f4 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:57:35.849443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 762/1503] 10.222.0.15 () {54 vars in 963 bytes} [Thu Jun 2 18:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:57:35.854720 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12986523-f00a-44cb-b7c0-5e1b9f828860 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:57:35.855005 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12986523-f00a-44cb-b7c0-5e1b9f828860 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:57:35.855300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12986523-f00a-44cb-b7c0-5e1b9f828860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:57:35.876211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-12986523-f00a-44cb-b7c0-5e1b9f828860 None None] MFA Rules not processed for user `e0141329b2cd4f668803a192d2b6cedb`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:57:35.877415 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-12986523-f00a-44cb-b7c0-5e1b9f828860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:57:35.923909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:57:35.933040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 742/1504] 10.222.0.15 () {58 vars in 1060 bytes} [Thu Jun 2 18:57:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:57:35.941208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d498cc-8c4d-4fca-b435-08b3cbe2b7f4 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:57:35.954616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d498cc-8c4d-4fca-b435-08b3cbe2b7f4 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:57:35.959150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201be1b-ea7c-476e-bd9a-756335e522ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:57:35.959800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201be1b-ea7c-476e-bd9a-756335e522ef service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:57:35.960076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201be1b-ea7c-476e-bd9a-756335e522ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:57:35.960350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201be1b-ea7c-476e-bd9a-756335e522ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:57:35.969150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201be1b-ea7c-476e-bd9a-756335e522ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:57:35.970630 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201be1b-ea7c-476e-bd9a-756335e522ef service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:57:35.979992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 763/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:57:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:57:36.025550 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58afe0d-51c9-4999-bd61-428b8a1e2b83 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:57:36.025818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58afe0d-51c9-4999-bd61-428b8a1e2b83 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:57:36.026101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58afe0d-51c9-4999-bd61-428b8a1e2b83 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:57:36.027863 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 743/1506] 10.222.0.15 () {52 vars in 829 bytes} [Thu Jun 2 18:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:57:36.031630 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201be1b-ea7c-476e-bd9a-756335e522ef service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:57:36.095885 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201be1b-ea7c-476e-bd9a-756335e522ef service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:57:36.100758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf46228-afa4-4f6c-9ac7-b8f5b4b087a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:57:36.101659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf46228-afa4-4f6c-9ac7-b8f5b4b087a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:57:36.102044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf46228-afa4-4f6c-9ac7-b8f5b4b087a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:57:36.102322 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf46228-afa4-4f6c-9ac7-b8f5b4b087a8 admin admin] PATH_INFO: `/v3/users/2447184454ea4cddb36e4c678d355381` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:57:36.103556 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf46228-afa4-4f6c-9ac7-b8f5b4b087a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2447184454ea4cddb36e4c678d355381)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:57:36.104579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: WARNING py.warnings [None req-dbf46228-afa4-4f6c-9ac7-b8f5b4b087a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 18:57:36.104579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: warnings.warn(msg) Jun 02 18:57:36.104579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: Jun 02 18:57:36.105827 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf46228-afa4-4f6c-9ac7-b8f5b4b087a8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:57:36.175942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-dbf46228-afa4-4f6c-9ac7-b8f5b4b087a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2447184454ea4cddb36e4c678d355381'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 18:57:36.176797 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-dbf46228-afa4-4f6c-9ac7-b8f5b4b087a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2447184454ea4cddb36e4c678d355381'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 18:57:36.191499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-dbf46228-afa4-4f6c-9ac7-b8f5b4b087a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2447184454ea4cddb36e4c678d355381'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 18:57:36.203115 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-dbf46228-afa4-4f6c-9ac7-b8f5b4b087a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2447184454ea4cddb36e4c678d355381'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 18:57:36.203847 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-dbf46228-afa4-4f6c-9ac7-b8f5b4b087a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2447184454ea4cddb36e4c678d355381'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 18:57:36.220772 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:57:36.230967 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 764/1507] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 18:57:36 2022] DELETE /identity/v3/users/2447184454ea4cddb36e4c678d355381 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:57:36.235745 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f9e19-7a5a-410e-aeb6-acf5511f3744 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:57:36.236031 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f9e19-7a5a-410e-aeb6-acf5511f3744 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:57:36.236306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f9e19-7a5a-410e-aeb6-acf5511f3744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:57:36.256232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-384f9e19-7a5a-410e-aeb6-acf5511f3744 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:57:36.257439 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-384f9e19-7a5a-410e-aeb6-acf5511f3744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:57:36.325774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 744/1508] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 18:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:57:36.339150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf46228-afa4-4f6c-9ac7-b8f5b4b087a8 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:57:36.340724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-dbf46228-afa4-4f6c-9ac7-b8f5b4b087a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:57:36.403986 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf46228-afa4-4f6c-9ac7-b8f5b4b087a8 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:57:36.408184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1c9ed-e9be-476b-8f18-c6f04ef930f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:57:36.408830 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1c9ed-e9be-476b-8f18-c6f04ef930f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:57:36.409114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1c9ed-e9be-476b-8f18-c6f04ef930f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:57:36.409378 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1c9ed-e9be-476b-8f18-c6f04ef930f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:57:36.419439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1c9ed-e9be-476b-8f18-c6f04ef930f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:57:36.420868 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1c9ed-e9be-476b-8f18-c6f04ef930f2 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:57:36.431252 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 765/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:57:36.841032 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f9e19-7a5a-410e-aeb6-acf5511f3744 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:57:36.842628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-384f9e19-7a5a-410e-aeb6-acf5511f3744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:57:36.854646 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f9e19-7a5a-410e-aeb6-acf5511f3744 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:57:36.859903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ed986-c5a7-446e-8c6f-2938cf7388b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:57:36.860774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ed986-c5a7-446e-8c6f-2938cf7388b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:57:36.861060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ed986-c5a7-446e-8c6f-2938cf7388b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:57:36.861349 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ed986-c5a7-446e-8c6f-2938cf7388b2 admin admin] PATH_INFO: `/v3/projects/a6ebc5456aac450397b949d529025684` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:57:36.862532 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ed986-c5a7-446e-8c6f-2938cf7388b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ebc5456aac450397b949d529025684)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:57:36.863595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: WARNING py.warnings [None req-4f7ed986-c5a7-446e-8c6f-2938cf7388b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 18:57:36.863595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: warnings.warn(msg) Jun 02 18:57:36.863595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: Jun 02 18:57:36.864782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ed986-c5a7-446e-8c6f-2938cf7388b2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:57:36.935148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4f7ed986-c5a7-446e-8c6f-2938cf7388b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ebc5456aac450397b949d529025684', 'request_id': 'req-4f7ed986-c5a7-446e-8c6f-2938cf7388b2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 18:57:36.942725 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4f7ed986-c5a7-446e-8c6f-2938cf7388b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ebc5456aac450397b949d529025684', 'request_id': 'req-4f7ed986-c5a7-446e-8c6f-2938cf7388b2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 18:57:36.956243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4f7ed986-c5a7-446e-8c6f-2938cf7388b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ebc5456aac450397b949d529025684', 'request_id': 'req-4f7ed986-c5a7-446e-8c6f-2938cf7388b2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 18:57:36.977254 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4f7ed986-c5a7-446e-8c6f-2938cf7388b2 admin admin] The token cache is being invalidate because project a6ebc5456aac450397b949d529025684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 18:57:36.977535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4f7ed986-c5a7-446e-8c6f-2938cf7388b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 18:57:36.978333 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4f7ed986-c5a7-446e-8c6f-2938cf7388b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 18:57:36.980365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 745/1510] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 18:57:36 2022] DELETE /identity/v3/projects/a6ebc5456aac450397b949d529025684 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 18:57:46.426293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:57:46.973620 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:59:14.705247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00456329-4ac7-4a6f-ac3e-d1b6c1447212 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:14.705906 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00456329-4ac7-4a6f-ac3e-d1b6c1447212 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:14.705906 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00456329-4ac7-4a6f-ac3e-d1b6c1447212 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:14.707369 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 18:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:59:14.714065 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fc0b3-5f4a-45fe-b8e8-20ad8d72c74e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:14.714725 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fc0b3-5f4a-45fe-b8e8-20ad8d72c74e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:14.714725 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fc0b3-5f4a-45fe-b8e8-20ad8d72c74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:14.740347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-6b2fc0b3-5f4a-45fe-b8e8-20ad8d72c74e None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:59:14.741641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6b2fc0b3-5f4a-45fe-b8e8-20ad8d72c74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:59:14.804948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 18:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:59:14.978641 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00456329-4ac7-4a6f-ac3e-d1b6c1447212 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:59:14.981522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-00456329-4ac7-4a6f-ac3e-d1b6c1447212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:59:15.070401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00456329-4ac7-4a6f-ac3e-d1b6c1447212 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:59:15.076595 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b983c-e186-435e-aa92-a614d5103114 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:59:15.077240 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b983c-e186-435e-aa92-a614d5103114 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:15.077515 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b983c-e186-435e-aa92-a614d5103114 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:15.077779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b983c-e186-435e-aa92-a614d5103114 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:15.086864 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b983c-e186-435e-aa92-a614d5103114 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:59:15.088482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b983c-e186-435e-aa92-a614d5103114 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:59:15.098298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 767/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:59:15.946615 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe28e7-9aef-4d85-84d1-d34026a29b22 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:15.947243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe28e7-9aef-4d85-84d1-d34026a29b22 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:15.947243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe28e7-9aef-4d85-84d1-d34026a29b22 None None] PATH_INFO: `/v3` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:15.948893 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 747/1514] 10.222.0.44 () {54 vars in 925 bytes} [Thu Jun 2 18:59:15 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 18:59:15.955782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f7769-ae5c-4415-80bc-f062400c25d6 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:15.956322 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f7769-ae5c-4415-80bc-f062400c25d6 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:15.956322 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f7769-ae5c-4415-80bc-f062400c25d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:15.976264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4c4f7769-ae5c-4415-80bc-f062400c25d6 None None] MFA Rules not processed for user `11a4152a82e1486887541afab2d4e5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:59:15.977488 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4c4f7769-ae5c-4415-80bc-f062400c25d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:59:16.015458 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46605797-9d5a-45c9-bd1f-6fca316a589f None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:16.015717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46605797-9d5a-45c9-bd1f-6fca316a589f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:16.015993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46605797-9d5a-45c9-bd1f-6fca316a589f None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:16.017435 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 748/1515] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 18:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:59:16.022125 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce0f6f-ba50-4a88-8614-aa2c49040aaf None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:16.022478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce0f6f-ba50-4a88-8614-aa2c49040aaf None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:16.022786 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce0f6f-ba50-4a88-8614-aa2c49040aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:16.041354 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b7ce0f6f-ba50-4a88-8614-aa2c49040aaf None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:59:16.043028 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 768/1516] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Jun 2 18:59:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:59:16.043295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b7ce0f6f-ba50-4a88-8614-aa2c49040aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:59:16.051851 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 749/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 18:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:59:16.210411 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f7769-ae5c-4415-80bc-f062400c25d6 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:59:16.230940 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f7769-ae5c-4415-80bc-f062400c25d6 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:59:16.238072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13507c4-b556-490a-9785-968bcabe20c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:59:16.238733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13507c4-b556-490a-9785-968bcabe20c9 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:16.239017 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13507c4-b556-490a-9785-968bcabe20c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:16.239320 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13507c4-b556-490a-9785-968bcabe20c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:16.248585 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13507c4-b556-490a-9785-968bcabe20c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:59:16.250309 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13507c4-b556-490a-9785-968bcabe20c9 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:59:16.260766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 769/1518] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:59:20.024017 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4470d8d-d943-4207-9032-9e64dcd2f9cf None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:20.024651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4470d8d-d943-4207-9032-9e64dcd2f9cf None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:20.024651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4470d8d-d943-4207-9032-9e64dcd2f9cf None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:20.025988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 750/1519] 10.222.0.15 () {54 vars in 960 bytes} [Thu Jun 2 18:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:59:20.032772 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab2eb7-e6e7-4588-9ea9-8fc2068df7a1 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:20.033265 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab2eb7-e6e7-4588-9ea9-8fc2068df7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:20.033359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab2eb7-e6e7-4588-9ea9-8fc2068df7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:20.063230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d5ab2eb7-e6e7-4588-9ea9-8fc2068df7a1 None None] MFA Rules not processed for user `11a4152a82e1486887541afab2d4e5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:59:20.064458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d5ab2eb7-e6e7-4588-9ea9-8fc2068df7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:59:20.074844 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 770/1520] 10.222.0.15 () {58 vars in 1057 bytes} [Thu Jun 2 18:59:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:59:20.086001 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4470d8d-d943-4207-9032-9e64dcd2f9cf None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:59:20.103009 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4470d8d-d943-4207-9032-9e64dcd2f9cf None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:59:20.109305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968a00c-e88b-4578-bc5d-981b1525bd25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:59:20.110111 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968a00c-e88b-4578-bc5d-981b1525bd25 service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:20.110392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968a00c-e88b-4578-bc5d-981b1525bd25 service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:20.110662 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968a00c-e88b-4578-bc5d-981b1525bd25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:20.120273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968a00c-e88b-4578-bc5d-981b1525bd25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:59:20.121923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968a00c-e88b-4578-bc5d-981b1525bd25 service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:59:20.132067 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 751/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:59:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:59:27.635908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f061c-35b1-40ac-aa76-86eedf19fbc7 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:27.636599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f061c-35b1-40ac-aa76-86eedf19fbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:27.636599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f061c-35b1-40ac-aa76-86eedf19fbc7 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:27.637847 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 18:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:59:27.643927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839374e-77d2-4ada-9d8a-162b85744d00 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:27.644444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839374e-77d2-4ada-9d8a-162b85744d00 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:27.644537 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839374e-77d2-4ada-9d8a-162b85744d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:27.663987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-7839374e-77d2-4ada-9d8a-162b85744d00 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:59:27.665322 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7839374e-77d2-4ada-9d8a-162b85744d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:59:27.675753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 18:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:59:27.835710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f061c-35b1-40ac-aa76-86eedf19fbc7 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:59:27.851425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f061c-35b1-40ac-aa76-86eedf19fbc7 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:59:27.856886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8739f4f-136d-4d9b-976a-4b2fee160024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:59:27.857536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8739f4f-136d-4d9b-976a-4b2fee160024 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:27.857835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8739f4f-136d-4d9b-976a-4b2fee160024 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:27.858110 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8739f4f-136d-4d9b-976a-4b2fee160024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:27.867589 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8739f4f-136d-4d9b-976a-4b2fee160024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:59:27.869317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8739f4f-136d-4d9b-976a-4b2fee160024 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:59:27.879934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 772/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 18:59:28.791033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd053583-cd54-43fe-9b2d-53955519d609 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:28.791875 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd053583-cd54-43fe-9b2d-53955519d609 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:28.791875 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd053583-cd54-43fe-9b2d-53955519d609 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:28.793444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 18:59:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:59:28.799343 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501f3c5-7b01-4306-9665-e05cc32934c7 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:28.800096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501f3c5-7b01-4306-9665-e05cc32934c7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:28.800278 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501f3c5-7b01-4306-9665-e05cc32934c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:28.819420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-8501f3c5-7b01-4306-9665-e05cc32934c7 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:59:28.820638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8501f3c5-7b01-4306-9665-e05cc32934c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:59:28.832595 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 18:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 18:59:28.989428 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd053583-cd54-43fe-9b2d-53955519d609 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:59:29.004221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd053583-cd54-43fe-9b2d-53955519d609 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:59:29.009872 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81746b-4b51-4b2e-a0e9-c14e0158d5df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:59:29.010525 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81746b-4b51-4b2e-a0e9-c14e0158d5df service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:29.010802 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81746b-4b51-4b2e-a0e9-c14e0158d5df service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:29.011110 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81746b-4b51-4b2e-a0e9-c14e0158d5df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:29.019759 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81746b-4b51-4b2e-a0e9-c14e0158d5df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:59:29.021370 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81746b-4b51-4b2e-a0e9-c14e0158d5df service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:59:29.031975 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 754/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:59:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:59:33.236318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd0896-9644-4376-bf6c-880d16f951aa None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:33.236913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd0896-9644-4376-bf6c-880d16f951aa None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:33.236913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd0896-9644-4376-bf6c-880d16f951aa None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:33.238389 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 18:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:59:33.245138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3bb75-3729-43be-8fc6-75c55e718d89 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:33.245722 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3bb75-3729-43be-8fc6-75c55e718d89 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:33.245722 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3bb75-3729-43be-8fc6-75c55e718d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:33.267203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-55a3bb75-3729-43be-8fc6-75c55e718d89 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:59:33.268446 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-55a3bb75-3729-43be-8fc6-75c55e718d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:59:33.277631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 18:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:59:33.316201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd0896-9644-4376-bf6c-880d16f951aa None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:59:33.323176 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d9bd0896-9644-4376-bf6c-880d16f951aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:59:33.378138 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:59:33.391996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd0896-9644-4376-bf6c-880d16f951aa None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:59:33.397120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222eb8f-793a-4163-93d8-6a08c7959735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:59:33.397782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222eb8f-793a-4163-93d8-6a08c7959735 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:33.398117 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222eb8f-793a-4163-93d8-6a08c7959735 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:33.398415 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222eb8f-793a-4163-93d8-6a08c7959735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:33.411583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222eb8f-793a-4163-93d8-6a08c7959735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:59:33.413027 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222eb8f-793a-4163-93d8-6a08c7959735 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:59:33.427138 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 775/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:59:35.777845 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c77633-bd23-4c6e-8158-767383de3146 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:35.778495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c77633-bd23-4c6e-8158-767383de3146 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:35.778495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c77633-bd23-4c6e-8158-767383de3146 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:35.779993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 18:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:59:35.786378 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ec083-3028-435c-bee3-f50252573859 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:35.786946 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ec083-3028-435c-bee3-f50252573859 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:35.786946 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ec083-3028-435c-bee3-f50252573859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:35.808006 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a52ec083-3028-435c-bee3-f50252573859 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:59:35.809286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a52ec083-3028-435c-bee3-f50252573859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:59:35.820413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 18:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:59:35.862450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c77633-bd23-4c6e-8158-767383de3146 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:59:35.875386 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c77633-bd23-4c6e-8158-767383de3146 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:59:35.881159 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed285003-e158-4acc-ab1b-f52b71a06a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:59:35.882017 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed285003-e158-4acc-ab1b-f52b71a06a8f service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:35.882296 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed285003-e158-4acc-ab1b-f52b71a06a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:35.882563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed285003-e158-4acc-ab1b-f52b71a06a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:35.896852 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed285003-e158-4acc-ab1b-f52b71a06a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:59:35.898362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed285003-e158-4acc-ab1b-f52b71a06a8f service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:59:35.909367 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 757/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:59:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:59:39.788901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f91178-1f6c-467c-b356-c478c1ab786c None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:39.789513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f91178-1f6c-467c-b356-c478c1ab786c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:39.789513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f91178-1f6c-467c-b356-c478c1ab786c None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:39.790838 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 18:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:59:39.796654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f5332-5689-4e96-bbda-44365c136dc9 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:39.797240 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f5332-5689-4e96-bbda-44365c136dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:39.797240 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f5332-5689-4e96-bbda-44365c136dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:39.804144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=55 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:59:39.817946 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f09f5332-5689-4e96-bbda-44365c136dc9 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:59:39.819177 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f09f5332-5689-4e96-bbda-44365c136dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:59:39.827496 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 18:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:59:40.101870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f91178-1f6c-467c-b356-c478c1ab786c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:59:40.104391 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-25f91178-1f6c-467c-b356-c478c1ab786c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:59:40.171652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f91178-1f6c-467c-b356-c478c1ab786c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:59:40.176165 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77986153-aa4b-422f-ae2c-5ad1e3a5727e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:59:40.176831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77986153-aa4b-422f-ae2c-5ad1e3a5727e service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:40.177105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77986153-aa4b-422f-ae2c-5ad1e3a5727e service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:40.177371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77986153-aa4b-422f-ae2c-5ad1e3a5727e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:40.188571 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77986153-aa4b-422f-ae2c-5ad1e3a5727e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:59:40.190038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77986153-aa4b-422f-ae2c-5ad1e3a5727e service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:59:40.200693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 778/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 18:59:42.549840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2417517-d9b3-4c92-a4eb-d2aa715d2cf3 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:42.550445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2417517-d9b3-4c92-a4eb-d2aa715d2cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:42.550445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2417517-d9b3-4c92-a4eb-d2aa715d2cf3 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:42.551770 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 18:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 18:59:42.557662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa1730-6164-4143-a86d-112b341dbe1f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:42.558215 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa1730-6164-4143-a86d-112b341dbe1f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:42.558324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa1730-6164-4143-a86d-112b341dbe1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:42.578713 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-0bfa1730-6164-4143-a86d-112b341dbe1f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 18:59:42.580629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-0bfa1730-6164-4143-a86d-112b341dbe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:59:42.590621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 18:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 18:59:42.867984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2417517-d9b3-4c92-a4eb-d2aa715d2cf3 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 18:59:42.869602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e2417517-d9b3-4c92-a4eb-d2aa715d2cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 18:59:42.883939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2417517-d9b3-4c92-a4eb-d2aa715d2cf3 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 18:59:42.887774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8f8f6-429d-4350-9df3-5bfa00281ec4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 18:59:42.888431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8f8f6-429d-4350-9df3-5bfa00281ec4 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 18:59:42.888711 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8f8f6-429d-4350-9df3-5bfa00281ec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 18:59:42.889002 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8f8f6-429d-4350-9df3-5bfa00281ec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 18:59:42.899281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8f8f6-429d-4350-9df3-5bfa00281ec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 18:59:42.900730 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8f8f6-429d-4350-9df3-5bfa00281ec4 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 18:59:42.910666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 760/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 18:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 18:59:52.572720 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=39 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 18:59:52.906370 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=8 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:15.276380 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7fbb6-c29c-4fdb-914a-1193c9bd4d8f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.276994 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7fbb6-c29c-4fdb-914a-1193c9bd4d8f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.277386 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7fbb6-c29c-4fdb-914a-1193c9bd4d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.310381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c7e7fbb6-c29c-4fdb-914a-1193c9bd4d8f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:15.312095 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c7e7fbb6-c29c-4fdb-914a-1193c9bd4d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:15.325444 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 780/1540] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:01:15.335745 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da6c46-07fc-4681-a830-07b2354aef19 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.336370 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da6c46-07fc-4681-a830-07b2354aef19 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.336370 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da6c46-07fc-4681-a830-07b2354aef19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.386448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-92da6c46-07fc-4681-a830-07b2354aef19 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:15.387731 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-92da6c46-07fc-4681-a830-07b2354aef19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:15.399648 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 761/1541] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:15.404642 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7fbb6-c29c-4fdb-914a-1193c9bd4d8f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:15.418040 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7fbb6-c29c-4fdb-914a-1193c9bd4d8f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:15.428548 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c658e-14e6-471b-b864-6ca447f26950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:15.429251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c658e-14e6-471b-b864-6ca447f26950 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.429535 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c658e-14e6-471b-b864-6ca447f26950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.429822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c658e-14e6-471b-b864-6ca447f26950 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.430576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c658e-14e6-471b-b864-6ca447f26950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:15.430886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c658e-14e6-471b-b864-6ca447f26950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:15.432136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: WARNING py.warnings [None req-241c658e-14e6-471b-b864-6ca447f26950 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:01:15.432136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: warnings.warn(msg) Jun 02 19:01:15.432136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: Jun 02 19:01:15.433157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c658e-14e6-471b-b864-6ca447f26950 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:15.433479 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d0fcb-b213-471f-bcf8-9c164b48e470 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.433775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d0fcb-b213-471f-bcf8-9c164b48e470 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.434109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d0fcb-b213-471f-bcf8-9c164b48e470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.456399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 781/1542] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:15.464554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c658e-14e6-471b-b864-6ca447f26950 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:15.467465 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-9b7d0fcb-b213-471f-bcf8-9c164b48e470 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:15.468874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9b7d0fcb-b213-471f-bcf8-9c164b48e470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:15.481782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c658e-14e6-471b-b864-6ca447f26950 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:15.487796 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 762/1543] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:15.494690 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a18486-a21c-491d-be0b-5f89a7001f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:15.495400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a18486-a21c-491d-be0b-5f89a7001f6d admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.495683 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a18486-a21c-491d-be0b-5f89a7001f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.495961 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a18486-a21c-491d-be0b-5f89a7001f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.496468 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea734788-8798-4108-a1c0-5e49031437b9 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.496767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea734788-8798-4108-a1c0-5e49031437b9 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.496888 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a18486-a21c-491d-be0b-5f89a7001f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:15.497090 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea734788-8798-4108-a1c0-5e49031437b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.498882 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a18486-a21c-491d-be0b-5f89a7001f6d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:15.550757 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ea734788-8798-4108-a1c0-5e49031437b9 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:15.552160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ea734788-8798-4108-a1c0-5e49031437b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:15.568235 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 763/1544] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:15.579520 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea734788-8798-4108-a1c0-5e49031437b9 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:15.583689 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 782/1545] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:15 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:15.588264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a18486-a21c-491d-be0b-5f89a7001f6d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:15.594632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea734788-8798-4108-a1c0-5e49031437b9 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:15.702524 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a18486-a21c-491d-be0b-5f89a7001f6d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:15.707749 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824e023-13b4-4be3-9d97-d13b64129ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:15.707917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a032f-fd9d-4402-b2ca-4519e3936a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:15.708579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a032f-fd9d-4402-b2ca-4519e3936a35 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.708777 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824e023-13b4-4be3-9d97-d13b64129ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.708888 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a032f-fd9d-4402-b2ca-4519e3936a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.709127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a032f-fd9d-4402-b2ca-4519e3936a35 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.709248 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824e023-13b4-4be3-9d97-d13b64129ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.709627 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824e023-13b4-4be3-9d97-d13b64129ef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.710303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a032f-fd9d-4402-b2ca-4519e3936a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:15.711150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824e023-13b4-4be3-9d97-d13b64129ef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:15.711518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: WARNING py.warnings [None req-396a032f-fd9d-4402-b2ca-4519e3936a35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:01:15.711518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: warnings.warn(msg) Jun 02 19:01:15.711518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: Jun 02 19:01:15.711764 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824e023-13b4-4be3-9d97-d13b64129ef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:15.712749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a032f-fd9d-4402-b2ca-4519e3936a35 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:15.715019 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824e023-13b4-4be3-9d97-d13b64129ef7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:15.730465 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 764/1546] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:15.732590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfd0f1-8e9a-4c03-b6fa-ad52bd17a923 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.733101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfd0f1-8e9a-4c03-b6fa-ad52bd17a923 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.733456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfd0f1-8e9a-4c03-b6fa-ad52bd17a923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.739458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 783/1547] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:15 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:15.741180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69409eff-af22-4d93-b40b-f98c4e10d388 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.741474 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69409eff-af22-4d93-b40b-f98c4e10d388 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.741756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69409eff-af22-4d93-b40b-f98c4e10d388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.762126 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e3dfd0f1-8e9a-4c03-b6fa-ad52bd17a923 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:15.763590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e3dfd0f1-8e9a-4c03-b6fa-ad52bd17a923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:15.766418 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-69409eff-af22-4d93-b40b-f98c4e10d388 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:15.768068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-69409eff-af22-4d93-b40b-f98c4e10d388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:15.772345 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 765/1548] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:15.773492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdebbb4-13ac-4c26-a961-6f34543af362 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.773786 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdebbb4-13ac-4c26-a961-6f34543af362 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.774092 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdebbb4-13ac-4c26-a961-6f34543af362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.779438 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 784/1549] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:15.781463 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eb476-c743-4e33-8d90-426d4c89e426 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.781963 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eb476-c743-4e33-8d90-426d4c89e426 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.782403 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eb476-c743-4e33-8d90-426d4c89e426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.795925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ccdebbb4-13ac-4c26-a961-6f34543af362 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:15.797211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ccdebbb4-13ac-4c26-a961-6f34543af362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:15.805347 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-bd4eb476-c743-4e33-8d90-426d4c89e426 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:15.807036 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-bd4eb476-c743-4e33-8d90-426d4c89e426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:15.807937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 766/1550] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:15.808793 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdebbb4-13ac-4c26-a961-6f34543af362 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:15.836625 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdebbb4-13ac-4c26-a961-6f34543af362 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:15.836857 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 785/1551] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:15.838469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4eb476-c743-4e33-8d90-426d4c89e426 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:15.852563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848a6a2-df27-419c-97a8-42e7d6edefe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:15.852805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4eb476-c743-4e33-8d90-426d4c89e426 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:15.854367 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848a6a2-df27-419c-97a8-42e7d6edefe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.854797 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848a6a2-df27-419c-97a8-42e7d6edefe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.855555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848a6a2-df27-419c-97a8-42e7d6edefe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.856990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848a6a2-df27-419c-97a8-42e7d6edefe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:15.858755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: WARNING py.warnings [None req-8848a6a2-df27-419c-97a8-42e7d6edefe8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:01:15.858755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: warnings.warn(msg) Jun 02 19:01:15.858755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: Jun 02 19:01:15.859034 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3a12d-4760-4e65-b0d4-aa0de8a55ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:15.859795 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3a12d-4760-4e65-b0d4-aa0de8a55ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.860140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3a12d-4760-4e65-b0d4-aa0de8a55ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.860483 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3a12d-4760-4e65-b0d4-aa0de8a55ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.861124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848a6a2-df27-419c-97a8-42e7d6edefe8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:15.861346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3a12d-4760-4e65-b0d4-aa0de8a55ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:15.864094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3a12d-4760-4e65-b0d4-aa0de8a55ff0 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:15.882169 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 786/1552] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:15.882169 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f6ac5-9cb1-4937-b858-696a4beaaf98 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.882169 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f6ac5-9cb1-4937-b858-696a4beaaf98 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.882169 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f6ac5-9cb1-4937-b858-696a4beaaf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.907330 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-dc4f6ac5-9cb1-4937-b858-696a4beaaf98 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:15.909037 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-dc4f6ac5-9cb1-4937-b858-696a4beaaf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:15.910759 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 767/1553] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:15 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:15.912067 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc1843-a52f-4124-adb6-2aaedd025639 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.912351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc1843-a52f-4124-adb6-2aaedd025639 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.912678 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc1843-a52f-4124-adb6-2aaedd025639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:15.932063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e6fc1843-a52f-4124-adb6-2aaedd025639 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:15.933275 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e6fc1843-a52f-4124-adb6-2aaedd025639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:15.990614 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 787/1554] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:15.991928 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a2b16-d79f-41ea-9d70-3e52fa29ca2b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:15.992313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a2b16-d79f-41ea-9d70-3e52fa29ca2b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:15.992694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a2b16-d79f-41ea-9d70-3e52fa29ca2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.002999 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 768/1555] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:16.004270 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de2fa3-b870-443e-9a72-7e7dc505d225 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.004698 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de2fa3-b870-443e-9a72-7e7dc505d225 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.005021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de2fa3-b870-443e-9a72-7e7dc505d225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.013810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-655a2b16-d79f-41ea-9d70-3e52fa29ca2b None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:16.015045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-655a2b16-d79f-41ea-9d70-3e52fa29ca2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:16.024177 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 788/1556] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:16.024981 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a2b16-d79f-41ea-9d70-3e52fa29ca2b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.025537 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e3de2fa3-b870-443e-9a72-7e7dc505d225 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:16.026932 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e3de2fa3-b870-443e-9a72-7e7dc505d225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:16.034896 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a2b16-d79f-41ea-9d70-3e52fa29ca2b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.036166 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 769/1557] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:16.037494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c148416-fb5e-4c1c-ba96-4db8ecb0a322 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.037779 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c148416-fb5e-4c1c-ba96-4db8ecb0a322 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.038091 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c148416-fb5e-4c1c-ba96-4db8ecb0a322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.042840 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0035c-a96c-42b9-89b6-9feca7473e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.043503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0035c-a96c-42b9-89b6-9feca7473e5e admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.043779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0035c-a96c-42b9-89b6-9feca7473e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.044224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0035c-a96c-42b9-89b6-9feca7473e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.045178 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0035c-a96c-42b9-89b6-9feca7473e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.046862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0035c-a96c-42b9-89b6-9feca7473e5e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.057084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-3c148416-fb5e-4c1c-ba96-4db8ecb0a322 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:16.057273 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 789/1558] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:16.057908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0035c-a96c-42b9-89b6-9feca7473e5e admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.059248 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3c148416-fb5e-4c1c-ba96-4db8ecb0a322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:16.068017 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0035c-a96c-42b9-89b6-9feca7473e5e admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.068910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 770/1559] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:16.069856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c148416-fb5e-4c1c-ba96-4db8ecb0a322 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.073620 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50301070-ba0f-4a5d-9604-cf67bc68e2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.074397 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50301070-ba0f-4a5d-9604-cf67bc68e2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.074741 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50301070-ba0f-4a5d-9604-cf67bc68e2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.075076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50301070-ba0f-4a5d-9604-cf67bc68e2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.075989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50301070-ba0f-4a5d-9604-cf67bc68e2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.078107 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50301070-ba0f-4a5d-9604-cf67bc68e2c2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.081138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c148416-fb5e-4c1c-ba96-4db8ecb0a322 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.085758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:16.086023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f851bd9-c8c1-4a64-bd54-504768a80aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.086688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f851bd9-c8c1-4a64-bd54-504768a80aea admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.086996 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f851bd9-c8c1-4a64-bd54-504768a80aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.087328 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f851bd9-c8c1-4a64-bd54-504768a80aea admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.088371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f851bd9-c8c1-4a64-bd54-504768a80aea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:16.088549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f851bd9-c8c1-4a64-bd54-504768a80aea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.090269 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f851bd9-c8c1-4a64-bd54-504768a80aea admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.104913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 771/1560] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:16.106574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b165e8-d649-4628-a982-ab1903c90410 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.106875 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b165e8-d649-4628-a982-ab1903c90410 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.107121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b165e8-d649-4628-a982-ab1903c90410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.107622 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 790/1561] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:16 2022] POST /identity/v3/users => generated 287 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:16.108249 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50301070-ba0f-4a5d-9604-cf67bc68e2c2 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.118786 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50301070-ba0f-4a5d-9604-cf67bc68e2c2 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.123571 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fd1cc-4dac-41ee-9f57-61ceea268e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.124152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fd1cc-4dac-41ee-9f57-61ceea268e18 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.124430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fd1cc-4dac-41ee-9f57-61ceea268e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.124700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fd1cc-4dac-41ee-9f57-61ceea268e18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.125433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fd1cc-4dac-41ee-9f57-61ceea268e18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:16.125737 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fd1cc-4dac-41ee-9f57-61ceea268e18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.127374 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fd1cc-4dac-41ee-9f57-61ceea268e18 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.139329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f4b165e8-d649-4628-a982-ab1903c90410 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:16.140444 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 791/1562] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:16.141275 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fd1cc-4dac-41ee-9f57-61ceea268e18 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.141685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f4b165e8-d649-4628-a982-ab1903c90410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:16.151463 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fd1cc-4dac-41ee-9f57-61ceea268e18 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.156681 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 772/1563] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:16.157590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b165e8-d649-4628-a982-ab1903c90410 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.157778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c004f2f-05b9-4b05-87f7-99d918b6f6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.158409 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c004f2f-05b9-4b05-87f7-99d918b6f6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.158678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c004f2f-05b9-4b05-87f7-99d918b6f6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.158949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c004f2f-05b9-4b05-87f7-99d918b6f6e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.159685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c004f2f-05b9-4b05-87f7-99d918b6f6e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:16.159989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c004f2f-05b9-4b05-87f7-99d918b6f6e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.161614 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c004f2f-05b9-4b05-87f7-99d918b6f6e7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.169096 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b165e8-d649-4628-a982-ab1903c90410 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.175838 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 792/1564] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:16.176730 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c004f2f-05b9-4b05-87f7-99d918b6f6e7 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.176889 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb64fc-6523-4b0f-8f05-8bea4615e216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.177575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb64fc-6523-4b0f-8f05-8bea4615e216 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.177783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb64fc-6523-4b0f-8f05-8bea4615e216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.178081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb64fc-6523-4b0f-8f05-8bea4615e216 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.178811 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb64fc-6523-4b0f-8f05-8bea4615e216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:16.179197 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb64fc-6523-4b0f-8f05-8bea4615e216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.180828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb64fc-6523-4b0f-8f05-8bea4615e216 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.183065 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:16.188280 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c004f2f-05b9-4b05-87f7-99d918b6f6e7 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.193137 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d3456-7392-4894-b081-547bfc7eae3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.194162 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d3456-7392-4894-b081-547bfc7eae3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.194440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d3456-7392-4894-b081-547bfc7eae3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.194712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d3456-7392-4894-b081-547bfc7eae3a admin admin] PATH_INFO: `/v3/projects/b1ed3fa8416e46b7b7f2ddb9981d2d5b/users/f81a7d3daa7e40cd965dc0df610fa525/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.202567 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 773/1565] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:16.202567 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b5e4c-0982-4523-81d8-b39e051d1318 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.202567 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b5e4c-0982-4523-81d8-b39e051d1318 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.202567 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b5e4c-0982-4523-81d8-b39e051d1318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.217413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-fd4b5e4c-0982-4523-81d8-b39e051d1318 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:16.218677 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-fd4b5e4c-0982-4523-81d8-b39e051d1318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:16.218827 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d3456-7392-4894-b081-547bfc7eae3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ed3fa8416e46b7b7f2ddb9981d2d5b, user_id=f81a7d3daa7e40cd965dc0df610fa525, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.221723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d3456-7392-4894-b081-547bfc7eae3a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.228492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 774/1566] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:16.232472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b5e4c-0982-4523-81d8-b39e051d1318 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.240954 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b5e4c-0982-4523-81d8-b39e051d1318 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.242406 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 793/1567] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:16 2022] PUT /identity/v3/projects/b1ed3fa8416e46b7b7f2ddb9981d2d5b/users/f81a7d3daa7e40cd965dc0df610fa525/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:16.243535 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d3456-7392-4894-b081-547bfc7eae3a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.309789 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68c39d-b7e1-4937-84b6-0b5963edd1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.310523 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68c39d-b7e1-4937-84b6-0b5963edd1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.310797 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68c39d-b7e1-4937-84b6-0b5963edd1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.311067 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68c39d-b7e1-4937-84b6-0b5963edd1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.311795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68c39d-b7e1-4937-84b6-0b5963edd1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.313408 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68c39d-b7e1-4937-84b6-0b5963edd1d3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.313508 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d3456-7392-4894-b081-547bfc7eae3a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.318392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89db7ca-a325-4376-944c-6f9df0a09c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.319211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89db7ca-a325-4376-944c-6f9df0a09c4e admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.319514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89db7ca-a325-4376-944c-6f9df0a09c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.319768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89db7ca-a325-4376-944c-6f9df0a09c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.320476 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89db7ca-a325-4376-944c-6f9df0a09c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.322863 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89db7ca-a325-4376-944c-6f9df0a09c4e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.328800 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 775/1568] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:16.328800 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68c39d-b7e1-4937-84b6-0b5963edd1d3 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.339142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68c39d-b7e1-4937-84b6-0b5963edd1d3 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.344644 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1f5d9-a449-440e-b65f-8cd05285be2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.345283 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1f5d9-a449-440e-b65f-8cd05285be2a admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.345588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1f5d9-a449-440e-b65f-8cd05285be2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.345897 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1f5d9-a449-440e-b65f-8cd05285be2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.346591 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1f5d9-a449-440e-b65f-8cd05285be2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.348538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1f5d9-a449-440e-b65f-8cd05285be2a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.355434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 794/1569] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:16 2022] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:16.356801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c96084-8914-4583-9da2-a18e8ec20dbb None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.357196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c96084-8914-4583-9da2-a18e8ec20dbb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.357477 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c96084-8914-4583-9da2-a18e8ec20dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.378453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-90c96084-8914-4583-9da2-a18e8ec20dbb None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:16.379725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-90c96084-8914-4583-9da2-a18e8ec20dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:16.380647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 776/1570] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:16 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:16.381698 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1f5d9-a449-440e-b65f-8cd05285be2a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.457257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 795/1571] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:16.461981 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c96084-8914-4583-9da2-a18e8ec20dbb None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.462593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1f5d9-a449-440e-b65f-8cd05285be2a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.470076 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40d902-24d6-4c0b-804d-b9bdead1116e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.471050 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40d902-24d6-4c0b-804d-b9bdead1116e admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.471458 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40d902-24d6-4c0b-804d-b9bdead1116e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.471862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40d902-24d6-4c0b-804d-b9bdead1116e admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.472911 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40d902-24d6-4c0b-804d-b9bdead1116e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.473325 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c96084-8914-4583-9da2-a18e8ec20dbb None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.476048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40d902-24d6-4c0b-804d-b9bdead1116e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.478592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fc109-0714-409c-8c29-af4ccdc03163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.479275 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fc109-0714-409c-8c29-af4ccdc03163 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.479553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fc109-0714-409c-8c29-af4ccdc03163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.479824 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fc109-0714-409c-8c29-af4ccdc03163 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.480528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fc109-0714-409c-8c29-af4ccdc03163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.483652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fc109-0714-409c-8c29-af4ccdc03163 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.511090 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 777/1572] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:16 2022] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:16.514528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 796/1573] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:16 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:16.515946 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40d902-24d6-4c0b-804d-b9bdead1116e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.516557 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854886f4-d4f5-4d35-94c3-fcc6f711e453 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.517054 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854886f4-d4f5-4d35-94c3-fcc6f711e453 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.517489 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854886f4-d4f5-4d35-94c3-fcc6f711e453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.526397 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:16.551984 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-854886f4-d4f5-4d35-94c3-fcc6f711e453 None None] MFA Rules not processed for user `f81a7d3daa7e40cd965dc0df610fa525`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:16.553228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-854886f4-d4f5-4d35-94c3-fcc6f711e453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:16.578021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:16.598079 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40d902-24d6-4c0b-804d-b9bdead1116e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.629733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 797/1574] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:16.630670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854886f4-d4f5-4d35-94c3-fcc6f711e453 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.674711 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2241b-2ccf-4d58-948b-96b8b90ab414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.675424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2241b-2ccf-4d58-948b-96b8b90ab414 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.675707 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2241b-2ccf-4d58-948b-96b8b90ab414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.675983 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2241b-2ccf-4d58-948b-96b8b90ab414 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.676895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2241b-2ccf-4d58-948b-96b8b90ab414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:16.677034 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2241b-2ccf-4d58-948b-96b8b90ab414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.678723 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2241b-2ccf-4d58-948b-96b8b90ab414 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.693750 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 778/1575] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:16.694965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2241b-2ccf-4d58-948b-96b8b90ab414 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.706676 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2241b-2ccf-4d58-948b-96b8b90ab414 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.711620 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8c718-d5f2-4dc0-b333-051408772ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.712316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8c718-d5f2-4dc0-b333-051408772ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.712597 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8c718-d5f2-4dc0-b333-051408772ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.712870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8c718-d5f2-4dc0-b333-051408772ef6 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.713575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8c718-d5f2-4dc0-b333-051408772ef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.715709 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8c718-d5f2-4dc0-b333-051408772ef6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.718601 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854886f4-d4f5-4d35-94c3-fcc6f711e453 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.723435 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f2311-d703-4c48-b83b-1c8add79af7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.724109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f2311-d703-4c48-b83b-1c8add79af7d admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.724508 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f2311-d703-4c48-b83b-1c8add79af7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.724760 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f2311-d703-4c48-b83b-1c8add79af7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.725535 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f2311-d703-4c48-b83b-1c8add79af7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.727201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f2311-d703-4c48-b83b-1c8add79af7d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.744849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 798/1576] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:16.745065 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 779/1577] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:16 2022] POST /identity/v3/users => generated 284 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:16.745184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f2311-d703-4c48-b83b-1c8add79af7d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.745305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8c718-d5f2-4dc0-b333-051408772ef6 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.756883 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8c718-d5f2-4dc0-b333-051408772ef6 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.757145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f2311-d703-4c48-b83b-1c8add79af7d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.762691 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21904a9-2f89-4556-be58-f0d459cb04b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.763041 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb2f5c-744f-4d7a-876d-7481519fbe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.763616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21904a9-2f89-4556-be58-f0d459cb04b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.763908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21904a9-2f89-4556-be58-f0d459cb04b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.764117 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb2f5c-744f-4d7a-876d-7481519fbe78 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.764302 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21904a9-2f89-4556-be58-f0d459cb04b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.764488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb2f5c-744f-4d7a-876d-7481519fbe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.764488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb2f5c-744f-4d7a-876d-7481519fbe78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.764875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21904a9-2f89-4556-be58-f0d459cb04b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.765231 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb2f5c-744f-4d7a-876d-7481519fbe78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:16.765536 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb2f5c-744f-4d7a-876d-7481519fbe78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.766871 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21904a9-2f89-4556-be58-f0d459cb04b3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.767167 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb2f5c-744f-4d7a-876d-7481519fbe78 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.782500 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 780/1578] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:16.783337 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb2f5c-744f-4d7a-876d-7481519fbe78 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.794565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb2f5c-744f-4d7a-876d-7481519fbe78 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.795353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 799/1579] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:16 2022] POST /identity/v3/users => generated 285 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:16.796229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21904a9-2f89-4556-be58-f0d459cb04b3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.800337 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af8a0a-e9d8-43e4-9a55-f53387ab3049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.801012 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af8a0a-e9d8-43e4-9a55-f53387ab3049 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.801277 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af8a0a-e9d8-43e4-9a55-f53387ab3049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.801557 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af8a0a-e9d8-43e4-9a55-f53387ab3049 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.802304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af8a0a-e9d8-43e4-9a55-f53387ab3049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.804274 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af8a0a-e9d8-43e4-9a55-f53387ab3049 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.807135 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21904a9-2f89-4556-be58-f0d459cb04b3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.813088 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c52e08-524b-4b63-bad5-b1f4d39ecc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.814025 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c52e08-524b-4b63-bad5-b1f4d39ecc5d admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.814312 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c52e08-524b-4b63-bad5-b1f4d39ecc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.814590 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c52e08-524b-4b63-bad5-b1f4d39ecc5d admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.815301 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c52e08-524b-4b63-bad5-b1f4d39ecc5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.817258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c52e08-524b-4b63-bad5-b1f4d39ecc5d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.839279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 781/1580] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:16 2022] POST /identity/v3/users => generated 295 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:16.839279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63f8ad-bdc3-4965-821b-6fc26bed544d None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.839859 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63f8ad-bdc3-4965-821b-6fc26bed544d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.840410 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63f8ad-bdc3-4965-821b-6fc26bed544d None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.844024 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 782/1581] 10.222.0.15 () {54 vars in 961 bytes} [Thu Jun 2 19:01:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:16.845221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63f8ad-bdc3-4965-821b-6fc26bed544d None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.858651 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 800/1582] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:16 2022] POST /identity/v3/users => generated 292 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:16.858651 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c52e08-524b-4b63-bad5-b1f4d39ecc5d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.864450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63f8ad-bdc3-4965-821b-6fc26bed544d None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.869557 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2bf51-a7ca-43dd-8e3b-36b1ae87e411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.870103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2bf51-a7ca-43dd-8e3b-36b1ae87e411 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.870400 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2bf51-a7ca-43dd-8e3b-36b1ae87e411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.870570 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c52e08-524b-4b63-bad5-b1f4d39ecc5d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:16.870726 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2bf51-a7ca-43dd-8e3b-36b1ae87e411 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.871411 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2bf51-a7ca-43dd-8e3b-36b1ae87e411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.873521 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2bf51-a7ca-43dd-8e3b-36b1ae87e411 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.876042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ba6a1-c287-43e9-b0f6-4571bb1fab80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:16.877133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ba6a1-c287-43e9-b0f6-4571bb1fab80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:16.877509 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ba6a1-c287-43e9-b0f6-4571bb1fab80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:16.877947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ba6a1-c287-43e9-b0f6-4571bb1fab80 admin admin] PATH_INFO: `/v3/projects/54d8329301c643f4b57709c8e412c0ea/users/1abf5cf28f394ab79246c07b6f31318f/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:16.898470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ba6a1-c287-43e9-b0f6-4571bb1fab80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d8329301c643f4b57709c8e412c0ea, user_id=1abf5cf28f394ab79246c07b6f31318f, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:16.902065 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ba6a1-c287-43e9-b0f6-4571bb1fab80 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:16.904832 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 783/1583] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:16 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:16.905701 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2bf51-a7ca-43dd-8e3b-36b1ae87e411 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.929440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 801/1584] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:16 2022] PUT /identity/v3/projects/54d8329301c643f4b57709c8e412c0ea/users/1abf5cf28f394ab79246c07b6f31318f/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:16.934768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ba6a1-c287-43e9-b0f6-4571bb1fab80 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:16.981087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:16.991544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2bf51-a7ca-43dd-8e3b-36b1ae87e411 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.012511 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:17.014217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ba6a1-c287-43e9-b0f6-4571bb1fab80 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.018872 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ab7cc-96a9-44c0-9f44-b15824e22ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.019518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ab7cc-96a9-44c0-9f44-b15824e22ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.019799 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ab7cc-96a9-44c0-9f44-b15824e22ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.020184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ab7cc-96a9-44c0-9f44-b15824e22ac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.020770 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ab7cc-96a9-44c0-9f44-b15824e22ac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.022761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ab7cc-96a9-44c0-9f44-b15824e22ac9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.050878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 802/1585] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:16 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:17.051248 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06e7d1-f578-46a5-ad17-5909130b96a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.051557 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ab7cc-96a9-44c0-9f44-b15824e22ac9 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.052209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06e7d1-f578-46a5-ad17-5909130b96a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.052530 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06e7d1-f578-46a5-ad17-5909130b96a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.052918 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06e7d1-f578-46a5-ad17-5909130b96a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.053865 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06e7d1-f578-46a5-ad17-5909130b96a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.055603 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06e7d1-f578-46a5-ad17-5909130b96a6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.067025 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 784/1586] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:17.067940 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06e7d1-f578-46a5-ad17-5909130b96a6 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.079919 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06e7d1-f578-46a5-ad17-5909130b96a6 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.118558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ab7cc-96a9-44c0-9f44-b15824e22ac9 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.125083 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92875ab-8f1a-4952-a0f4-54a6afc7cdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.125788 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92875ab-8f1a-4952-a0f4-54a6afc7cdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.126086 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92875ab-8f1a-4952-a0f4-54a6afc7cdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.126381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92875ab-8f1a-4952-a0f4-54a6afc7cdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.127098 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92875ab-8f1a-4952-a0f4-54a6afc7cdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.129761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92875ab-8f1a-4952-a0f4-54a6afc7cdd4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.139225 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcde86-f9ef-4cc6-a347-b71fa8e0c2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.139697 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 803/1587] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:17.139918 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcde86-f9ef-4cc6-a347-b71fa8e0c2ce admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.140199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcde86-f9ef-4cc6-a347-b71fa8e0c2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.140479 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcde86-f9ef-4cc6-a347-b71fa8e0c2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.141100 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184f4e9-82c9-4431-b1d1-eb88b9b0ec68 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.141358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcde86-f9ef-4cc6-a347-b71fa8e0c2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.141476 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184f4e9-82c9-4431-b1d1-eb88b9b0ec68 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.141655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184f4e9-82c9-4431-b1d1-eb88b9b0ec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.143077 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcde86-f9ef-4cc6-a347-b71fa8e0c2ce admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.164037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 785/1588] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:17.164271 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d184f4e9-82c9-4431-b1d1-eb88b9b0ec68 None None] MFA Rules not processed for user `6b8ff9f5032e498db3c70c79cc11989b`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:17.164390 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcde86-f9ef-4cc6-a347-b71fa8e0c2ce admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.164482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d184f4e9-82c9-4431-b1d1-eb88b9b0ec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:17.173737 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcde86-f9ef-4cc6-a347-b71fa8e0c2ce admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.178242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8774b62-b769-4311-827c-96d5709bcd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.178903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8774b62-b769-4311-827c-96d5709bcd55 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.179179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8774b62-b769-4311-827c-96d5709bcd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.179451 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8774b62-b769-4311-827c-96d5709bcd55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.180198 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8774b62-b769-4311-827c-96d5709bcd55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.181937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8774b62-b769-4311-827c-96d5709bcd55 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.192385 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 786/1589] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:17.193298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8774b62-b769-4311-827c-96d5709bcd55 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.205835 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8774b62-b769-4311-827c-96d5709bcd55 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.210838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35395f00-1133-4e64-b5f1-cd077d3669d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.211546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35395f00-1133-4e64-b5f1-cd077d3669d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.211830 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35395f00-1133-4e64-b5f1-cd077d3669d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.212122 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35395f00-1133-4e64-b5f1-cd077d3669d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.212810 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35395f00-1133-4e64-b5f1-cd077d3669d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.214885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35395f00-1133-4e64-b5f1-cd077d3669d8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.244188 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 804/1590] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Jun 2 19:01:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:17.245395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 787/1591] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:17 2022] POST /identity/v3/users => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:17.246253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35395f00-1133-4e64-b5f1-cd077d3669d8 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.249884 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c8d66-bcee-4f65-acd6-74942fc007a8 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.250244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c8d66-bcee-4f65-acd6-74942fc007a8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.250743 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c8d66-bcee-4f65-acd6-74942fc007a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.257490 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35395f00-1133-4e64-b5f1-cd077d3669d8 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.263538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c90b8-2c64-426d-8635-2c8a037615ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.264677 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c90b8-2c64-426d-8635-2c8a037615ab admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.264677 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c90b8-2c64-426d-8635-2c8a037615ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.264983 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c90b8-2c64-426d-8635-2c8a037615ab admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.265434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c90b8-2c64-426d-8635-2c8a037615ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.267431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c90b8-2c64-426d-8635-2c8a037615ab admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.281426 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-cf5c8d66-bcee-4f65-acd6-74942fc007a8 None None] MFA Rules not processed for user `1abf5cf28f394ab79246c07b6f31318f`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:17.282812 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-cf5c8d66-bcee-4f65-acd6-74942fc007a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:17.289690 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 788/1592] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:17 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:17.290566 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c90b8-2c64-426d-8635-2c8a037615ab admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.310832 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c90b8-2c64-426d-8635-2c8a037615ab admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.314428 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:17.317374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7af3d-02ef-4a42-a9dd-40d0ddbd5ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.318085 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7af3d-02ef-4a42-a9dd-40d0ddbd5ffc admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.318363 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7af3d-02ef-4a42-a9dd-40d0ddbd5ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.319546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7af3d-02ef-4a42-a9dd-40d0ddbd5ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.319546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7af3d-02ef-4a42-a9dd-40d0ddbd5ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.321183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7af3d-02ef-4a42-a9dd-40d0ddbd5ffc admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.333716 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 789/1593] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:17.334594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7af3d-02ef-4a42-a9dd-40d0ddbd5ffc admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.345156 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7af3d-02ef-4a42-a9dd-40d0ddbd5ffc admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.349924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81671bc5-d7c4-471a-b2e5-4d8931c5cabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.350592 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81671bc5-d7c4-471a-b2e5-4d8931c5cabd admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.350871 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81671bc5-d7c4-471a-b2e5-4d8931c5cabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.351143 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81671bc5-d7c4-471a-b2e5-4d8931c5cabd admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.351870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81671bc5-d7c4-471a-b2e5-4d8931c5cabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.353484 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81671bc5-d7c4-471a-b2e5-4d8931c5cabd admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.355409 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 805/1594] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:17.356621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c8d66-bcee-4f65-acd6-74942fc007a8 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.367260 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c8d66-bcee-4f65-acd6-74942fc007a8 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.370986 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 790/1595] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:17.370986 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81671bc5-d7c4-471a-b2e5-4d8931c5cabd admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.374622 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d23840-26e0-488c-b73b-290aae0ff234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.375294 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d23840-26e0-488c-b73b-290aae0ff234 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.375653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d23840-26e0-488c-b73b-290aae0ff234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.375927 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d23840-26e0-488c-b73b-290aae0ff234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.376628 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d23840-26e0-488c-b73b-290aae0ff234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.378254 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d23840-26e0-488c-b73b-290aae0ff234 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.380765 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81671bc5-d7c4-471a-b2e5-4d8931c5cabd admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.386436 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14f6e0-9c58-4c69-986d-162eb0c23a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.386826 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14f6e0-9c58-4c69-986d-162eb0c23a56 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.387104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14f6e0-9c58-4c69-986d-162eb0c23a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.387372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14f6e0-9c58-4c69-986d-162eb0c23a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.388168 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14f6e0-9c58-4c69-986d-162eb0c23a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.388638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 806/1596] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:17.389827 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14f6e0-9c58-4c69-986d-162eb0c23a56 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.392381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d23840-26e0-488c-b73b-290aae0ff234 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.400706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 791/1597] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:17.401331 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14f6e0-9c58-4c69-986d-162eb0c23a56 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.401730 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d23840-26e0-488c-b73b-290aae0ff234 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.406956 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087a592-49ac-4f7a-8c04-ad6979370d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.407613 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087a592-49ac-4f7a-8c04-ad6979370d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.407889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087a592-49ac-4f7a-8c04-ad6979370d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.408158 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087a592-49ac-4f7a-8c04-ad6979370d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.408874 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087a592-49ac-4f7a-8c04-ad6979370d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.410506 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087a592-49ac-4f7a-8c04-ad6979370d7d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.414344 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14f6e0-9c58-4c69-986d-162eb0c23a56 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.421899 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac170e7-3abe-4810-b9df-a39b07b2a7a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.422114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 807/1598] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:17.422551 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac170e7-3abe-4810-b9df-a39b07b2a7a6 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.422847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac170e7-3abe-4810-b9df-a39b07b2a7a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.423100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac170e7-3abe-4810-b9df-a39b07b2a7a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.423250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087a592-49ac-4f7a-8c04-ad6979370d7d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.434575 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087a592-49ac-4f7a-8c04-ad6979370d7d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.440074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc974834-67d1-456c-98f5-cc159bcbee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.440771 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc974834-67d1-456c-98f5-cc159bcbee60 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.441055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc974834-67d1-456c-98f5-cc159bcbee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.441330 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc974834-67d1-456c-98f5-cc159bcbee60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.442089 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc974834-67d1-456c-98f5-cc159bcbee60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.443924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc974834-67d1-456c-98f5-cc159bcbee60 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.455708 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 808/1599] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:17.456616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc974834-67d1-456c-98f5-cc159bcbee60 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.462611 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:17.466845 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc974834-67d1-456c-98f5-cc159bcbee60 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.472478 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafc71b-53e1-4f4b-ab27-b5b3eda45e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.473372 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafc71b-53e1-4f4b-ab27-b5b3eda45e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.473646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafc71b-53e1-4f4b-ab27-b5b3eda45e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.473975 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafc71b-53e1-4f4b-ab27-b5b3eda45e85 admin admin] PATH_INFO: `/v3/projects/2d7356c4c0c641c9bed979fc7a5558be/users/caaaf75b67df46cf9e3e67b231c2a4f2/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.487445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac170e7-3abe-4810-b9df-a39b07b2a7a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.488515 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebafc71b-53e1-4f4b-ab27-b5b3eda45e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7356c4c0c641c9bed979fc7a5558be, user_id=caaaf75b67df46cf9e3e67b231c2a4f2, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.489137 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac170e7-3abe-4810-b9df-a39b07b2a7a6 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.491199 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebafc71b-53e1-4f4b-ab27-b5b3eda45e85 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.499451 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 792/1600] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:17.500356 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac170e7-3abe-4810-b9df-a39b07b2a7a6 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.507525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 809/1601] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:17 2022] PUT /identity/v3/projects/2d7356c4c0c641c9bed979fc7a5558be/users/caaaf75b67df46cf9e3e67b231c2a4f2/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:17.510516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac170e7-3abe-4810-b9df-a39b07b2a7a6 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.514887 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafc71b-53e1-4f4b-ab27-b5b3eda45e85 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.582018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b460ea7-81a8-462d-bf09-52318809c7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.582785 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b460ea7-81a8-462d-bf09-52318809c7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.583157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b460ea7-81a8-462d-bf09-52318809c7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.583500 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b460ea7-81a8-462d-bf09-52318809c7f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.584271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b460ea7-81a8-462d-bf09-52318809c7f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.586384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b460ea7-81a8-462d-bf09-52318809c7f0 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.592557 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafc71b-53e1-4f4b-ab27-b5b3eda45e85 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.598065 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e7fb1-e647-4168-ae13-0c666835ef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.599184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e7fb1-e647-4168-ae13-0c666835ef1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.599628 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e7fb1-e647-4168-ae13-0c666835ef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.600208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e7fb1-e647-4168-ae13-0c666835ef1d admin admin] PATH_INFO: `/v3/projects/d189f695095c4d27b6b93c7419ac0bbe/users/79aac82943d54deb83995911fdf6f2c2/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.621354 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e7fb1-e647-4168-ae13-0c666835ef1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d189f695095c4d27b6b93c7419ac0bbe, user_id=79aac82943d54deb83995911fdf6f2c2, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.623862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 793/1602] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:17 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:17.625183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b460ea7-81a8-462d-bf09-52318809c7f0 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.627921 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e7fb1-e647-4168-ae13-0c666835ef1d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.658346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 810/1603] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:17 2022] PUT /identity/v3/projects/d189f695095c4d27b6b93c7419ac0bbe/users/79aac82943d54deb83995911fdf6f2c2/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:17.659731 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e7fb1-e647-4168-ae13-0c666835ef1d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.701754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b460ea7-81a8-462d-bf09-52318809c7f0 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.745731 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:17.757624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e7fb1-e647-4168-ae13-0c666835ef1d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.765184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7113fe-650f-4515-a644-6ee01a8c8fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.766135 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7113fe-650f-4515-a644-6ee01a8c8fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.766465 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7113fe-650f-4515-a644-6ee01a8c8fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.766744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7113fe-650f-4515-a644-6ee01a8c8fb3 admin admin] PATH_INFO: `/v3/projects/2c5cf4734d8e430db02969affe17b102/users/5bb0cf077f484094ae382ad949c24373/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.776053 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd03f2d-bb09-4d36-b044-55d71710b8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.777052 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd03f2d-bb09-4d36-b044-55d71710b8ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.777387 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd03f2d-bb09-4d36-b044-55d71710b8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.777726 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd03f2d-bb09-4d36-b044-55d71710b8ce admin admin] PATH_INFO: `/v3/projects/a23ef70d937643f8a1c8597a8cfac596/users/cef7ac127d2f4284a1808c580148c9e0/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.783942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7113fe-650f-4515-a644-6ee01a8c8fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5cf4734d8e430db02969affe17b102, user_id=5bb0cf077f484094ae382ad949c24373, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.786670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7113fe-650f-4515-a644-6ee01a8c8fb3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.791949 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:17.795355 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd03f2d-bb09-4d36-b044-55d71710b8ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23ef70d937643f8a1c8597a8cfac596, user_id=cef7ac127d2f4284a1808c580148c9e0, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.796507 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: WARNING py.warnings [None req-0bd03f2d-bb09-4d36-b044-55d71710b8ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:01:17.796507 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: warnings.warn(msg) Jun 02 19:01:17.796507 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: Jun 02 19:01:17.799194 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd03f2d-bb09-4d36-b044-55d71710b8ce admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.805382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 811/1604] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:17 2022] PUT /identity/v3/projects/2c5cf4734d8e430db02969affe17b102/users/5bb0cf077f484094ae382ad949c24373/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:17.811996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7113fe-650f-4515-a644-6ee01a8c8fb3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.825665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 794/1605] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:17 2022] PUT /identity/v3/projects/a23ef70d937643f8a1c8597a8cfac596/users/cef7ac127d2f4284a1808c580148c9e0/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:17.826837 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd03f2d-bb09-4d36-b044-55d71710b8ce admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.898952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd03f2d-bb09-4d36-b044-55d71710b8ce admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.906502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1b2b6-640f-4e67-ae10-70129af099bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.907207 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1b2b6-640f-4e67-ae10-70129af099bf admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.907487 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1b2b6-640f-4e67-ae10-70129af099bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.907746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7113fe-650f-4515-a644-6ee01a8c8fb3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.907881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1b2b6-640f-4e67-ae10-70129af099bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.908494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1b2b6-640f-4e67-ae10-70129af099bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.910188 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1b2b6-640f-4e67-ae10-70129af099bf admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.917650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cc882-1272-490f-9924-6876ef87f389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.918590 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cc882-1272-490f-9924-6876ef87f389 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.918904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cc882-1272-490f-9924-6876ef87f389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.919181 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cc882-1272-490f-9924-6876ef87f389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.920356 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cc882-1272-490f-9924-6876ef87f389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.922252 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cc882-1272-490f-9924-6876ef87f389 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.930033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 795/1606] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:17.932803 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ce1b1-5c72-48e7-87c8-a16cd09109b5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.933220 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ce1b1-5c72-48e7-87c8-a16cd09109b5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.933700 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ce1b1-5c72-48e7-87c8-a16cd09109b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.940032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 812/1607] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:17.940032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cc882-1272-490f-9924-6876ef87f389 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:17.949617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cc882-1272-490f-9924-6876ef87f389 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:17.958045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db7710-68fc-4ada-ab97-929c4cda1da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:17.959281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db7710-68fc-4ada-ab97-929c4cda1da1 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.959721 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db7710-68fc-4ada-ab97-929c4cda1da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.960136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db7710-68fc-4ada-ab97-929c4cda1da1 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:17.961368 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db7710-68fc-4ada-ab97-929c4cda1da1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:17.963597 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db7710-68fc-4ada-ab97-929c4cda1da1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:17.973941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-7d9ce1b1-5c72-48e7-87c8-a16cd09109b5 None None] MFA Rules not processed for user `caaaf75b67df46cf9e3e67b231c2a4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:17.975281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7d9ce1b1-5c72-48e7-87c8-a16cd09109b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:17.994739 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 813/1608] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:17 2022] POST /identity/v3/users => generated 292 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:17.998682 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce2805-e8d8-4712-aabe-0434baf827bc None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:17.998682 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce2805-e8d8-4712-aabe-0434baf827bc None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:17.998682 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce2805-e8d8-4712-aabe-0434baf827bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:18.040722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5dce2805-e8d8-4712-aabe-0434baf827bc None None] MFA Rules not processed for user `79aac82943d54deb83995911fdf6f2c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:18.042119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5dce2805-e8d8-4712-aabe-0434baf827bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:18.089207 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 796/1609] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:18.090847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8905879-ef98-419d-8235-25c3419163d2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:18.091125 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8905879-ef98-419d-8235-25c3419163d2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:18.091402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8905879-ef98-419d-8235-25c3419163d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:18.128136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e8905879-ef98-419d-8235-25c3419163d2 None None] MFA Rules not processed for user `5bb0cf077f484094ae382ad949c24373`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:18.130511 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e8905879-ef98-419d-8235-25c3419163d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:18.159252 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 814/1610] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:18.161051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50f4fd-53de-49b2-b8a8-37736417d688 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:18.161560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50f4fd-53de-49b2-b8a8-37736417d688 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:18.162088 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50f4fd-53de-49b2-b8a8-37736417d688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:18.194400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-fa50f4fd-53de-49b2-b8a8-37736417d688 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:18.195663 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fa50f4fd-53de-49b2-b8a8-37736417d688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:18.209755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 815/1611] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:18.209755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50f4fd-53de-49b2-b8a8-37736417d688 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:18.217291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50f4fd-53de-49b2-b8a8-37736417d688 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:18.223338 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c89969-f0bf-4fd3-8963-9a85ba8854bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:18.224529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c89969-f0bf-4fd3-8963-9a85ba8854bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:18.224818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c89969-f0bf-4fd3-8963-9a85ba8854bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:18.225095 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c89969-f0bf-4fd3-8963-9a85ba8854bf admin admin] PATH_INFO: `/v3/projects/5a66e7666ca24a079738eea09c470cdd/users/4a660a47927140d6b4d0543de5e281a1/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:18.244546 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c89969-f0bf-4fd3-8963-9a85ba8854bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a66e7666ca24a079738eea09c470cdd, user_id=4a660a47927140d6b4d0543de5e281a1, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:18.249558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c89969-f0bf-4fd3-8963-9a85ba8854bf admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:18.270180 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 797/1612] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:18.271595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8905879-ef98-419d-8235-25c3419163d2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:18.280609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 816/1613] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:18 2022] PUT /identity/v3/projects/5a66e7666ca24a079738eea09c470cdd/users/4a660a47927140d6b4d0543de5e281a1/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:18.280609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c89969-f0bf-4fd3-8963-9a85ba8854bf admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:18.290030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8905879-ef98-419d-8235-25c3419163d2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:18.294988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:18.311263 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:18.362458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c89969-f0bf-4fd3-8963-9a85ba8854bf admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:18.367432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451efa71-8e11-4b4d-bea7-459dedbf7166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:18.368281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451efa71-8e11-4b4d-bea7-459dedbf7166 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:18.368565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451efa71-8e11-4b4d-bea7-459dedbf7166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:18.368840 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451efa71-8e11-4b4d-bea7-459dedbf7166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:18.369587 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451efa71-8e11-4b4d-bea7-459dedbf7166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:18.371280 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451efa71-8e11-4b4d-bea7-459dedbf7166 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:18.382995 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 817/1614] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:18.383485 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32592608-4217-413e-8277-a52553b8e4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:18.384504 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32592608-4217-413e-8277-a52553b8e4bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:18.384788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32592608-4217-413e-8277-a52553b8e4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:18.385064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32592608-4217-413e-8277-a52553b8e4bf admin admin] PATH_INFO: `/v3/projects/8e515ddd7313434f9e3dd34debc97877/users/daefcb4d04ee4bc5b2c1a7b755077a4a/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:18.386093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b961f39-351a-4ba1-bbdd-e6566707dfde None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:18.386571 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b961f39-351a-4ba1-bbdd-e6566707dfde None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:18.386914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b961f39-351a-4ba1-bbdd-e6566707dfde None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:18.388725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 818/1615] 10.222.0.15 () {54 vars in 961 bytes} [Thu Jun 2 19:01:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:18.389618 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b961f39-351a-4ba1-bbdd-e6566707dfde None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:18.409494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32592608-4217-413e-8277-a52553b8e4bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e515ddd7313434f9e3dd34debc97877, user_id=daefcb4d04ee4bc5b2c1a7b755077a4a, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:18.412686 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32592608-4217-413e-8277-a52553b8e4bf admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:18.432322 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 798/1616] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:18 2022] PUT /identity/v3/projects/8e515ddd7313434f9e3dd34debc97877/users/daefcb4d04ee4bc5b2c1a7b755077a4a/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:18.433378 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32592608-4217-413e-8277-a52553b8e4bf admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:18.480584 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b961f39-351a-4ba1-bbdd-e6566707dfde None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:18.520832 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32592608-4217-413e-8277-a52553b8e4bf admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:18.527866 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da045061-7da8-4397-a6c2-51908e3f9310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:18.528775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da045061-7da8-4397-a6c2-51908e3f9310 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:18.529070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da045061-7da8-4397-a6c2-51908e3f9310 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:18.529446 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da045061-7da8-4397-a6c2-51908e3f9310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:18.567527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a22b5-697e-4897-8429-5f0b98d84127 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:18.568203 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a22b5-697e-4897-8429-5f0b98d84127 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:18.568571 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a22b5-697e-4897-8429-5f0b98d84127 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:18.569032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a22b5-697e-4897-8429-5f0b98d84127 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:18.593634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da045061-7da8-4397-a6c2-51908e3f9310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:18.595413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da045061-7da8-4397-a6c2-51908e3f9310 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:18.607883 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 799/1617] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:18 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:18.609318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da045061-7da8-4397-a6c2-51908e3f9310 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:18.639582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a22b5-697e-4897-8429-5f0b98d84127 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:18.641151 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a22b5-697e-4897-8429-5f0b98d84127 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:18.652023 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 819/1618] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:18.653612 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc89d7-fb04-4960-bdf9-27a2431a98dc None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:18.654126 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc89d7-fb04-4960-bdf9-27a2431a98dc None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:18.654342 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc89d7-fb04-4960-bdf9-27a2431a98dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:18.654800 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:18.678653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a7bc89d7-fb04-4960-bdf9-27a2431a98dc None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:18.680353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a7bc89d7-fb04-4960-bdf9-27a2431a98dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:18.687699 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da045061-7da8-4397-a6c2-51908e3f9310 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:18.691419 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde8513-e3b2-4563-a05e-a873d377e40f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:18.692093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde8513-e3b2-4563-a05e-a873d377e40f service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:18.692375 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde8513-e3b2-4563-a05e-a873d377e40f service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:18.692647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde8513-e3b2-4563-a05e-a873d377e40f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:18.707184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:18.777439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 820/1619] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:18.780055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc89d7-fb04-4960-bdf9-27a2431a98dc None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:18.797911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc89d7-fb04-4960-bdf9-27a2431a98dc None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:18.804859 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4612c3-58f3-453a-bd58-22fe4e788297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:18.806261 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde8513-e3b2-4563-a05e-a873d377e40f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:18.806436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4612c3-58f3-453a-bd58-22fe4e788297 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:18.806698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4612c3-58f3-453a-bd58-22fe4e788297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:18.807106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4612c3-58f3-453a-bd58-22fe4e788297 admin admin] PATH_INFO: `/v3/projects/6ae4d74e87694f718abcc7efda2bce9f/users/e7d0bf9f517f47df898309515457c575/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:18.808522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde8513-e3b2-4563-a05e-a873d377e40f service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:18.824311 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 800/1620] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:18.826044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a80937-e943-4dd8-ae95-6a38efa5e79a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:18.826512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a80937-e943-4dd8-ae95-6a38efa5e79a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:18.826798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a80937-e943-4dd8-ae95-6a38efa5e79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:18.838514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4612c3-58f3-453a-bd58-22fe4e788297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae4d74e87694f718abcc7efda2bce9f, user_id=e7d0bf9f517f47df898309515457c575, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:18.843874 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4612c3-58f3-453a-bd58-22fe4e788297 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:18.852820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d4a80937-e943-4dd8-ae95-6a38efa5e79a None None] MFA Rules not processed for user `6b8ff9f5032e498db3c70c79cc11989b`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:18.854379 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d4a80937-e943-4dd8-ae95-6a38efa5e79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:18.873389 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 821/1621] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:18 2022] PUT /identity/v3/projects/6ae4d74e87694f718abcc7efda2bce9f/users/e7d0bf9f517f47df898309515457c575/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:18.875969 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef4766-2158-44e5-bad4-2443bb355838 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:18.876303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef4766-2158-44e5-bad4-2443bb355838 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:18.878425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef4766-2158-44e5-bad4-2443bb355838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:18.882796 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 801/1622] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Jun 2 19:01:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:18.884406 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d468fc8-ace2-43f5-a199-4b42bbc4467a None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:18.884802 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d468fc8-ace2-43f5-a199-4b42bbc4467a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:18.884963 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d468fc8-ace2-43f5-a199-4b42bbc4467a None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:18.886636 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 802/1623] 10.222.0.15 () {54 vars in 912 bytes} [Thu Jun 2 19:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:18.887262 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d468fc8-ace2-43f5-a199-4b42bbc4467a None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:18.892786 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3d468fc8-ace2-43f5-a199-4b42bbc4467a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:18.921336 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-29ef4766-2158-44e5-bad4-2443bb355838 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:18.924091 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-29ef4766-2158-44e5-bad4-2443bb355838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:18.986091 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d468fc8-ace2-43f5-a199-4b42bbc4467a None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:18.991369 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677a464-b662-4fdb-9851-1fab800e0e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:18.992570 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677a464-b662-4fdb-9851-1fab800e0e3d service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:18.992939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677a464-b662-4fdb-9851-1fab800e0e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:18.993228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677a464-b662-4fdb-9851-1fab800e0e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:19.053779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 822/1624] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:19.060991 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef4766-2158-44e5-bad4-2443bb355838 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:19.079876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef4766-2158-44e5-bad4-2443bb355838 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:19.090207 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34aefb5-07ad-48e6-886a-f5c36e6cf4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:19.091023 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aefb5-07ad-48e6-886a-f5c36e6cf4cc admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:19.091368 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aefb5-07ad-48e6-886a-f5c36e6cf4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:19.091716 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aefb5-07ad-48e6-886a-f5c36e6cf4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:19.092521 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34aefb5-07ad-48e6-886a-f5c36e6cf4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:19.094253 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34aefb5-07ad-48e6-886a-f5c36e6cf4cc admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:19.110881 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 823/1625] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:19.110881 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e124a-b978-4c73-9d18-aef705075677 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:19.110881 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e124a-b978-4c73-9d18-aef705075677 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:19.110881 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e124a-b978-4c73-9d18-aef705075677 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:19.110881 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 824/1626] 10.222.0.15 () {54 vars in 912 bytes} [Thu Jun 2 19:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:19.111503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff4672-cc68-4777-819d-e96e175cc8cd None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:19.112023 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff4672-cc68-4777-819d-e96e175cc8cd None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:19.112023 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff4672-cc68-4777-819d-e96e175cc8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:19.142880 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-62ff4672-cc68-4777-819d-e96e175cc8cd None None] MFA Rules not processed for user `6b8ff9f5032e498db3c70c79cc11989b`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:19.145209 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-62ff4672-cc68-4777-819d-e96e175cc8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:19.149629 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677a464-b662-4fdb-9851-1fab800e0e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:19.156181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677a464-b662-4fdb-9851-1fab800e0e3d service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:19.179479 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 803/1627] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:19.197661 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677a464-b662-4fdb-9851-1fab800e0e3d service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:19.221845 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677a464-b662-4fdb-9851-1fab800e0e3d service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:19.231020 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9465e-9de9-4ee7-a332-9d7558847bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:19.231896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9465e-9de9-4ee7-a332-9d7558847bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:19.232280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9465e-9de9-4ee7-a332-9d7558847bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:19.232715 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9465e-9de9-4ee7-a332-9d7558847bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:19.244196 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9465e-9de9-4ee7-a332-9d7558847bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:19.245914 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9465e-9de9-4ee7-a332-9d7558847bb2 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:19.258187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 804/1628] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:19.259129 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9465e-9de9-4ee7-a332-9d7558847bb2 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:19.270602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9465e-9de9-4ee7-a332-9d7558847bb2 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:19.275926 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912a389-bd0d-4f18-bd23-0440ff326ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:19.277329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912a389-bd0d-4f18-bd23-0440ff326ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:19.277329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912a389-bd0d-4f18-bd23-0440ff326ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:19.277655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912a389-bd0d-4f18-bd23-0440ff326ba9 admin admin] PATH_INFO: `/v3/projects/6ae4d74e87694f718abcc7efda2bce9f/users/e7d0bf9f517f47df898309515457c575/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:19.280875 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912a389-bd0d-4f18-bd23-0440ff326ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae4d74e87694f718abcc7efda2bce9f, user_id=e7d0bf9f517f47df898309515457c575, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:19.284728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912a389-bd0d-4f18-bd23-0440ff326ba9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:19.287796 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:19.300872 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 805/1629] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:19 2022] PUT /identity/v3/projects/6ae4d74e87694f718abcc7efda2bce9f/users/e7d0bf9f517f47df898309515457c575/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:19.302553 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc735140-7f3e-486b-82ee-ed781c230fd2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:19.302906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc735140-7f3e-486b-82ee-ed781c230fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:19.303245 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc735140-7f3e-486b-82ee-ed781c230fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:19.326993 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 825/1630] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 2 19:01:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:19.331843 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d0586-6e02-4034-8e5b-9889b64032cc None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:19.334373 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d0586-6e02-4034-8e5b-9889b64032cc None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:19.338184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d0586-6e02-4034-8e5b-9889b64032cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:19.339722 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-cc735140-7f3e-486b-82ee-ed781c230fd2 None None] MFA Rules not processed for user `6b8ff9f5032e498db3c70c79cc11989b`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:19.342129 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-cc735140-7f3e-486b-82ee-ed781c230fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:19.408102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-896d0586-6e02-4034-8e5b-9889b64032cc None None] MFA Rules not processed for user `e7d0bf9f517f47df898309515457c575`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:19.409488 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-896d0586-6e02-4034-8e5b-9889b64032cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:19.423571 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:19.454321 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 806/1631] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 2 19:01:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:19.455795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc735140-7f3e-486b-82ee-ed781c230fd2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:19.549973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 826/1632] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:19 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:19.574071 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc735140-7f3e-486b-82ee-ed781c230fd2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:19.580259 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a961606-f8f5-4987-b995-c58942eb36dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:19.581438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a961606-f8f5-4987-b995-c58942eb36dc service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:19.581824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a961606-f8f5-4987-b995-c58942eb36dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:19.582290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a961606-f8f5-4987-b995-c58942eb36dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:19.638772 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a961606-f8f5-4987-b995-c58942eb36dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:19.640124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a961606-f8f5-4987-b995-c58942eb36dc service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:19.641144 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d0586-6e02-4034-8e5b-9889b64032cc None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:19.655482 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 807/1633] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:19.660296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d0586-6e02-4034-8e5b-9889b64032cc None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:19.671640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f85269-77d2-4ec6-a285-72f0edf596f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:19.674333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f85269-77d2-4ec6-a285-72f0edf596f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:19.675840 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f85269-77d2-4ec6-a285-72f0edf596f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:19.676172 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f85269-77d2-4ec6-a285-72f0edf596f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:19.720788 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f85269-77d2-4ec6-a285-72f0edf596f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:19.727261 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f85269-77d2-4ec6-a285-72f0edf596f0 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:19.785988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 827/1634] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:19.838472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a961606-f8f5-4987-b995-c58942eb36dc service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:19.851856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a961606-f8f5-4987-b995-c58942eb36dc service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:19.857697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cd73f-4506-4394-9056-69ccbeefcbe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:19.860366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cd73f-4506-4394-9056-69ccbeefcbe4 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:19.860726 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cd73f-4506-4394-9056-69ccbeefcbe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:19.860981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cd73f-4506-4394-9056-69ccbeefcbe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:19.888565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cd73f-4506-4394-9056-69ccbeefcbe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:19.893277 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cd73f-4506-4394-9056-69ccbeefcbe4 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:19.928342 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f85269-77d2-4ec6-a285-72f0edf596f0 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:19.943443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 808/1635] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:19.946658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f85269-77d2-4ec6-a285-72f0edf596f0 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:19.978489 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969df98-0711-44bd-8b6e-cdfd3d88cee4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:19.979228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969df98-0711-44bd-8b6e-cdfd3d88cee4 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:19.979465 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969df98-0711-44bd-8b6e-cdfd3d88cee4 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:19.979741 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969df98-0711-44bd-8b6e-cdfd3d88cee4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:20.149392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969df98-0711-44bd-8b6e-cdfd3d88cee4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:20.151401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969df98-0711-44bd-8b6e-cdfd3d88cee4 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:20.182461 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 828/1636] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:01:20.490563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cd73f-4506-4394-9056-69ccbeefcbe4 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:20.509062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cd73f-4506-4394-9056-69ccbeefcbe4 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:20.525478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7fa80-ec8e-4059-9fa1-00c9e6a5818e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:20.526681 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7fa80-ec8e-4059-9fa1-00c9e6a5818e service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:20.527194 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7fa80-ec8e-4059-9fa1-00c9e6a5818e service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:20.527692 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7fa80-ec8e-4059-9fa1-00c9e6a5818e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:20.686478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7fa80-ec8e-4059-9fa1-00c9e6a5818e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:20.689840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7fa80-ec8e-4059-9fa1-00c9e6a5818e service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:20.706756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 809/1637] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:21.535343 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cbe64-7599-4362-89ea-b5dddbd3c05d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:21.536988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cbe64-7599-4362-89ea-b5dddbd3c05d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:21.537954 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cbe64-7599-4362-89ea-b5dddbd3c05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:21.626067 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7fa80-ec8e-4059-9fa1-00c9e6a5818e service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:21.706596 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:21.790830 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-948cbe64-7599-4362-89ea-b5dddbd3c05d None None] MFA Rules not processed for user `daefcb4d04ee4bc5b2c1a7b755077a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:21.796185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-948cbe64-7599-4362-89ea-b5dddbd3c05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:22.007481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7fa80-ec8e-4059-9fa1-00c9e6a5818e service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:22.008877 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 829/1638] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:22.023152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df851fc-5cbd-4701-8256-f3ff53668943 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:22.025496 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df851fc-5cbd-4701-8256-f3ff53668943 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:22.026599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df851fc-5cbd-4701-8256-f3ff53668943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:22.032239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81b0bb-5fd7-4ac3-87d4-c824614ffb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:22.037039 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81b0bb-5fd7-4ac3-87d4-c824614ffb30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:22.038902 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81b0bb-5fd7-4ac3-87d4-c824614ffb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:22.039374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81b0bb-5fd7-4ac3-87d4-c824614ffb30 admin admin] PATH_INFO: `/v3/users/f81a7d3daa7e40cd965dc0df610fa525` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:22.044016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81b0bb-5fd7-4ac3-87d4-c824614ffb30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f81a7d3daa7e40cd965dc0df610fa525)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:22.048181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: WARNING py.warnings [None req-ee81b0bb-5fd7-4ac3-87d4-c824614ffb30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:01:22.048181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: warnings.warn(msg) Jun 02 19:01:22.048181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: Jun 02 19:01:22.055022 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81b0bb-5fd7-4ac3-87d4-c824614ffb30 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:22.093952 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-7df851fc-5cbd-4701-8256-f3ff53668943 None None] MFA Rules not processed for user `daefcb4d04ee4bc5b2c1a7b755077a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:22.097967 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7df851fc-5cbd-4701-8256-f3ff53668943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:22.133024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 830/1639] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:22.142472 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df851fc-5cbd-4701-8256-f3ff53668943 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:22.201752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df851fc-5cbd-4701-8256-f3ff53668943 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:22.214981 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c4e69-0fa7-413a-8f18-3eb28b1ce6fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:22.217157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c4e69-0fa7-413a-8f18-3eb28b1ce6fa service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:22.218005 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c4e69-0fa7-413a-8f18-3eb28b1ce6fa service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:22.218528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c4e69-0fa7-413a-8f18-3eb28b1ce6fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:22.233461 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c4e69-0fa7-413a-8f18-3eb28b1ce6fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:22.235810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c4e69-0fa7-413a-8f18-3eb28b1ce6fa service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:22.276055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 831/1640] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:01:22.289363 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ee81b0bb-5fd7-4ac3-87d4-c824614ffb30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f81a7d3daa7e40cd965dc0df610fa525'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:22.290087 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ee81b0bb-5fd7-4ac3-87d4-c824614ffb30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f81a7d3daa7e40cd965dc0df610fa525'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:22.304182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ee81b0bb-5fd7-4ac3-87d4-c824614ffb30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f81a7d3daa7e40cd965dc0df610fa525'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:22.352450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ee81b0bb-5fd7-4ac3-87d4-c824614ffb30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f81a7d3daa7e40cd965dc0df610fa525'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:22.353969 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ee81b0bb-5fd7-4ac3-87d4-c824614ffb30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f81a7d3daa7e40cd965dc0df610fa525'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:22.396796 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 810/1641] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:01:21 2022] DELETE /identity/v3/users/f81a7d3daa7e40cd965dc0df610fa525 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:22.399599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65c4a5-442a-456f-83ee-2231827c1089 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:22.400117 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65c4a5-442a-456f-83ee-2231827c1089 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:22.400489 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65c4a5-442a-456f-83ee-2231827c1089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:22.415553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:22.465391 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6a65c4a5-442a-456f-83ee-2231827c1089 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:22.467171 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6a65c4a5-442a-456f-83ee-2231827c1089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:22.647114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 832/1642] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:01:22.705010 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81b0bb-5fd7-4ac3-87d4-c824614ffb30 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:22.706732 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ee81b0bb-5fd7-4ac3-87d4-c824614ffb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:22.877330 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81b0bb-5fd7-4ac3-87d4-c824614ffb30 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:22.894873 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba79033-e897-44fe-8a27-66b1c04c0b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:22.894873 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79033-e897-44fe-8a27-66b1c04c0b07 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:22.897717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79033-e897-44fe-8a27-66b1c04c0b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:22.897717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79033-e897-44fe-8a27-66b1c04c0b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:22.938906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba79033-e897-44fe-8a27-66b1c04c0b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:22.943380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba79033-e897-44fe-8a27-66b1c04c0b07 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:22.987242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 811/1643] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:01:23.444174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65c4a5-442a-456f-83ee-2231827c1089 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:23.446686 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6a65c4a5-442a-456f-83ee-2231827c1089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:23.503137 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1f325-eaa3-40fc-b151-9bfcd0ea7483 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:23.503728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1f325-eaa3-40fc-b151-9bfcd0ea7483 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:23.504128 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1f325-eaa3-40fc-b151-9bfcd0ea7483 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:23.506739 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 812/1644] 10.222.0.15 () {54 vars in 912 bytes} [Thu Jun 2 19:01:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:01:23.540129 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd14c6-94f4-4009-8fb8-4b6869d5fa41 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:23.540581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd14c6-94f4-4009-8fb8-4b6869d5fa41 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:23.540996 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd14c6-94f4-4009-8fb8-4b6869d5fa41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:23.548095 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65c4a5-442a-456f-83ee-2231827c1089 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:23.569901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32decc-b639-453a-96f3-336fc99d5246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:23.570837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32decc-b639-453a-96f3-336fc99d5246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:23.571117 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32decc-b639-453a-96f3-336fc99d5246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:23.571393 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32decc-b639-453a-96f3-336fc99d5246 admin admin] PATH_INFO: `/v3/users/79aac82943d54deb83995911fdf6f2c2` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:23.577006 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32decc-b639-453a-96f3-336fc99d5246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79aac82943d54deb83995911fdf6f2c2)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:23.584182 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32decc-b639-453a-96f3-336fc99d5246 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:23.601868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-68bd14c6-94f4-4009-8fb8-4b6869d5fa41 None None] MFA Rules not processed for user `e7714d3ad1d849f5a398fc1843f22e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:23.603507 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-68bd14c6-94f4-4009-8fb8-4b6869d5fa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:23.626478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 813/1645] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 2 19:01:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:01:23.700210 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd14c6-94f4-4009-8fb8-4b6869d5fa41 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:23.710462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd14c6-94f4-4009-8fb8-4b6869d5fa41 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:23.724590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079fef9-5147-4f6d-8f45-60ec379cf2cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:23.725340 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079fef9-5147-4f6d-8f45-60ec379cf2cd service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:23.728742 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079fef9-5147-4f6d-8f45-60ec379cf2cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:23.729228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079fef9-5147-4f6d-8f45-60ec379cf2cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:23.754265 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079fef9-5147-4f6d-8f45-60ec379cf2cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:23.756703 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079fef9-5147-4f6d-8f45-60ec379cf2cd service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:23.761850 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fb32decc-b639-453a-96f3-336fc99d5246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79aac82943d54deb83995911fdf6f2c2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:23.765670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fb32decc-b639-453a-96f3-336fc99d5246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79aac82943d54deb83995911fdf6f2c2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:23.782181 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fb32decc-b639-453a-96f3-336fc99d5246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79aac82943d54deb83995911fdf6f2c2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:23.798462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 814/1646] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:23.801442 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fb32decc-b639-453a-96f3-336fc99d5246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79aac82943d54deb83995911fdf6f2c2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:23.802715 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fb32decc-b639-453a-96f3-336fc99d5246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79aac82943d54deb83995911fdf6f2c2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:23.889749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 833/1647] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:01:23 2022] DELETE /identity/v3/users/79aac82943d54deb83995911fdf6f2c2 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:23.895051 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53179b6-4e05-4a74-b1f0-4f0917d6dcf4 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:23.895595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53179b6-4e05-4a74-b1f0-4f0917d6dcf4 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:23.896175 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53179b6-4e05-4a74-b1f0-4f0917d6dcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:23.905261 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:23.935979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d53179b6-4e05-4a74-b1f0-4f0917d6dcf4 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:23.939850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d53179b6-4e05-4a74-b1f0-4f0917d6dcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:24.115692 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 815/1648] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:24.172295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32decc-b639-453a-96f3-336fc99d5246 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:24.174367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fb32decc-b639-453a-96f3-336fc99d5246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:24.344044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32decc-b639-453a-96f3-336fc99d5246 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:24.353905 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152ffea-bf5e-4d00-8443-123348eac0ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:24.355405 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152ffea-bf5e-4d00-8443-123348eac0ec service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:24.355842 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152ffea-bf5e-4d00-8443-123348eac0ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:24.356259 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152ffea-bf5e-4d00-8443-123348eac0ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:24.396435 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152ffea-bf5e-4d00-8443-123348eac0ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:24.401747 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152ffea-bf5e-4d00-8443-123348eac0ec service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:24.426317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 834/1649] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:25.639661 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6136714-1202-4320-bf09-39fe7f77e227 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:25.640209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6136714-1202-4320-bf09-39fe7f77e227 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:25.640422 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6136714-1202-4320-bf09-39fe7f77e227 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:25.642251 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 816/1650] 10.222.0.15 () {54 vars in 960 bytes} [Thu Jun 2 19:01:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 19:01:25.682451 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd1b00-535f-4adc-973f-e5bda5b72fb3 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:25.683000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd1b00-535f-4adc-973f-e5bda5b72fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:25.683247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd1b00-535f-4adc-973f-e5bda5b72fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:25.723066 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c2fd1b00-535f-4adc-973f-e5bda5b72fb3 None None] MFA Rules not processed for user `11a4152a82e1486887541afab2d4e5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:25.727106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c2fd1b00-535f-4adc-973f-e5bda5b72fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:25.771583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:25.939800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 835/1651] 10.222.0.15 () {58 vars in 1057 bytes} [Thu Jun 2 19:01:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:25.956244 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6136714-1202-4320-bf09-39fe7f77e227 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:25.956531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd1b00-535f-4adc-973f-e5bda5b72fb3 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:25.961842 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e6136714-1202-4320-bf09-39fe7f77e227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:25.978212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd1b00-535f-4adc-973f-e5bda5b72fb3 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:25.999259 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebeb55-86cc-4a6d-bd65-91f6b90ce8f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:26.000102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebeb55-86cc-4a6d-bd65-91f6b90ce8f6 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:26.000488 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebeb55-86cc-4a6d-bd65-91f6b90ce8f6 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:26.001293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6136714-1202-4320-bf09-39fe7f77e227 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:26.001692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebeb55-86cc-4a6d-bd65-91f6b90ce8f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:26.005652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-77ebeb55-86cc-4a6d-bd65-91f6b90ce8f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:26.017464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71930eb-1f08-42d2-a151-8f4d291ab687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:26.019387 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71930eb-1f08-42d2-a151-8f4d291ab687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:26.023947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71930eb-1f08-42d2-a151-8f4d291ab687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:26.025853 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71930eb-1f08-42d2-a151-8f4d291ab687 admin admin] PATH_INFO: `/v3/projects/b1ed3fa8416e46b7b7f2ddb9981d2d5b` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:26.029457 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71930eb-1f08-42d2-a151-8f4d291ab687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ed3fa8416e46b7b7f2ddb9981d2d5b)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:26.036016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71930eb-1f08-42d2-a151-8f4d291ab687 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:26.051036 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebeb55-86cc-4a6d-bd65-91f6b90ce8f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:26.053730 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebeb55-86cc-4a6d-bd65-91f6b90ce8f6 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:26.083646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 836/1652] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:26.134192 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a71930eb-1f08-42d2-a151-8f4d291ab687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ed3fa8416e46b7b7f2ddb9981d2d5b', 'request_id': 'req-a71930eb-1f08-42d2-a151-8f4d291ab687'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:26.142727 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a71930eb-1f08-42d2-a151-8f4d291ab687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ed3fa8416e46b7b7f2ddb9981d2d5b', 'request_id': 'req-a71930eb-1f08-42d2-a151-8f4d291ab687'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:26.166057 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a71930eb-1f08-42d2-a151-8f4d291ab687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ed3fa8416e46b7b7f2ddb9981d2d5b', 'request_id': 'req-a71930eb-1f08-42d2-a151-8f4d291ab687'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:26.202590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a71930eb-1f08-42d2-a151-8f4d291ab687 admin admin] The token cache is being invalidate because project b1ed3fa8416e46b7b7f2ddb9981d2d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:01:26.203025 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a71930eb-1f08-42d2-a151-8f4d291ab687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:26.204377 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a71930eb-1f08-42d2-a151-8f4d291ab687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:26.235124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 817/1653] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:01:25 2022] DELETE /identity/v3/projects/b1ed3fa8416e46b7b7f2ddb9981d2d5b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:26.238312 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f11a31-a977-4acf-b2bf-b81895978355 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:26.238959 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f11a31-a977-4acf-b2bf-b81895978355 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:26.239358 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f11a31-a977-4acf-b2bf-b81895978355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:26.297404 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-87f11a31-a977-4acf-b2bf-b81895978355 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:26.303356 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-87f11a31-a977-4acf-b2bf-b81895978355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:26.519307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef777648-d42a-491c-a65b-8e5036ae7935 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:26.525828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef777648-d42a-491c-a65b-8e5036ae7935 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:26.525828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef777648-d42a-491c-a65b-8e5036ae7935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:26.530558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 837/1654] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:26.562369 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ef777648-d42a-491c-a65b-8e5036ae7935 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:26.563443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ef777648-d42a-491c-a65b-8e5036ae7935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:26.576833 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f11a31-a977-4acf-b2bf-b81895978355 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:26.579021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-87f11a31-a977-4acf-b2bf-b81895978355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:26.605450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 818/1655] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:26.614937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef777648-d42a-491c-a65b-8e5036ae7935 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:26.642651 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f11a31-a977-4acf-b2bf-b81895978355 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:26.650972 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef777648-d42a-491c-a65b-8e5036ae7935 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:26.675517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cdfaa-ad0d-4566-8a50-d44f8ecffccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:26.689549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d0d39-e6f1-412a-9ac6-17046127dae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:26.690481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d0d39-e6f1-412a-9ac6-17046127dae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:26.691152 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d0d39-e6f1-412a-9ac6-17046127dae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:26.692605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d0d39-e6f1-412a-9ac6-17046127dae8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:26.693532 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d0d39-e6f1-412a-9ac6-17046127dae8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:26.694340 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d0d39-e6f1-412a-9ac6-17046127dae8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:26.696171 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d0d39-e6f1-412a-9ac6-17046127dae8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:26.701375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cdfaa-ad0d-4566-8a50-d44f8ecffccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:26.704017 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cdfaa-ad0d-4566-8a50-d44f8ecffccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:26.704410 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cdfaa-ad0d-4566-8a50-d44f8ecffccd admin admin] PATH_INFO: `/v3/projects/d189f695095c4d27b6b93c7419ac0bbe` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:26.717118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040cdfaa-ad0d-4566-8a50-d44f8ecffccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d189f695095c4d27b6b93c7419ac0bbe)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:26.726572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: WARNING py.warnings [None req-040cdfaa-ad0d-4566-8a50-d44f8ecffccd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 19:01:26.726572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: warnings.warn(msg) Jun 02 19:01:26.726572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: Jun 02 19:01:26.729340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040cdfaa-ad0d-4566-8a50-d44f8ecffccd admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:26.764169 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 819/1656] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:26.789437 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d0d39-e6f1-412a-9ac6-17046127dae8 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:26.835169 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d0d39-e6f1-412a-9ac6-17046127dae8 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:26.878604 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a8303-5ebe-4579-a0b0-fd780dee932c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:26.879505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a8303-5ebe-4579-a0b0-fd780dee932c admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:26.882157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a8303-5ebe-4579-a0b0-fd780dee932c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:26.886540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a8303-5ebe-4579-a0b0-fd780dee932c admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:26.888190 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a8303-5ebe-4579-a0b0-fd780dee932c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:26.902262 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a8303-5ebe-4579-a0b0-fd780dee932c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:27.016043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 820/1657] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:26 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:27.020334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-040cdfaa-ad0d-4566-8a50-d44f8ecffccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd189f695095c4d27b6b93c7419ac0bbe', 'request_id': 'req-040cdfaa-ad0d-4566-8a50-d44f8ecffccd'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:27.020923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a8303-5ebe-4579-a0b0-fd780dee932c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:27.059891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-040cdfaa-ad0d-4566-8a50-d44f8ecffccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd189f695095c4d27b6b93c7419ac0bbe', 'request_id': 'req-040cdfaa-ad0d-4566-8a50-d44f8ecffccd'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:27.126416 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-040cdfaa-ad0d-4566-8a50-d44f8ecffccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd189f695095c4d27b6b93c7419ac0bbe', 'request_id': 'req-040cdfaa-ad0d-4566-8a50-d44f8ecffccd'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:27.169700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-040cdfaa-ad0d-4566-8a50-d44f8ecffccd admin admin] The token cache is being invalidate because project d189f695095c4d27b6b93c7419ac0bbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:01:27.169700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-040cdfaa-ad0d-4566-8a50-d44f8ecffccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:27.175838 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-040cdfaa-ad0d-4566-8a50-d44f8ecffccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:27.187122 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 838/1658] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:01:26 2022] DELETE /identity/v3/projects/d189f695095c4d27b6b93c7419ac0bbe => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:27.189780 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da5159-be60-41ab-b9f9-5b6b6d8f5ffa None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:27.190114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da5159-be60-41ab-b9f9-5b6b6d8f5ffa None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:27.190393 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da5159-be60-41ab-b9f9-5b6b6d8f5ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:27.206506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:27.292321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-03da5159-be60-41ab-b9f9-5b6b6d8f5ffa None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:27.295390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-03da5159-be60-41ab-b9f9-5b6b6d8f5ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:27.305155 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a8303-5ebe-4579-a0b0-fd780dee932c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:27.349682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9603c2-ad83-4a58-bb56-28a9267c0f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:27.353137 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9603c2-ad83-4a58-bb56-28a9267c0f65 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:27.353561 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9603c2-ad83-4a58-bb56-28a9267c0f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:27.364318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 839/1659] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:27.364888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9603c2-ad83-4a58-bb56-28a9267c0f65 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:27.366497 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9603c2-ad83-4a58-bb56-28a9267c0f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:27.370611 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9603c2-ad83-4a58-bb56-28a9267c0f65 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:27.379485 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cb963-2aea-4c83-aa4d-0711a65a41d6 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:27.379938 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cb963-2aea-4c83-aa4d-0711a65a41d6 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:27.380362 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cb963-2aea-4c83-aa4d-0711a65a41d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:27.473706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 821/1660] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:27 2022] POST /identity/v3/users => generated 288 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:27.479022 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9603c2-ad83-4a58-bb56-28a9267c0f65 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:27.483395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3f9603c2-ad83-4a58-bb56-28a9267c0f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:27.486529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b12cb963-2aea-4c83-aa4d-0711a65a41d6 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:27.495595 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b12cb963-2aea-4c83-aa4d-0711a65a41d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:27.531103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9603c2-ad83-4a58-bb56-28a9267c0f65 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:27.567737 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835d46e-b201-4a72-a98b-2408c2988fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:27.574205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835d46e-b201-4a72-a98b-2408c2988fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:27.574370 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835d46e-b201-4a72-a98b-2408c2988fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:27.575136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835d46e-b201-4a72-a98b-2408c2988fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:27.589399 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835d46e-b201-4a72-a98b-2408c2988fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:27.605962 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835d46e-b201-4a72-a98b-2408c2988fe1 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:27.647061 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 840/1661] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:01:27.651558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cb963-2aea-4c83-aa4d-0711a65a41d6 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:27.688970 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 822/1662] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:27.694443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835d46e-b201-4a72-a98b-2408c2988fe1 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:27.739941 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cb963-2aea-4c83-aa4d-0711a65a41d6 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:27.769492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835d46e-b201-4a72-a98b-2408c2988fe1 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:27.791008 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751aac1e-6686-4ac5-9f65-404c47a58abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:27.792340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751aac1e-6686-4ac5-9f65-404c47a58abb admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:27.792827 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751aac1e-6686-4ac5-9f65-404c47a58abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:27.793313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751aac1e-6686-4ac5-9f65-404c47a58abb admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:27.796400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751aac1e-6686-4ac5-9f65-404c47a58abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:27.796915 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751aac1e-6686-4ac5-9f65-404c47a58abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:27.799879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751aac1e-6686-4ac5-9f65-404c47a58abb admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:27.815868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d547b-93f8-48d5-a7dc-1cdf0b7a5f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:27.816940 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d547b-93f8-48d5-a7dc-1cdf0b7a5f8c admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:27.819176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d547b-93f8-48d5-a7dc-1cdf0b7a5f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:27.819176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d547b-93f8-48d5-a7dc-1cdf0b7a5f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:27.830560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d547b-93f8-48d5-a7dc-1cdf0b7a5f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:27.847709 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d547b-93f8-48d5-a7dc-1cdf0b7a5f8c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:27.864950 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:27.889381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 841/1663] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:27.892479 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751aac1e-6686-4ac5-9f65-404c47a58abb admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:27.942156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751aac1e-6686-4ac5-9f65-404c47a58abb admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:27.961338 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7792e-5fb7-4e77-8cd0-62bae4ff6671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:27.962140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7792e-5fb7-4e77-8cd0-62bae4ff6671 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:27.962330 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7792e-5fb7-4e77-8cd0-62bae4ff6671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:27.962604 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7792e-5fb7-4e77-8cd0-62bae4ff6671 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:27.963313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7792e-5fb7-4e77-8cd0-62bae4ff6671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:27.968306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 823/1664] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:27.973229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7792e-5fb7-4e77-8cd0-62bae4ff6671 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:27.973823 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d547b-93f8-48d5-a7dc-1cdf0b7a5f8c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:28.035016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d547b-93f8-48d5-a7dc-1cdf0b7a5f8c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:28.055640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dc020-05a6-4164-b3db-db6d0c25c969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:28.059942 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dc020-05a6-4164-b3db-db6d0c25c969 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:28.060671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dc020-05a6-4164-b3db-db6d0c25c969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:28.078851 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dc020-05a6-4164-b3db-db6d0c25c969 admin admin] PATH_INFO: `/v3/projects/96c76385e43a497ca267c3bc799ae35c/users/a16bd7264a4545868bf145cc9dc729c8/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:28.141350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 842/1665] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:27 2022] POST /identity/v3/projects => generated 403 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:28.150209 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7792e-5fb7-4e77-8cd0-62bae4ff6671 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:28.163492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9dc020-05a6-4164-b3db-db6d0c25c969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c76385e43a497ca267c3bc799ae35c, user_id=a16bd7264a4545868bf145cc9dc729c8, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:28.175900 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9dc020-05a6-4164-b3db-db6d0c25c969 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:28.253348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 824/1666] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:27 2022] PUT /identity/v3/projects/96c76385e43a497ca267c3bc799ae35c/users/a16bd7264a4545868bf145cc9dc729c8/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:28.276546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a99205-6ce6-419e-8e93-f7eb383a74fd None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:28.277765 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a99205-6ce6-419e-8e93-f7eb383a74fd None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:28.278555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a99205-6ce6-419e-8e93-f7eb383a74fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:28.421517 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-83a99205-6ce6-419e-8e93-f7eb383a74fd None None] MFA Rules not processed for user `a16bd7264a4545868bf145cc9dc729c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:28.423121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-83a99205-6ce6-419e-8e93-f7eb383a74fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:28.506859 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7792e-5fb7-4e77-8cd0-62bae4ff6671 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:28.658576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25483377-53e2-4125-9e12-9134db4a623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:28.659487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25483377-53e2-4125-9e12-9134db4a623f admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:28.675293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25483377-53e2-4125-9e12-9134db4a623f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:28.675293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25483377-53e2-4125-9e12-9134db4a623f admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:28.675293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25483377-53e2-4125-9e12-9134db4a623f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:28.675293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25483377-53e2-4125-9e12-9134db4a623f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:28.696407 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 825/1667] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:01:28.708982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a99205-6ce6-419e-8e93-f7eb383a74fd None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:28.747471 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 843/1668] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:28 2022] POST /identity/v3/users => generated 302 bytes in 601 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:01:28.750020 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25483377-53e2-4125-9e12-9134db4a623f admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:28.768942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25483377-53e2-4125-9e12-9134db4a623f admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:28.772433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a99205-6ce6-419e-8e93-f7eb383a74fd None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:28.780998 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc93a4-ee99-4b50-bcd4-6f921297a783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:28.784359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc93a4-ee99-4b50-bcd4-6f921297a783 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:28.785020 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ace5b1-681b-4f35-a929-157447924550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:28.785712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ace5b1-681b-4f35-a929-157447924550 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:28.786022 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ace5b1-681b-4f35-a929-157447924550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:28.786296 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ace5b1-681b-4f35-a929-157447924550 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:28.787006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ace5b1-681b-4f35-a929-157447924550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:28.788644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc93a4-ee99-4b50-bcd4-6f921297a783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:28.788951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ace5b1-681b-4f35-a929-157447924550 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:28.789160 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc93a4-ee99-4b50-bcd4-6f921297a783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:28.795739 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc93a4-ee99-4b50-bcd4-6f921297a783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:28.798320 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc93a4-ee99-4b50-bcd4-6f921297a783 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:28.834220 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 844/1669] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:28.838821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a93a9-416f-4309-b5ff-769b51139695 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:28.839626 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a93a9-416f-4309-b5ff-769b51139695 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:28.840039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a93a9-416f-4309-b5ff-769b51139695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:28.871088 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 826/1670] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:28 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:28.872433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ace5b1-681b-4f35-a929-157447924550 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:28.899432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d80a93a9-416f-4309-b5ff-769b51139695 None None] MFA Rules not processed for user `cef7ac127d2f4284a1808c580148c9e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:28.901580 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d80a93a9-416f-4309-b5ff-769b51139695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:28.974817 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:28.980417 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ace5b1-681b-4f35-a929-157447924550 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:28.987463 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36503bba-b65f-49b5-9798-9047437d8a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:28.988644 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36503bba-b65f-49b5-9798-9047437d8a24 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:28.989100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36503bba-b65f-49b5-9798-9047437d8a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:28.989548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36503bba-b65f-49b5-9798-9047437d8a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:28.990536 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36503bba-b65f-49b5-9798-9047437d8a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:28.992404 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36503bba-b65f-49b5-9798-9047437d8a24 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:29.004707 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 827/1671] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:29.005893 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36503bba-b65f-49b5-9798-9047437d8a24 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:29.027019 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36503bba-b65f-49b5-9798-9047437d8a24 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:29.034351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ca15b-e2dd-45ff-9381-662687007868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:29.035605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ca15b-e2dd-45ff-9381-662687007868 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:29.036172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ca15b-e2dd-45ff-9381-662687007868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:29.036591 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ca15b-e2dd-45ff-9381-662687007868 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:29.037667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ca15b-e2dd-45ff-9381-662687007868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:29.040668 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ca15b-e2dd-45ff-9381-662687007868 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:29.065319 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:29.083381 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 828/1672] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:29 2022] POST /identity/v3/users => generated 295 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:29.085053 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ca15b-e2dd-45ff-9381-662687007868 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:29.117347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ca15b-e2dd-45ff-9381-662687007868 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:29.132644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 845/1673] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:29.141673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a93a9-416f-4309-b5ff-769b51139695 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:29.147898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68725129-cfa1-46c0-b61d-1777db368041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:29.150894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68725129-cfa1-46c0-b61d-1777db368041 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:29.152661 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68725129-cfa1-46c0-b61d-1777db368041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:29.155445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68725129-cfa1-46c0-b61d-1777db368041 admin admin] PATH_INFO: `/v3/projects/cde5e4b4cad6485683a17fd692c225bd/users/f840039051fb435da95a5dadc7d87ac1/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:29.163954 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a93a9-416f-4309-b5ff-769b51139695 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:29.171290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67eafa7-a98c-4851-b388-53bb5bcd46d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:29.172560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67eafa7-a98c-4851-b388-53bb5bcd46d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:29.173032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67eafa7-a98c-4851-b388-53bb5bcd46d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:29.173433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67eafa7-a98c-4851-b388-53bb5bcd46d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:29.174362 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67eafa7-a98c-4851-b388-53bb5bcd46d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:29.176300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67eafa7-a98c-4851-b388-53bb5bcd46d0 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:29.197858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 846/1674] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:29.197858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67eafa7-a98c-4851-b388-53bb5bcd46d0 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:29.199847 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c67eafa7-a98c-4851-b388-53bb5bcd46d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:29.227630 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68725129-cfa1-46c0-b61d-1777db368041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde5e4b4cad6485683a17fd692c225bd, user_id=f840039051fb435da95a5dadc7d87ac1, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:29.230576 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68725129-cfa1-46c0-b61d-1777db368041 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:29.256952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 829/1675] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:29 2022] PUT /identity/v3/projects/cde5e4b4cad6485683a17fd692c225bd/users/f840039051fb435da95a5dadc7d87ac1/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:29.257822 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68725129-cfa1-46c0-b61d-1777db368041 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:29.338025 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67eafa7-a98c-4851-b388-53bb5bcd46d0 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:29.446487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f92fa4-6848-4727-bd59-b4951f8db289 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:29.448001 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f92fa4-6848-4727-bd59-b4951f8db289 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:29.448387 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f92fa4-6848-4727-bd59-b4951f8db289 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:29.448849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f92fa4-6848-4727-bd59-b4951f8db289 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:29.488813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68725129-cfa1-46c0-b61d-1777db368041 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:29.509025 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ee066-c0e9-4694-a3b9-c14e843f0df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:29.510282 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ee066-c0e9-4694-a3b9-c14e843f0df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:29.510692 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ee066-c0e9-4694-a3b9-c14e843f0df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:29.511095 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ee066-c0e9-4694-a3b9-c14e843f0df5 admin admin] PATH_INFO: `/v3/projects/49d795f8af4542e583a2f22c170655ae/users/99126a5dcbff481e8956c33711df3f81/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:29.545122 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ee066-c0e9-4694-a3b9-c14e843f0df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d795f8af4542e583a2f22c170655ae, user_id=99126a5dcbff481e8956c33711df3f81, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:29.548134 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ee066-c0e9-4694-a3b9-c14e843f0df5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:29.568407 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f92fa4-6848-4727-bd59-b4951f8db289 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:29.571769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f92fa4-6848-4727-bd59-b4951f8db289 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:29.584164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 830/1676] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:29 2022] PUT /identity/v3/projects/49d795f8af4542e583a2f22c170655ae/users/99126a5dcbff481e8956c33711df3f81/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:29.585651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658629fe-7049-48f8-8db7-03998597e753 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:29.585975 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658629fe-7049-48f8-8db7-03998597e753 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:29.586249 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658629fe-7049-48f8-8db7-03998597e753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:29.589648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 847/1677] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:29.591899 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f92fa4-6848-4727-bd59-b4951f8db289 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:29.609915 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f92fa4-6848-4727-bd59-b4951f8db289 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:29.633255 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:29.666519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-658629fe-7049-48f8-8db7-03998597e753 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:29.682745 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-658629fe-7049-48f8-8db7-03998597e753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:29.710813 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d174652-6189-4e24-845e-e38f97f7ed10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:29.711826 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d174652-6189-4e24-845e-e38f97f7ed10 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:29.712456 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d174652-6189-4e24-845e-e38f97f7ed10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:29.713389 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d174652-6189-4e24-845e-e38f97f7ed10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:29.714438 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d174652-6189-4e24-845e-e38f97f7ed10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:29.720802 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d174652-6189-4e24-845e-e38f97f7ed10 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:29.745076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 848/1678] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:29.750097 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d174652-6189-4e24-845e-e38f97f7ed10 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:29.767022 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d174652-6189-4e24-845e-e38f97f7ed10 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:29.779741 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb119caa-ad76-4a0b-a630-a37269a2888c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:29.782430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb119caa-ad76-4a0b-a630-a37269a2888c admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:29.783061 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb119caa-ad76-4a0b-a630-a37269a2888c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:29.783619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb119caa-ad76-4a0b-a630-a37269a2888c admin admin] PATH_INFO: `/v3/projects/49d795f8af4542e583a2f22c170655ae/users/99126a5dcbff481e8956c33711df3f81/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:29.789951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb119caa-ad76-4a0b-a630-a37269a2888c admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d795f8af4542e583a2f22c170655ae, user_id=99126a5dcbff481e8956c33711df3f81, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:29.798450 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb119caa-ad76-4a0b-a630-a37269a2888c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:29.827739 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 849/1679] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:29 2022] PUT /identity/v3/projects/49d795f8af4542e583a2f22c170655ae/users/99126a5dcbff481e8956c33711df3f81/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:29.849617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678baca-570d-4ee2-80eb-53f17fb185d3 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:29.849617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678baca-570d-4ee2-80eb-53f17fb185d3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:29.850048 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678baca-570d-4ee2-80eb-53f17fb185d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:29.920184 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 831/1680] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:29.936743 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5678baca-570d-4ee2-80eb-53f17fb185d3 None None] MFA Rules not processed for user `99126a5dcbff481e8956c33711df3f81`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:29.938021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5678baca-570d-4ee2-80eb-53f17fb185d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:29.942312 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658629fe-7049-48f8-8db7-03998597e753 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:29.943785 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-658629fe-7049-48f8-8db7-03998597e753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:30.108042 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:30.187706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658629fe-7049-48f8-8db7-03998597e753 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:30.247361 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 850/1681] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:01:30.260340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678baca-570d-4ee2-80eb-53f17fb185d3 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:30.261981 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5678baca-570d-4ee2-80eb-53f17fb185d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:30.317688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09c38c-7751-4167-9685-e26641060058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:30.318463 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09c38c-7751-4167-9685-e26641060058 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:30.318807 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09c38c-7751-4167-9685-e26641060058 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:30.319160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09c38c-7751-4167-9685-e26641060058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:30.430507 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678baca-570d-4ee2-80eb-53f17fb185d3 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:30.436028 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d54d56-37c9-402a-ac1c-5ac71f359e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:30.437284 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d54d56-37c9-402a-ac1c-5ac71f359e7a service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:30.437775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d54d56-37c9-402a-ac1c-5ac71f359e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:30.438144 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d54d56-37c9-402a-ac1c-5ac71f359e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:30.484010 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09c38c-7751-4167-9685-e26641060058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:30.485530 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09c38c-7751-4167-9685-e26641060058 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:30.514064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 832/1682] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:01:30.538939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:30.595185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d54d56-37c9-402a-ac1c-5ac71f359e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:30.597344 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d54d56-37c9-402a-ac1c-5ac71f359e7a service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:30.654655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 851/1683] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:01:31.360094 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09c38c-7751-4167-9685-e26641060058 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:31.362774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4e09c38c-7751-4167-9685-e26641060058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:31.395434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09c38c-7751-4167-9685-e26641060058 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:31.413788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cf86c-6549-4b64-b0a1-dd7b5bfbe052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:31.415940 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cf86c-6549-4b64-b0a1-dd7b5bfbe052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:31.416306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cf86c-6549-4b64-b0a1-dd7b5bfbe052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:31.418064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cf86c-6549-4b64-b0a1-dd7b5bfbe052 admin admin] PATH_INFO: `/v3/users/5bb0cf077f484094ae382ad949c24373` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:31.422984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792cf86c-6549-4b64-b0a1-dd7b5bfbe052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb0cf077f484094ae382ad949c24373)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:31.428974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792cf86c-6549-4b64-b0a1-dd7b5bfbe052 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:31.617363 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-792cf86c-6549-4b64-b0a1-dd7b5bfbe052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb0cf077f484094ae382ad949c24373'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:31.618211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-792cf86c-6549-4b64-b0a1-dd7b5bfbe052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb0cf077f484094ae382ad949c24373'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:31.635377 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-792cf86c-6549-4b64-b0a1-dd7b5bfbe052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb0cf077f484094ae382ad949c24373'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:31.674062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-792cf86c-6549-4b64-b0a1-dd7b5bfbe052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb0cf077f484094ae382ad949c24373'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:31.675068 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-792cf86c-6549-4b64-b0a1-dd7b5bfbe052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb0cf077f484094ae382ad949c24373'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:31.725403 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4997e8a-99af-46be-8cbc-45722d39032d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:31.725936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4997e8a-99af-46be-8cbc-45722d39032d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:31.726490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4997e8a-99af-46be-8cbc-45722d39032d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:31.728656 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 833/1684] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:01:31 2022] DELETE /identity/v3/users/5bb0cf077f484094ae382ad949c24373 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:31.796127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a4997e8a-99af-46be-8cbc-45722d39032d None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:31.797712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a4997e8a-99af-46be-8cbc-45722d39032d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:32.023511 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 852/1685] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:32.082898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cf86c-6549-4b64-b0a1-dd7b5bfbe052 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:32.084635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-792cf86c-6549-4b64-b0a1-dd7b5bfbe052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:32.147640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:32.321087 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cf86c-6549-4b64-b0a1-dd7b5bfbe052 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:32.335108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2518367-e20a-4301-ab46-57d72c5dc517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:32.336967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2518367-e20a-4301-ab46-57d72c5dc517 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:32.338501 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2518367-e20a-4301-ab46-57d72c5dc517 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:32.339428 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2518367-e20a-4301-ab46-57d72c5dc517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:32.367708 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2518367-e20a-4301-ab46-57d72c5dc517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:32.370079 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2518367-e20a-4301-ab46-57d72c5dc517 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:32.398226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 834/1686] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:32.819207 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdaddf-05f4-4682-8f47-5115aa2d68d6 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:32.820172 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdaddf-05f4-4682-8f47-5115aa2d68d6 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:32.820635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdaddf-05f4-4682-8f47-5115aa2d68d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:32.911976 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f5cdaddf-05f4-4682-8f47-5115aa2d68d6 None None] MFA Rules not processed for user `23aa142375c54b94ad276d1a4b9031e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:32.913760 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f5cdaddf-05f4-4682-8f47-5115aa2d68d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:33.091607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 853/1687] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 2 19:01:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:33.163824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2518367-e20a-4301-ab46-57d72c5dc517 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:33.165692 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f2518367-e20a-4301-ab46-57d72c5dc517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:33.197125 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2518367-e20a-4301-ab46-57d72c5dc517 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:33.208679 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e95518-6b45-4086-8af1-80feecf2dc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:33.214364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e95518-6b45-4086-8af1-80feecf2dc7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:33.214773 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e95518-6b45-4086-8af1-80feecf2dc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:33.215054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e95518-6b45-4086-8af1-80feecf2dc7a admin admin] PATH_INFO: `/v3/users/caaaf75b67df46cf9e3e67b231c2a4f2` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:33.219391 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e95518-6b45-4086-8af1-80feecf2dc7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=caaaf75b67df46cf9e3e67b231c2a4f2)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:33.224836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e95518-6b45-4086-8af1-80feecf2dc7a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:33.329386 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e0e95518-6b45-4086-8af1-80feecf2dc7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caaaf75b67df46cf9e3e67b231c2a4f2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:33.330340 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e0e95518-6b45-4086-8af1-80feecf2dc7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caaaf75b67df46cf9e3e67b231c2a4f2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:33.346717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e0e95518-6b45-4086-8af1-80feecf2dc7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caaaf75b67df46cf9e3e67b231c2a4f2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:33.351073 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdaddf-05f4-4682-8f47-5115aa2d68d6 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:33.352611 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f5cdaddf-05f4-4682-8f47-5115aa2d68d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:33.411062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e0e95518-6b45-4086-8af1-80feecf2dc7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caaaf75b67df46cf9e3e67b231c2a4f2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:33.412437 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e0e95518-6b45-4086-8af1-80feecf2dc7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caaaf75b67df46cf9e3e67b231c2a4f2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:33.444519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 835/1688] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:01:33 2022] DELETE /identity/v3/users/caaaf75b67df46cf9e3e67b231c2a4f2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:33.449533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ed04c-c61a-45b4-9309-6b51c5a85105 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:33.449914 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ed04c-c61a-45b4-9309-6b51c5a85105 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:33.450144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ed04c-c61a-45b4-9309-6b51c5a85105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:33.495400 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d02ed04c-c61a-45b4-9309-6b51c5a85105 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:33.499073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d02ed04c-c61a-45b4-9309-6b51c5a85105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:33.642277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdaddf-05f4-4682-8f47-5115aa2d68d6 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:33.743433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:33.756005 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 836/1689] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:01:33.834684 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ae8c3-1dac-4795-8ed1-d24e0796bfd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4faac48f82244bebf039aab92898617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:33.836081 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ae8c3-1dac-4795-8ed1-d24e0796bfd9 service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:33.836503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ae8c3-1dac-4795-8ed1-d24e0796bfd9 service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:33.836912 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ae8c3-1dac-4795-8ed1-d24e0796bfd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:33.842524 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c51ae8c3-1dac-4795-8ed1-d24e0796bfd9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:33.908596 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ed04c-c61a-45b4-9309-6b51c5a85105 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:33.910382 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d02ed04c-c61a-45b4-9309-6b51c5a85105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:33.976809 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ae8c3-1dac-4795-8ed1-d24e0796bfd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:33.978645 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ae8c3-1dac-4795-8ed1-d24e0796bfd9 service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:34.002628 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 854/1690] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 2 19:01:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:01:34.006594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:34.134746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb9a91-a971-4361-a2a3-80acbe985859 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:34.135141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb9a91-a971-4361-a2a3-80acbe985859 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:34.135506 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb9a91-a971-4361-a2a3-80acbe985859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:34.171500 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ed04c-c61a-45b4-9309-6b51c5a85105 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:34.173696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-69cb9a91-a971-4361-a2a3-80acbe985859 None None] MFA Rules not processed for user `cef7ac127d2f4284a1808c580148c9e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:34.178686 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-69cb9a91-a971-4361-a2a3-80acbe985859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:34.188693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225370f-5c54-469a-bf4d-2ba23d243bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:34.189396 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225370f-5c54-469a-bf4d-2ba23d243bcf service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:34.189680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225370f-5c54-469a-bf4d-2ba23d243bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:34.189989 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225370f-5c54-469a-bf4d-2ba23d243bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:34.220225 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225370f-5c54-469a-bf4d-2ba23d243bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:34.229037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225370f-5c54-469a-bf4d-2ba23d243bcf service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:34.270844 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 837/1691] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:34.376637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 855/1692] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:01:34.891230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225370f-5c54-469a-bf4d-2ba23d243bcf service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:34.892966 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a225370f-5c54-469a-bf4d-2ba23d243bcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:34.930049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225370f-5c54-469a-bf4d-2ba23d243bcf service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:34.969614 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0cefb-eb56-4cac-b8c5-c10d78798b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:34.972857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0cefb-eb56-4cac-b8c5-c10d78798b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:34.973840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0cefb-eb56-4cac-b8c5-c10d78798b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:34.974169 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0cefb-eb56-4cac-b8c5-c10d78798b0b admin admin] PATH_INFO: `/v3/projects/2c5cf4734d8e430db02969affe17b102` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:34.979347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0cefb-eb56-4cac-b8c5-c10d78798b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c5cf4734d8e430db02969affe17b102)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:35.002900 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0cefb-eb56-4cac-b8c5-c10d78798b0b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:35.320896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-80e0cefb-eb56-4cac-b8c5-c10d78798b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c5cf4734d8e430db02969affe17b102', 'request_id': 'req-80e0cefb-eb56-4cac-b8c5-c10d78798b0b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:35.360829 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-80e0cefb-eb56-4cac-b8c5-c10d78798b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c5cf4734d8e430db02969affe17b102', 'request_id': 'req-80e0cefb-eb56-4cac-b8c5-c10d78798b0b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:35.385555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-80e0cefb-eb56-4cac-b8c5-c10d78798b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c5cf4734d8e430db02969affe17b102', 'request_id': 'req-80e0cefb-eb56-4cac-b8c5-c10d78798b0b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:35.434806 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-80e0cefb-eb56-4cac-b8c5-c10d78798b0b admin admin] The token cache is being invalidate because project 2c5cf4734d8e430db02969affe17b102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:01:35.438890 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd765b9d-be73-421f-be27-b3c905fc1a9e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:35.439424 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd765b9d-be73-421f-be27-b3c905fc1a9e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:35.439506 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd765b9d-be73-421f-be27-b3c905fc1a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:35.441079 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-80e0cefb-eb56-4cac-b8c5-c10d78798b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:35.442196 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-80e0cefb-eb56-4cac-b8c5-c10d78798b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:35.448668 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 838/1693] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:01:34 2022] DELETE /identity/v3/projects/2c5cf4734d8e430db02969affe17b102 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:01:35.456538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1136f-d1ec-4e47-818b-ec4c56ec60e7 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:35.456896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1136f-d1ec-4e47-818b-ec4c56ec60e7 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:35.457334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1136f-d1ec-4e47-818b-ec4c56ec60e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:35.547178 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e7d1136f-d1ec-4e47-818b-ec4c56ec60e7 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:35.548435 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e7d1136f-d1ec-4e47-818b-ec4c56ec60e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:35.567853 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-bd765b9d-be73-421f-be27-b3c905fc1a9e None None] MFA Rules not processed for user `f840039051fb435da95a5dadc7d87ac1`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:35.575271 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-bd765b9d-be73-421f-be27-b3c905fc1a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:35.807270 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 839/1694] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:35.809207 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29f3ce-cac7-4de1-82e1-0c24d919f5d8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:35.810732 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29f3ce-cac7-4de1-82e1-0c24d919f5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:35.812372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29f3ce-cac7-4de1-82e1-0c24d919f5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:35.858473 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 856/1695] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:35.859944 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd765b9d-be73-421f-be27-b3c905fc1a9e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:35.861776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ad29f3ce-cac7-4de1-82e1-0c24d919f5d8 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:35.863142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-bd765b9d-be73-421f-be27-b3c905fc1a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:35.866608 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ad29f3ce-cac7-4de1-82e1-0c24d919f5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:35.878242 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:35.891448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 840/1696] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:35.892707 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29f3ce-cac7-4de1-82e1-0c24d919f5d8 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:35.898359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd765b9d-be73-421f-be27-b3c905fc1a9e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:35.912075 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff731b34-d56c-4832-a7ff-0db68d1f4ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:35.913594 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff731b34-d56c-4832-a7ff-0db68d1f4ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:35.914094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff731b34-d56c-4832-a7ff-0db68d1f4ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:35.918267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff731b34-d56c-4832-a7ff-0db68d1f4ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:35.921193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff731b34-d56c-4832-a7ff-0db68d1f4ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:35.921884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29f3ce-cac7-4de1-82e1-0c24d919f5d8 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:35.925202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff731b34-d56c-4832-a7ff-0db68d1f4ca7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:35.933753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ae8e7-6b28-4eee-8c5f-1fba3027b0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:35.935974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae8e7-6b28-4eee-8c5f-1fba3027b0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:35.937409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae8e7-6b28-4eee-8c5f-1fba3027b0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:35.937938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae8e7-6b28-4eee-8c5f-1fba3027b0a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:35.940364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ae8e7-6b28-4eee-8c5f-1fba3027b0a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:35.940967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ae8e7-6b28-4eee-8c5f-1fba3027b0a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:35.945493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ae8e7-6b28-4eee-8c5f-1fba3027b0a2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:35.979433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 841/1697] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:35.984432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ae8e7-6b28-4eee-8c5f-1fba3027b0a2 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:36.000238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 857/1698] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:35 2022] POST /identity/v3/projects => generated 405 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:36.004237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff731b34-d56c-4832-a7ff-0db68d1f4ca7 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:36.006055 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ae8e7-6b28-4eee-8c5f-1fba3027b0a2 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:36.133777 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:36.212037 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff731b34-d56c-4832-a7ff-0db68d1f4ca7 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:36.251379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616d0ee-79f7-4cfa-98e5-20f8091df977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:36.255066 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616d0ee-79f7-4cfa-98e5-20f8091df977 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:36.256306 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616d0ee-79f7-4cfa-98e5-20f8091df977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:36.257240 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616d0ee-79f7-4cfa-98e5-20f8091df977 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:36.259177 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616d0ee-79f7-4cfa-98e5-20f8091df977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:36.273346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68105c3-9beb-41c7-9cdf-4a1ea1c13dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:36.273776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616d0ee-79f7-4cfa-98e5-20f8091df977 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:36.274761 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68105c3-9beb-41c7-9cdf-4a1ea1c13dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:36.275316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68105c3-9beb-41c7-9cdf-4a1ea1c13dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:36.276045 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68105c3-9beb-41c7-9cdf-4a1ea1c13dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:36.279857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68105c3-9beb-41c7-9cdf-4a1ea1c13dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:36.283785 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68105c3-9beb-41c7-9cdf-4a1ea1c13dd4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:36.330164 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 858/1699] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:36 2022] POST /identity/v3/users => generated 309 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:36.336912 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616d0ee-79f7-4cfa-98e5-20f8091df977 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:36.384099 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616d0ee-79f7-4cfa-98e5-20f8091df977 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:36.428713 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d2a12-3ccf-4ab3-b11a-958736a774a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:36.431438 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d2a12-3ccf-4ab3-b11a-958736a774a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:36.434652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d2a12-3ccf-4ab3-b11a-958736a774a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:36.435252 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d2a12-3ccf-4ab3-b11a-958736a774a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:36.439401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d2a12-3ccf-4ab3-b11a-958736a774a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:36.459321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d2a12-3ccf-4ab3-b11a-958736a774a7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:36.510188 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 842/1700] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:35 2022] POST /identity/v3/projects => generated 369 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:36.514896 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 859/1701] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:36.530201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68105c3-9beb-41c7-9cdf-4a1ea1c13dd4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:36.538353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d2a12-3ccf-4ab3-b11a-958736a774a7 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:36.595558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d2a12-3ccf-4ab3-b11a-958736a774a7 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:36.826692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e960324-3161-44cd-aded-0a7ebedeaab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:36.826970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e960324-3161-44cd-aded-0a7ebedeaab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:36.827264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e960324-3161-44cd-aded-0a7ebedeaab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:36.827562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e960324-3161-44cd-aded-0a7ebedeaab6 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:36.828648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e960324-3161-44cd-aded-0a7ebedeaab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:36.830967 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e960324-3161-44cd-aded-0a7ebedeaab6 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:36.842127 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68105c3-9beb-41c7-9cdf-4a1ea1c13dd4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:36.863834 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d66c6-87cb-4256-b739-f6c03c18c61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:36.871399 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d66c6-87cb-4256-b739-f6c03c18c61d admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:36.873322 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d66c6-87cb-4256-b739-f6c03c18c61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:36.874680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d66c6-87cb-4256-b739-f6c03c18c61d admin admin] PATH_INFO: `/v3/projects/83ba569a1fab4591bea861d3ca8144d8/users/61a5dcf4519f42b8bab7094ddc1ce818/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:36.938193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 860/1702] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:36 2022] POST /identity/v3/users => generated 285 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:36.939785 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e960324-3161-44cd-aded-0a7ebedeaab6 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:36.950286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8e960324-3161-44cd-aded-0a7ebedeaab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:36.972279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d66c6-87cb-4256-b739-f6c03c18c61d admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ba569a1fab4591bea861d3ca8144d8, user_id=61a5dcf4519f42b8bab7094ddc1ce818, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:36.991022 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d66c6-87cb-4256-b739-f6c03c18c61d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:37.061422 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 843/1703] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:36 2022] PUT /identity/v3/projects/83ba569a1fab4591bea861d3ca8144d8/users/61a5dcf4519f42b8bab7094ddc1ce818/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:37.061422 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d66c6-87cb-4256-b739-f6c03c18c61d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:37.134972 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:37.156716 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e960324-3161-44cd-aded-0a7ebedeaab6 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:37.383259 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2da00b-d52f-41b2-b965-aa27a9eb173f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:37.384364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2da00b-d52f-41b2-b965-aa27a9eb173f service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:37.384869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2da00b-d52f-41b2-b965-aa27a9eb173f service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:37.385355 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2da00b-d52f-41b2-b965-aa27a9eb173f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:37.385744 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d66c6-87cb-4256-b739-f6c03c18c61d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:37.394477 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fd2da00b-d52f-41b2-b965-aa27a9eb173f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:37.414006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18676b-9181-47c4-ba43-58810d84b93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:37.414762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18676b-9181-47c4-ba43-58810d84b93b admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:37.415041 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18676b-9181-47c4-ba43-58810d84b93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:37.419338 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18676b-9181-47c4-ba43-58810d84b93b admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:37.423263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18676b-9181-47c4-ba43-58810d84b93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:37.429622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18676b-9181-47c4-ba43-58810d84b93b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:37.489510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 844/1704] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:37.491128 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18676b-9181-47c4-ba43-58810d84b93b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:37.532805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18676b-9181-47c4-ba43-58810d84b93b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:37.561006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48620df9-b971-45dc-b0ee-55efd738625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:37.561743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48620df9-b971-45dc-b0ee-55efd738625b admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:37.562046 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48620df9-b971-45dc-b0ee-55efd738625b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:37.562318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48620df9-b971-45dc-b0ee-55efd738625b admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:37.570638 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48620df9-b971-45dc-b0ee-55efd738625b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:37.575725 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48620df9-b971-45dc-b0ee-55efd738625b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:37.628321 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 845/1705] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:37.630001 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48620df9-b971-45dc-b0ee-55efd738625b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:37.634557 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-48620df9-b971-45dc-b0ee-55efd738625b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:37.696305 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2da00b-d52f-41b2-b965-aa27a9eb173f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:37.701231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2da00b-d52f-41b2-b965-aa27a9eb173f service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:37.711724 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48620df9-b971-45dc-b0ee-55efd738625b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:37.730959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76287253-ced5-4217-a0b2-3dc7c1d090a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:37.738760 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76287253-ced5-4217-a0b2-3dc7c1d090a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:37.739280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76287253-ced5-4217-a0b2-3dc7c1d090a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:37.739713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76287253-ced5-4217-a0b2-3dc7c1d090a2 admin admin] PATH_INFO: `/v3/projects/2d7356c4c0c641c9bed979fc7a5558be` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:37.746528 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76287253-ced5-4217-a0b2-3dc7c1d090a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7356c4c0c641c9bed979fc7a5558be)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:37.749190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 861/1706] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 810 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:37.755269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2da00b-d52f-41b2-b965-aa27a9eb173f service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:37.762764 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76287253-ced5-4217-a0b2-3dc7c1d090a2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:37.816176 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2da00b-d52f-41b2-b965-aa27a9eb173f service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:37.844185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85942b1-9acd-42fe-bdce-46f06eed2c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:37.847882 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85942b1-9acd-42fe-bdce-46f06eed2c1e admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:37.849764 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85942b1-9acd-42fe-bdce-46f06eed2c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:37.850168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85942b1-9acd-42fe-bdce-46f06eed2c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:37.852762 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85942b1-9acd-42fe-bdce-46f06eed2c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:37.860494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85942b1-9acd-42fe-bdce-46f06eed2c1e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:37.892844 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:37.917183 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 862/1707] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:37.920951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85942b1-9acd-42fe-bdce-46f06eed2c1e admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:37.961294 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85942b1-9acd-42fe-bdce-46f06eed2c1e admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:38.050790 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-76287253-ced5-4217-a0b2-3dc7c1d090a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7356c4c0c641c9bed979fc7a5558be', 'request_id': 'req-76287253-ced5-4217-a0b2-3dc7c1d090a2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:38.092895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-76287253-ced5-4217-a0b2-3dc7c1d090a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7356c4c0c641c9bed979fc7a5558be', 'request_id': 'req-76287253-ced5-4217-a0b2-3dc7c1d090a2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:38.128149 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-76287253-ced5-4217-a0b2-3dc7c1d090a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7356c4c0c641c9bed979fc7a5558be', 'request_id': 'req-76287253-ced5-4217-a0b2-3dc7c1d090a2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:38.140471 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffa769-d27c-437d-9039-b0570a1d1018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:38.145918 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffa769-d27c-437d-9039-b0570a1d1018 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:38.146330 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffa769-d27c-437d-9039-b0570a1d1018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:38.148171 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffa769-d27c-437d-9039-b0570a1d1018 admin admin] PATH_INFO: `/v3/projects/83ba569a1fab4591bea861d3ca8144d8/users/61a5dcf4519f42b8bab7094ddc1ce818/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:38.156775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffa769-d27c-437d-9039-b0570a1d1018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ba569a1fab4591bea861d3ca8144d8, user_id=61a5dcf4519f42b8bab7094ddc1ce818, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:38.162406 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffa769-d27c-437d-9039-b0570a1d1018 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:38.166838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-76287253-ced5-4217-a0b2-3dc7c1d090a2 admin admin] The token cache is being invalidate because project 2d7356c4c0c641c9bed979fc7a5558be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:01:38.167206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-76287253-ced5-4217-a0b2-3dc7c1d090a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:38.167962 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-76287253-ced5-4217-a0b2-3dc7c1d090a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:38.192441 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 846/1708] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:01:37 2022] DELETE /identity/v3/projects/2d7356c4c0c641c9bed979fc7a5558be => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:38.195464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76287253-ced5-4217-a0b2-3dc7c1d090a2 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:38.202064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-76287253-ced5-4217-a0b2-3dc7c1d090a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:38.202201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 863/1709] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:37 2022] PUT /identity/v3/projects/83ba569a1fab4591bea861d3ca8144d8/users/61a5dcf4519f42b8bab7094ddc1ce818/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:38.208712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a48e8-970b-4526-8d17-0284b2cc0119 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:38.209034 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a48e8-970b-4526-8d17-0284b2cc0119 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:38.210744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a48e8-970b-4526-8d17-0284b2cc0119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:38.244927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76287253-ced5-4217-a0b2-3dc7c1d090a2 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:38.306764 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e58a48e8-970b-4526-8d17-0284b2cc0119 None None] MFA Rules not processed for user `4a660a47927140d6b4d0543de5e281a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:38.313276 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e58a48e8-970b-4526-8d17-0284b2cc0119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:38.395740 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:38.550639 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 864/1710] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:38.552805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88c68c-779e-4efc-b7fd-dad88c988640 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:38.553041 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88c68c-779e-4efc-b7fd-dad88c988640 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:38.553470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88c68c-779e-4efc-b7fd-dad88c988640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:38.600264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9b88c68c-779e-4efc-b7fd-dad88c988640 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:38.604020 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9b88c68c-779e-4efc-b7fd-dad88c988640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:38.618045 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc97ad-d6fd-4e8f-aee8-5f546cb8339f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:38.624432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc97ad-d6fd-4e8f-aee8-5f546cb8339f admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:38.624960 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc97ad-d6fd-4e8f-aee8-5f546cb8339f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:38.625354 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc97ad-d6fd-4e8f-aee8-5f546cb8339f admin admin] PATH_INFO: `/v3/projects/8da9a91ff19b4c96846e834f6e2c23da/users/4397bc0158e7425092c75c2b30bc2832/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:38.630604 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 865/1711] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:38.641691 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd6a25-1c3a-4423-9b0f-f5cf955c6919 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:38.644141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd6a25-1c3a-4423-9b0f-f5cf955c6919 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:38.645216 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd6a25-1c3a-4423-9b0f-f5cf955c6919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:38.711359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e8dd6a25-1c3a-4423-9b0f-f5cf955c6919 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:38.718060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e8dd6a25-1c3a-4423-9b0f-f5cf955c6919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:38.747945 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 866/1712] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:38.755897 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc97ad-d6fd-4e8f-aee8-5f546cb8339f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8da9a91ff19b4c96846e834f6e2c23da, user_id=4397bc0158e7425092c75c2b30bc2832, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:38.756898 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd6a25-1c3a-4423-9b0f-f5cf955c6919 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:38.771010 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc97ad-d6fd-4e8f-aee8-5f546cb8339f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:38.784902 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd6a25-1c3a-4423-9b0f-f5cf955c6919 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:38.797970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d525dc4-76e7-4a22-9d2e-6c3d46c6e2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:38.798748 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d525dc4-76e7-4a22-9d2e-6c3d46c6e2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:38.799037 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d525dc4-76e7-4a22-9d2e-6c3d46c6e2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:38.799315 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d525dc4-76e7-4a22-9d2e-6c3d46c6e2d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:38.800278 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d525dc4-76e7-4a22-9d2e-6c3d46c6e2d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:38.800445 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d525dc4-76e7-4a22-9d2e-6c3d46c6e2d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:38.811394 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d525dc4-76e7-4a22-9d2e-6c3d46c6e2d6 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:38.835447 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 847/1713] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:38 2022] PUT /identity/v3/projects/8da9a91ff19b4c96846e834f6e2c23da/users/4397bc0158e7425092c75c2b30bc2832/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:38.847137 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4518ec-c3b2-4d53-a71e-a4f355efe7dd None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:38.849732 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4518ec-c3b2-4d53-a71e-a4f355efe7dd None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:38.849732 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4518ec-c3b2-4d53-a71e-a4f355efe7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:38.856183 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 867/1714] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:38.865698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d525dc4-76e7-4a22-9d2e-6c3d46c6e2d6 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:38.897452 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d525dc4-76e7-4a22-9d2e-6c3d46c6e2d6 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:39.030868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ae4518ec-c3b2-4d53-a71e-a4f355efe7dd None None] MFA Rules not processed for user `4397bc0158e7425092c75c2b30bc2832`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:39.032302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ae4518ec-c3b2-4d53-a71e-a4f355efe7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:39.111837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9ee67-004b-4365-9343-4c5ab3d6f5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:39.112634 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9ee67-004b-4365-9343-4c5ab3d6f5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:39.113219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9ee67-004b-4365-9343-4c5ab3d6f5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:39.113591 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9ee67-004b-4365-9343-4c5ab3d6f5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:39.114459 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9ee67-004b-4365-9343-4c5ab3d6f5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:39.116833 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9ee67-004b-4365-9343-4c5ab3d6f5a8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:39.191613 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 868/1715] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:38 2022] POST /identity/v3/projects => generated 405 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:39.192633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9ee67-004b-4365-9343-4c5ab3d6f5a8 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:39.203638 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 848/1716] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:39.208887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4518ec-c3b2-4d53-a71e-a4f355efe7dd None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:39.242408 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4518ec-c3b2-4d53-a71e-a4f355efe7dd None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:39.317182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:39.376235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9ee67-004b-4365-9343-4c5ab3d6f5a8 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:39.383087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87784e40-90a2-4632-912c-8228608881ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:39.384388 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87784e40-90a2-4632-912c-8228608881ff admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:39.384950 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87784e40-90a2-4632-912c-8228608881ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:39.385372 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87784e40-90a2-4632-912c-8228608881ff admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:39.386509 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87784e40-90a2-4632-912c-8228608881ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:39.388808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87784e40-90a2-4632-912c-8228608881ff admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:39.414556 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a209b-e92f-467a-a2a0-506a0365556e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:39.415596 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a209b-e92f-467a-a2a0-506a0365556e admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:39.416281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a209b-e92f-467a-a2a0-506a0365556e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:39.416629 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a209b-e92f-467a-a2a0-506a0365556e admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:39.417447 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a209b-e92f-467a-a2a0-506a0365556e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:39.421295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a209b-e92f-467a-a2a0-506a0365556e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:39.453601 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 869/1717] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:39 2022] POST /identity/v3/users => generated 303 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:39.455087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87784e40-90a2-4632-912c-8228608881ff admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:39.470859 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87784e40-90a2-4632-912c-8228608881ff admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:39.486379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c58278-b5d2-49d5-a4c0-b640fc467828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:39.487493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c58278-b5d2-49d5-a4c0-b640fc467828 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:39.487966 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c58278-b5d2-49d5-a4c0-b640fc467828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:39.488382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c58278-b5d2-49d5-a4c0-b640fc467828 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:39.489620 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c58278-b5d2-49d5-a4c0-b640fc467828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:39.493755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c58278-b5d2-49d5-a4c0-b640fc467828 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:39.505968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 849/1718] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:39 2022] POST /identity/v3/projects => generated 369 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:39.507017 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a209b-e92f-467a-a2a0-506a0365556e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:39.508217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 870/1719] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:39.514325 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c58278-b5d2-49d5-a4c0-b640fc467828 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:39.526292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:39.538003 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c58278-b5d2-49d5-a4c0-b640fc467828 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:39.696932 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ee9d8-c031-46a8-86e1-86d9d5a51171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:39.697731 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ee9d8-c031-46a8-86e1-86d9d5a51171 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:39.698232 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ee9d8-c031-46a8-86e1-86d9d5a51171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:39.698465 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ee9d8-c031-46a8-86e1-86d9d5a51171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:39.699722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ee9d8-c031-46a8-86e1-86d9d5a51171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:39.702040 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ee9d8-c031-46a8-86e1-86d9d5a51171 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:39.722576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 871/1720] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:39.723875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ee9d8-c031-46a8-86e1-86d9d5a51171 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:39.725960 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4d8ee9d8-c031-46a8-86e1-86d9d5a51171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:39.738125 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a209b-e92f-467a-a2a0-506a0365556e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:39.745247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fc02e-792f-4f04-a81d-0d1c4ba67ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:39.746497 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fc02e-792f-4f04-a81d-0d1c4ba67ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:39.746979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fc02e-792f-4f04-a81d-0d1c4ba67ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:39.747456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fc02e-792f-4f04-a81d-0d1c4ba67ae7 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:39.748368 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fc02e-792f-4f04-a81d-0d1c4ba67ae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:39.750630 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fc02e-792f-4f04-a81d-0d1c4ba67ae7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:39.792928 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 850/1721] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:39 2022] POST /identity/v3/users => generated 291 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:39.794395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fc02e-792f-4f04-a81d-0d1c4ba67ae7 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:39.826547 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fc02e-792f-4f04-a81d-0d1c4ba67ae7 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:39.835550 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850b04d-8527-4147-85f7-d722ea21c0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:39.836323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ee9d8-c031-46a8-86e1-86d9d5a51171 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:39.837153 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850b04d-8527-4147-85f7-d722ea21c0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:39.837614 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850b04d-8527-4147-85f7-d722ea21c0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:39.838100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850b04d-8527-4147-85f7-d722ea21c0fe admin admin] PATH_INFO: `/v3/projects/bd1134d747cc43078ecc2a987569b667/users/10c95a54339043cfb92d2f8e04ccaeb4/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:39.843371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac9b93-d41c-487c-86d5-1fd9f4ae1e25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:39.844279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac9b93-d41c-487c-86d5-1fd9f4ae1e25 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:39.845592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac9b93-d41c-487c-86d5-1fd9f4ae1e25 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:39.845958 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac9b93-d41c-487c-86d5-1fd9f4ae1e25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:39.875127 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850b04d-8527-4147-85f7-d722ea21c0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1134d747cc43078ecc2a987569b667, user_id=10c95a54339043cfb92d2f8e04ccaeb4, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:39.887627 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850b04d-8527-4147-85f7-d722ea21c0fe admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:39.946951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 851/1722] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:39 2022] PUT /identity/v3/projects/bd1134d747cc43078ecc2a987569b667/users/10c95a54339043cfb92d2f8e04ccaeb4/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:39.987758 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850b04d-8527-4147-85f7-d722ea21c0fe admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:40.085197 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac9b93-d41c-487c-86d5-1fd9f4ae1e25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:40.088367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac9b93-d41c-487c-86d5-1fd9f4ae1e25 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:40.109532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 872/1723] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:40.112612 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8d648-9d60-4954-beff-cb9d90f1aed4 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:40.113457 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8d648-9d60-4954-beff-cb9d90f1aed4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:40.114319 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8d648-9d60-4954-beff-cb9d90f1aed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:40.195032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-dfa8d648-9d60-4954-beff-cb9d90f1aed4 None None] MFA Rules not processed for user `10c95a54339043cfb92d2f8e04ccaeb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:40.198582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-dfa8d648-9d60-4954-beff-cb9d90f1aed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:40.254456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850b04d-8527-4147-85f7-d722ea21c0fe admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:40.269472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a679304-5bd3-4e52-8e4b-0374a3472316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:40.270337 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a679304-5bd3-4e52-8e4b-0374a3472316 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:40.270912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a679304-5bd3-4e52-8e4b-0374a3472316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:40.271272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a679304-5bd3-4e52-8e4b-0374a3472316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:40.280026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a679304-5bd3-4e52-8e4b-0374a3472316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:40.281871 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:40.285561 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a679304-5bd3-4e52-8e4b-0374a3472316 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:40.312427 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 852/1724] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:40.320128 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a679304-5bd3-4e52-8e4b-0374a3472316 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:40.345984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a679304-5bd3-4e52-8e4b-0374a3472316 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:40.358119 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c7160-47eb-4c2f-9537-68c13f2fdd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:40.360163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c7160-47eb-4c2f-9537-68c13f2fdd46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:40.360737 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c7160-47eb-4c2f-9537-68c13f2fdd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:40.361030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c7160-47eb-4c2f-9537-68c13f2fdd46 admin admin] PATH_INFO: `/v3/projects/e619bf7c8e7646a3b17ea1b231b5472c/users/d589020615e247b5b529974a1fb9e621/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:40.369980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:40.403783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c7160-47eb-4c2f-9537-68c13f2fdd46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e619bf7c8e7646a3b17ea1b231b5472c, user_id=d589020615e247b5b529974a1fb9e621, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:40.406745 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c7160-47eb-4c2f-9537-68c13f2fdd46 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:40.422269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 873/1725] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:40.423228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8d648-9d60-4954-beff-cb9d90f1aed4 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:40.439285 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 853/1726] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:40 2022] PUT /identity/v3/projects/e619bf7c8e7646a3b17ea1b231b5472c/users/d589020615e247b5b529974a1fb9e621/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:01:40.443675 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c7160-47eb-4c2f-9537-68c13f2fdd46 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:40.462637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8d648-9d60-4954-beff-cb9d90f1aed4 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:40.616019 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c7160-47eb-4c2f-9537-68c13f2fdd46 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:40.634653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6912a1-c1ca-450d-984f-73eb4bf8ac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:40.636273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6912a1-c1ca-450d-984f-73eb4bf8ac01 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:40.638264 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6912a1-c1ca-450d-984f-73eb4bf8ac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:40.638618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6912a1-c1ca-450d-984f-73eb4bf8ac01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:40.639952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6912a1-c1ca-450d-984f-73eb4bf8ac01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:40.642505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6912a1-c1ca-450d-984f-73eb4bf8ac01 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:40.684592 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 854/1727] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:01:40.689486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6912a1-c1ca-450d-984f-73eb4bf8ac01 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:40.720879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6912a1-c1ca-450d-984f-73eb4bf8ac01 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:40.730098 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb06530-a06e-4c5a-960b-7962a1ce4af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:40.732826 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb06530-a06e-4c5a-960b-7962a1ce4af1 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:40.735340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb06530-a06e-4c5a-960b-7962a1ce4af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:40.736632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb06530-a06e-4c5a-960b-7962a1ce4af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:40.737664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb06530-a06e-4c5a-960b-7962a1ce4af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:40.743013 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad964e-2512-41ad-8844-bf9449c83b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:40.744556 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb06530-a06e-4c5a-960b-7962a1ce4af1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:40.749889 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad964e-2512-41ad-8844-bf9449c83b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:40.750265 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad964e-2512-41ad-8844-bf9449c83b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:40.756575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad964e-2512-41ad-8844-bf9449c83b71 admin admin] PATH_INFO: `/v3/projects/e619bf7c8e7646a3b17ea1b231b5472c/users/d589020615e247b5b529974a1fb9e621/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:40.763047 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad964e-2512-41ad-8844-bf9449c83b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e619bf7c8e7646a3b17ea1b231b5472c, user_id=d589020615e247b5b529974a1fb9e621, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:40.770378 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad964e-2512-41ad-8844-bf9449c83b71 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:40.863146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 855/1728] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:40 2022] PUT /identity/v3/projects/e619bf7c8e7646a3b17ea1b231b5472c/users/d589020615e247b5b529974a1fb9e621/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:40.884160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93746da7-cbb0-4726-8923-672aafc38503 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:40.884495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93746da7-cbb0-4726-8923-672aafc38503 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:40.885280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93746da7-cbb0-4726-8923-672aafc38503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:40.905771 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 874/1729] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:40 2022] POST /identity/v3/projects => generated 405 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:40.908417 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7acedd-57cb-436d-a2a6-ee550269a2d3 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:40.911744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7acedd-57cb-436d-a2a6-ee550269a2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:40.914622 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7acedd-57cb-436d-a2a6-ee550269a2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:40.988124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-93746da7-cbb0-4726-8923-672aafc38503 None None] MFA Rules not processed for user `61a5dcf4519f42b8bab7094ddc1ce818`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:40.991560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-93746da7-cbb0-4726-8923-672aafc38503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:41.040890 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4e7acedd-57cb-436d-a2a6-ee550269a2d3 None None] MFA Rules not processed for user `d589020615e247b5b529974a1fb9e621`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:41.049954 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4e7acedd-57cb-436d-a2a6-ee550269a2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:41.253415 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 856/1730] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:40 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:41.254074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 875/1731] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:40 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:41.254636 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93746da7-cbb0-4726-8923-672aafc38503 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:41.273614 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7acedd-57cb-436d-a2a6-ee550269a2d3 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:41.275184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4e7acedd-57cb-436d-a2a6-ee550269a2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:41.376433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:41.378009 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:41.404124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93746da7-cbb0-4726-8923-672aafc38503 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:41.411368 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7acedd-57cb-436d-a2a6-ee550269a2d3 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:41.416748 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db6e86-112e-4ab1-b694-d1f085e86d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:41.417504 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db6e86-112e-4ab1-b694-d1f085e86d1a admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:41.417826 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db6e86-112e-4ab1-b694-d1f085e86d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:41.418475 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db6e86-112e-4ab1-b694-d1f085e86d1a admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:41.419230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db6e86-112e-4ab1-b694-d1f085e86d1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:41.422518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ed486-4411-413a-a94c-de833724b73e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:41.423266 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ed486-4411-413a-a94c-de833724b73e service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:41.424961 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ed486-4411-413a-a94c-de833724b73e service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:41.425249 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ed486-4411-413a-a94c-de833724b73e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:41.425879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db6e86-112e-4ab1-b694-d1f085e86d1a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:41.453213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ed486-4411-413a-a94c-de833724b73e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:41.454841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ed486-4411-413a-a94c-de833724b73e service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:41.479122 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 876/1732] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:41 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:41.489250 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 857/1733] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:41 2022] POST /identity/v3/users => generated 309 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:41.493231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ed486-4411-413a-a94c-de833724b73e service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:41.508089 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ed486-4411-413a-a94c-de833724b73e service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:41.529846 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb56859-c5b4-4235-ae32-233e6177fc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:41.530561 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb56859-c5b4-4235-ae32-233e6177fc8f admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:41.530875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb56859-c5b4-4235-ae32-233e6177fc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:41.532348 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb56859-c5b4-4235-ae32-233e6177fc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:41.533328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb56859-c5b4-4235-ae32-233e6177fc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:41.536466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb56859-c5b4-4235-ae32-233e6177fc8f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:41.564184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 877/1734] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:41.565917 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db6e86-112e-4ab1-b694-d1f085e86d1a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:41.627322 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db6e86-112e-4ab1-b694-d1f085e86d1a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:41.645207 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71271f6e-1a55-4a18-b0fc-2b99493fd283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:41.651810 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71271f6e-1a55-4a18-b0fc-2b99493fd283 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:41.652291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71271f6e-1a55-4a18-b0fc-2b99493fd283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:41.652861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71271f6e-1a55-4a18-b0fc-2b99493fd283 admin admin] PATH_INFO: `/v3/projects/c2697520a5f943979b629a828932189d/users/ddcfad778fdf4db588db77faec5e5bd0/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:41.744968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71271f6e-1a55-4a18-b0fc-2b99493fd283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2697520a5f943979b629a828932189d, user_id=ddcfad778fdf4db588db77faec5e5bd0, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:41.751082 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71271f6e-1a55-4a18-b0fc-2b99493fd283 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:41.826407 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb56859-c5b4-4235-ae32-233e6177fc8f admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:41.837181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 858/1735] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:41 2022] PUT /identity/v3/projects/c2697520a5f943979b629a828932189d/users/ddcfad778fdf4db588db77faec5e5bd0/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:41.849084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb56859-c5b4-4235-ae32-233e6177fc8f admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:42.102086 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824d0db-5b0e-415f-86c0-4ddccfecf30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:42.102820 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d0db-5b0e-415f-86c0-4ddccfecf30d admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:42.103106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d0db-5b0e-415f-86c0-4ddccfecf30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:42.103426 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d0db-5b0e-415f-86c0-4ddccfecf30d admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:42.104127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824d0db-5b0e-415f-86c0-4ddccfecf30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:42.106120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824d0db-5b0e-415f-86c0-4ddccfecf30d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:42.135202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71271f6e-1a55-4a18-b0fc-2b99493fd283 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:42.138297 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 878/1736] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:42.153618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71271f6e-1a55-4a18-b0fc-2b99493fd283 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:42.164266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd8af7-8b92-431d-9553-a5894e9d0917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:42.167934 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd8af7-8b92-431d-9553-a5894e9d0917 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:42.169361 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd8af7-8b92-431d-9553-a5894e9d0917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:42.170141 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd8af7-8b92-431d-9553-a5894e9d0917 admin admin] PATH_INFO: `/v3/projects/c2697520a5f943979b629a828932189d/users/ddcfad778fdf4db588db77faec5e5bd0/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:42.174863 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd8af7-8b92-431d-9553-a5894e9d0917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2697520a5f943979b629a828932189d, user_id=ddcfad778fdf4db588db77faec5e5bd0, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:42.185348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd8af7-8b92-431d-9553-a5894e9d0917 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:42.222331 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 859/1737] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:42 2022] PUT /identity/v3/projects/c2697520a5f943979b629a828932189d/users/ddcfad778fdf4db588db77faec5e5bd0/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:01:42.227830 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680113e5-ee41-4d27-83c6-8508830d1cb8 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:42.228031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680113e5-ee41-4d27-83c6-8508830d1cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:42.228314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680113e5-ee41-4d27-83c6-8508830d1cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:42.273008 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34aa621-9e09-4745-9498-05bcf490c55b None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:42.273909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34aa621-9e09-4745-9498-05bcf490c55b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:42.276171 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34aa621-9e09-4745-9498-05bcf490c55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:42.319359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-680113e5-ee41-4d27-83c6-8508830d1cb8 None None] MFA Rules not processed for user `ddcfad778fdf4db588db77faec5e5bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:42.320992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-680113e5-ee41-4d27-83c6-8508830d1cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:42.322228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a34aa621-9e09-4745-9498-05bcf490c55b None None] MFA Rules not processed for user `e7714d3ad1d849f5a398fc1843f22e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:42.332790 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a34aa621-9e09-4745-9498-05bcf490c55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:42.694147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 860/1738] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Jun 2 19:01:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:42.710799 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 879/1739] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:42 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:42.722090 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34aa621-9e09-4745-9498-05bcf490c55b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:42.725835 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a34aa621-9e09-4745-9498-05bcf490c55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:42.937384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34aa621-9e09-4745-9498-05bcf490c55b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:42.946833 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3c072-3e1c-4994-996b-e9794825d476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:42.946833 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3c072-3e1c-4994-996b-e9794825d476 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:42.947202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3c072-3e1c-4994-996b-e9794825d476 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:42.949518 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3c072-3e1c-4994-996b-e9794825d476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:42.976181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3c072-3e1c-4994-996b-e9794825d476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:42.977673 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3c072-3e1c-4994-996b-e9794825d476 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:43.029972 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 861/1740] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:42 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:43.380953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680113e5-ee41-4d27-83c6-8508830d1cb8 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:43.383657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3c072-3e1c-4994-996b-e9794825d476 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:43.386308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d7c3c072-3e1c-4994-996b-e9794825d476 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:43.431631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3c072-3e1c-4994-996b-e9794825d476 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:43.446228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8395d5-d0bd-46ee-93dd-7bdb481ec251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:43.452247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8395d5-d0bd-46ee-93dd-7bdb481ec251 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:43.452715 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8395d5-d0bd-46ee-93dd-7bdb481ec251 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:43.453550 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8395d5-d0bd-46ee-93dd-7bdb481ec251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:43.520097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8395d5-d0bd-46ee-93dd-7bdb481ec251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:43.529839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8395d5-d0bd-46ee-93dd-7bdb481ec251 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:43.588316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 862/1741] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:43.657738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:43.685547 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680113e5-ee41-4d27-83c6-8508830d1cb8 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:43.698827 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3aa5e-1fb1-4676-bc66-c49c3b67c3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:43.699922 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3aa5e-1fb1-4676-bc66-c49c3b67c3c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:43.700188 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3aa5e-1fb1-4676-bc66-c49c3b67c3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:43.700537 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3aa5e-1fb1-4676-bc66-c49c3b67c3c8 admin admin] PATH_INFO: `/v3/users/10c95a54339043cfb92d2f8e04ccaeb4` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:43.703412 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3aa5e-1fb1-4676-bc66-c49c3b67c3c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c95a54339043cfb92d2f8e04ccaeb4)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:43.705314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3aa5e-1fb1-4676-bc66-c49c3b67c3c8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:43.953361 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-38e3aa5e-1fb1-4676-bc66-c49c3b67c3c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c95a54339043cfb92d2f8e04ccaeb4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:43.956036 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-38e3aa5e-1fb1-4676-bc66-c49c3b67c3c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c95a54339043cfb92d2f8e04ccaeb4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:43.995818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-38e3aa5e-1fb1-4676-bc66-c49c3b67c3c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c95a54339043cfb92d2f8e04ccaeb4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:44.020717 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-38e3aa5e-1fb1-4676-bc66-c49c3b67c3c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c95a54339043cfb92d2f8e04ccaeb4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:44.021688 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-38e3aa5e-1fb1-4676-bc66-c49c3b67c3c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c95a54339043cfb92d2f8e04ccaeb4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:44.066623 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 880/1742] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:01:43 2022] DELETE /identity/v3/users/10c95a54339043cfb92d2f8e04ccaeb4 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:44.071432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f05eb-4ffd-4a63-8423-97c6210d06dd None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:44.071734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f05eb-4ffd-4a63-8423-97c6210d06dd None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:44.072767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f05eb-4ffd-4a63-8423-97c6210d06dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:44.137176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-187f05eb-4ffd-4a63-8423-97c6210d06dd None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:44.166173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-187f05eb-4ffd-4a63-8423-97c6210d06dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:44.383478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:44.418611 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884ac94-3d61-4025-8cb1-569ebf2d204d None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:44.418611 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884ac94-3d61-4025-8cb1-569ebf2d204d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:44.418611 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884ac94-3d61-4025-8cb1-569ebf2d204d None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:44.419649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 881/1743] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 2 19:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:44.440487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b035d40-a8b1-4948-b238-bdc4fbd6a308 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:44.440782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b035d40-a8b1-4948-b238-bdc4fbd6a308 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:44.441074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b035d40-a8b1-4948-b238-bdc4fbd6a308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:44.451649 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 863/1744] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:44.560552 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-2b035d40-a8b1-4948-b238-bdc4fbd6a308 None None] MFA Rules not processed for user `11a4152a82e1486887541afab2d4e5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:44.567109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2b035d40-a8b1-4948-b238-bdc4fbd6a308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:44.626026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f05eb-4ffd-4a63-8423-97c6210d06dd None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:44.630837 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-187f05eb-4ffd-4a63-8423-97c6210d06dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:44.778251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 882/1745] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 2 19:01:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:01:44.809685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f05eb-4ffd-4a63-8423-97c6210d06dd None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:44.817096 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec2bca-33b2-43d0-8602-b813375319a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:44.821417 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec2bca-33b2-43d0-8602-b813375319a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:44.821984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec2bca-33b2-43d0-8602-b813375319a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:44.822555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec2bca-33b2-43d0-8602-b813375319a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:44.848598 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b035d40-a8b1-4948-b238-bdc4fbd6a308 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:44.852315 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2b035d40-a8b1-4948-b238-bdc4fbd6a308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:44.862622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec2bca-33b2-43d0-8602-b813375319a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:44.865538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec2bca-33b2-43d0-8602-b813375319a7 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:44.880965 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b035d40-a8b1-4948-b238-bdc4fbd6a308 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:44.887579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 864/1746] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:44.916179 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4ee93-38b5-4297-a606-c6f6e362b043 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:44.918516 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4ee93-38b5-4297-a606-c6f6e362b043 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:44.919191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4ee93-38b5-4297-a606-c6f6e362b043 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:44.921308 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4ee93-38b5-4297-a606-c6f6e362b043 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:44.943661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4ee93-38b5-4297-a606-c6f6e362b043 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:44.945400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4ee93-38b5-4297-a606-c6f6e362b043 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:44.970259 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 883/1747] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:46.219292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec2bca-33b2-43d0-8602-b813375319a7 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:46.222594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3cec2bca-33b2-43d0-8602-b813375319a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:46.277374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec2bca-33b2-43d0-8602-b813375319a7 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:46.299164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec9fc3-330a-4f1d-a0b5-82d7a3eba4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:46.301168 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec9fc3-330a-4f1d-a0b5-82d7a3eba4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:46.301914 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec9fc3-330a-4f1d-a0b5-82d7a3eba4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:46.302722 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec9fc3-330a-4f1d-a0b5-82d7a3eba4c2 admin admin] PATH_INFO: `/v3/users/4397bc0158e7425092c75c2b30bc2832` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:46.306637 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec9fc3-330a-4f1d-a0b5-82d7a3eba4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4397bc0158e7425092c75c2b30bc2832)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:46.315932 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec9fc3-330a-4f1d-a0b5-82d7a3eba4c2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:46.374949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4ee93-38b5-4297-a606-c6f6e362b043 service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:46.378786 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c4d4ee93-38b5-4297-a606-c6f6e362b043 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:46.427383 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4ee93-38b5-4297-a606-c6f6e362b043 service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:46.451238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cb506-aa05-49d9-8f2b-d10d2b065351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:46.453620 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cb506-aa05-49d9-8f2b-d10d2b065351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:46.454185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cb506-aa05-49d9-8f2b-d10d2b065351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:46.454958 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cb506-aa05-49d9-8f2b-d10d2b065351 admin admin] PATH_INFO: `/v3/projects/bd1134d747cc43078ecc2a987569b667` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:46.456632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8cb506-aa05-49d9-8f2b-d10d2b065351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1134d747cc43078ecc2a987569b667)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:46.459824 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8cb506-aa05-49d9-8f2b-d10d2b065351 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:46.482017 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-38ec9fc3-330a-4f1d-a0b5-82d7a3eba4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4397bc0158e7425092c75c2b30bc2832'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:46.483931 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-38ec9fc3-330a-4f1d-a0b5-82d7a3eba4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4397bc0158e7425092c75c2b30bc2832'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:46.507782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-38ec9fc3-330a-4f1d-a0b5-82d7a3eba4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4397bc0158e7425092c75c2b30bc2832'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:46.571195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-38ec9fc3-330a-4f1d-a0b5-82d7a3eba4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4397bc0158e7425092c75c2b30bc2832'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:46.575376 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-38ec9fc3-330a-4f1d-a0b5-82d7a3eba4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4397bc0158e7425092c75c2b30bc2832'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:46.580720 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:46.583347 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-be8cb506-aa05-49d9-8f2b-d10d2b065351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1134d747cc43078ecc2a987569b667', 'request_id': 'req-be8cb506-aa05-49d9-8f2b-d10d2b065351'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:46.612666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 865/1748] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:01:46 2022] DELETE /identity/v3/users/4397bc0158e7425092c75c2b30bc2832 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:46.614946 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d024c-b9b8-47a1-95b8-ed734ed0fcbd None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:46.616016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d024c-b9b8-47a1-95b8-ed734ed0fcbd None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:46.616590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d024c-b9b8-47a1-95b8-ed734ed0fcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:46.633817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-be8cb506-aa05-49d9-8f2b-d10d2b065351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1134d747cc43078ecc2a987569b667', 'request_id': 'req-be8cb506-aa05-49d9-8f2b-d10d2b065351'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:46.660590 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-be8cb506-aa05-49d9-8f2b-d10d2b065351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1134d747cc43078ecc2a987569b667', 'request_id': 'req-be8cb506-aa05-49d9-8f2b-d10d2b065351'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:46.660674 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-058d024c-b9b8-47a1-95b8-ed734ed0fcbd None None] MFA Rules not processed for user `4a660a47927140d6b4d0543de5e281a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:46.660674 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-058d024c-b9b8-47a1-95b8-ed734ed0fcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:46.687351 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-be8cb506-aa05-49d9-8f2b-d10d2b065351 admin admin] The token cache is being invalidate because project bd1134d747cc43078ecc2a987569b667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:01:46.687671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-be8cb506-aa05-49d9-8f2b-d10d2b065351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:46.690976 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-be8cb506-aa05-49d9-8f2b-d10d2b065351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:46.704684 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 884/1749] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:01:46 2022] DELETE /identity/v3/projects/bd1134d747cc43078ecc2a987569b667 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:46.707182 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574a7f1-68ca-4794-8e29-caa2e38e69ec None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:46.707474 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574a7f1-68ca-4794-8e29-caa2e38e69ec None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:46.707756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574a7f1-68ca-4794-8e29-caa2e38e69ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:46.748350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-8574a7f1-68ca-4794-8e29-caa2e38e69ec None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:46.750067 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8574a7f1-68ca-4794-8e29-caa2e38e69ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:46.985346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 866/1750] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:46.986310 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d024c-b9b8-47a1-95b8-ed734ed0fcbd None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:46.996445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-058d024c-b9b8-47a1-95b8-ed734ed0fcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:47.026234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:47.155283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 885/1751] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:47.246823 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d024c-b9b8-47a1-95b8-ed734ed0fcbd None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:47.260551 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94935be3-566a-41f6-8bb6-e739d719b45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:47.261842 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94935be3-566a-41f6-8bb6-e739d719b45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:47.262411 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94935be3-566a-41f6-8bb6-e739d719b45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:47.263038 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94935be3-566a-41f6-8bb6-e739d719b45e admin admin] PATH_INFO: `/v3/users/ddcfad778fdf4db588db77faec5e5bd0` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:47.266594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94935be3-566a-41f6-8bb6-e739d719b45e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddcfad778fdf4db588db77faec5e5bd0)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:47.279534 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94935be3-566a-41f6-8bb6-e739d719b45e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:47.322196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574a7f1-68ca-4794-8e29-caa2e38e69ec None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:47.325015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8574a7f1-68ca-4794-8e29-caa2e38e69ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:47.448996 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-94935be3-566a-41f6-8bb6-e739d719b45e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddcfad778fdf4db588db77faec5e5bd0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:47.450094 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-94935be3-566a-41f6-8bb6-e739d719b45e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddcfad778fdf4db588db77faec5e5bd0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:47.467113 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-94935be3-566a-41f6-8bb6-e739d719b45e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddcfad778fdf4db588db77faec5e5bd0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:47.486013 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574a7f1-68ca-4794-8e29-caa2e38e69ec None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:47.498846 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970e84a-bf63-4a5c-96ae-71935c080a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:47.499658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970e84a-bf63-4a5c-96ae-71935c080a12 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:47.499945 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970e84a-bf63-4a5c-96ae-71935c080a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:47.500224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970e84a-bf63-4a5c-96ae-71935c080a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:47.506336 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-94935be3-566a-41f6-8bb6-e739d719b45e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddcfad778fdf4db588db77faec5e5bd0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:47.507905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-94935be3-566a-41f6-8bb6-e739d719b45e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddcfad778fdf4db588db77faec5e5bd0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:47.535526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970e84a-bf63-4a5c-96ae-71935c080a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:47.537183 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970e84a-bf63-4a5c-96ae-71935c080a12 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:47.546153 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 867/1752] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:01:46 2022] DELETE /identity/v3/users/ddcfad778fdf4db588db77faec5e5bd0 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:47.560347 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 886/1753] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:48.541902 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94935be3-566a-41f6-8bb6-e739d719b45e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:48.543676 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-94935be3-566a-41f6-8bb6-e739d719b45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:48.639303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94935be3-566a-41f6-8bb6-e739d719b45e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:48.645469 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8c8ef-94c0-4dc1-9290-d91ed98f384d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:48.646606 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8c8ef-94c0-4dc1-9290-d91ed98f384d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:48.646753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8c8ef-94c0-4dc1-9290-d91ed98f384d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:48.647119 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8c8ef-94c0-4dc1-9290-d91ed98f384d admin admin] PATH_INFO: `/v3/users/f840039051fb435da95a5dadc7d87ac1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:48.648765 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8c8ef-94c0-4dc1-9290-d91ed98f384d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f840039051fb435da95a5dadc7d87ac1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:48.651096 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8c8ef-94c0-4dc1-9290-d91ed98f384d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:48.703309 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:48.753482 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-70a8c8ef-94c0-4dc1-9290-d91ed98f384d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f840039051fb435da95a5dadc7d87ac1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:48.754435 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-70a8c8ef-94c0-4dc1-9290-d91ed98f384d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f840039051fb435da95a5dadc7d87ac1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:48.764593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-70a8c8ef-94c0-4dc1-9290-d91ed98f384d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f840039051fb435da95a5dadc7d87ac1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:48.818991 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-70a8c8ef-94c0-4dc1-9290-d91ed98f384d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f840039051fb435da95a5dadc7d87ac1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:48.820144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-70a8c8ef-94c0-4dc1-9290-d91ed98f384d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f840039051fb435da95a5dadc7d87ac1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:48.849861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 868/1754] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:01:48 2022] DELETE /identity/v3/users/f840039051fb435da95a5dadc7d87ac1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:48.856635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c061f94-af25-4660-bb99-2c61029571a5 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:48.857577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c061f94-af25-4660-bb99-2c61029571a5 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:48.857577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c061f94-af25-4660-bb99-2c61029571a5 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:48.860724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 887/1755] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 2 19:01:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:48.909160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c193a-b8b6-4788-89db-caa0b2d6b8a0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:48.909637 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c193a-b8b6-4788-89db-caa0b2d6b8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:48.910116 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c193a-b8b6-4788-89db-caa0b2d6b8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:48.946821 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ed8c193a-b8b6-4788-89db-caa0b2d6b8a0 None None] MFA Rules not processed for user `6b8ff9f5032e498db3c70c79cc11989b`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:48.948843 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ed8c193a-b8b6-4788-89db-caa0b2d6b8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:48.970205 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278454f7-5976-488c-9113-eed689d4ac45 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:48.970944 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278454f7-5976-488c-9113-eed689d4ac45 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:48.971383 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278454f7-5976-488c-9113-eed689d4ac45 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:48.974350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 888/1756] 10.222.0.15 () {54 vars in 912 bytes} [Thu Jun 2 19:01:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:48.986674 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8561575-501b-40f8-8191-dea82c326352 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:48.987267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8561575-501b-40f8-8191-dea82c326352 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:48.988121 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8561575-501b-40f8-8191-dea82c326352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:49.032908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a8561575-501b-40f8-8191-dea82c326352 None None] MFA Rules not processed for user `e7714d3ad1d849f5a398fc1843f22e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:49.036032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a8561575-501b-40f8-8191-dea82c326352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:49.218342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 869/1757] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 2 19:01:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:49.219669 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c193a-b8b6-4788-89db-caa0b2d6b8a0 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:49.225435 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ed8c193a-b8b6-4788-89db-caa0b2d6b8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:49.230681 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 889/1758] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 2 19:01:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:01:49.243162 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8561575-501b-40f8-8191-dea82c326352 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:49.250206 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a8561575-501b-40f8-8191-dea82c326352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:49.372183 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:49.382309 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c193a-b8b6-4788-89db-caa0b2d6b8a0 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:49.388843 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5af825-f30d-4ed9-ad3a-209d29c73301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:49.390502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5af825-f30d-4ed9-ad3a-209d29c73301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:49.391194 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5af825-f30d-4ed9-ad3a-209d29c73301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:49.391680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5af825-f30d-4ed9-ad3a-209d29c73301 admin admin] PATH_INFO: `/v3/projects/c2697520a5f943979b629a828932189d` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:49.394567 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5af825-f30d-4ed9-ad3a-209d29c73301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2697520a5f943979b629a828932189d)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:49.396918 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5af825-f30d-4ed9-ad3a-209d29c73301 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:49.500106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8561575-501b-40f8-8191-dea82c326352 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:49.515020 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:49.559979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4f5af825-f30d-4ed9-ad3a-209d29c73301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2697520a5f943979b629a828932189d', 'request_id': 'req-4f5af825-f30d-4ed9-ad3a-209d29c73301'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:49.583099 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4f5af825-f30d-4ed9-ad3a-209d29c73301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2697520a5f943979b629a828932189d', 'request_id': 'req-4f5af825-f30d-4ed9-ad3a-209d29c73301'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:49.600634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4f5af825-f30d-4ed9-ad3a-209d29c73301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2697520a5f943979b629a828932189d', 'request_id': 'req-4f5af825-f30d-4ed9-ad3a-209d29c73301'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:49.643677 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4f5af825-f30d-4ed9-ad3a-209d29c73301 admin admin] The token cache is being invalidate because project c2697520a5f943979b629a828932189d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:01:49.643974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4f5af825-f30d-4ed9-ad3a-209d29c73301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:49.644641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4f5af825-f30d-4ed9-ad3a-209d29c73301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:49.646808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 870/1759] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:01:49 2022] DELETE /identity/v3/projects/c2697520a5f943979b629a828932189d => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:49.651255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5af825-f30d-4ed9-ad3a-209d29c73301 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:49.657073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4f5af825-f30d-4ed9-ad3a-209d29c73301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:49.734105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070db57-6756-4ea6-b486-61b0c697930b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:49.735547 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070db57-6756-4ea6-b486-61b0c697930b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:49.736047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070db57-6756-4ea6-b486-61b0c697930b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:49.736426 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070db57-6756-4ea6-b486-61b0c697930b admin admin] PATH_INFO: `/v3/projects/8da9a91ff19b4c96846e834f6e2c23da` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:49.740546 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070db57-6756-4ea6-b486-61b0c697930b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8da9a91ff19b4c96846e834f6e2c23da)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:49.753383 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070db57-6756-4ea6-b486-61b0c697930b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:49.938950 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e070db57-6756-4ea6-b486-61b0c697930b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8da9a91ff19b4c96846e834f6e2c23da', 'request_id': 'req-e070db57-6756-4ea6-b486-61b0c697930b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:49.941070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5af825-f30d-4ed9-ad3a-209d29c73301 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:49.953705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e070db57-6756-4ea6-b486-61b0c697930b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8da9a91ff19b4c96846e834f6e2c23da', 'request_id': 'req-e070db57-6756-4ea6-b486-61b0c697930b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:49.970885 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e070db57-6756-4ea6-b486-61b0c697930b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8da9a91ff19b4c96846e834f6e2c23da', 'request_id': 'req-e070db57-6756-4ea6-b486-61b0c697930b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:50.002761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e070db57-6756-4ea6-b486-61b0c697930b admin admin] The token cache is being invalidate because project 8da9a91ff19b4c96846e834f6e2c23da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:01:50.003127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e070db57-6756-4ea6-b486-61b0c697930b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:50.004140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e070db57-6756-4ea6-b486-61b0c697930b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:50.006681 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 890/1760] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:01:49 2022] DELETE /identity/v3/projects/8da9a91ff19b4c96846e834f6e2c23da => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:50.008093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7c066-0398-4a02-84d6-8cb9a07f9763 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:50.008381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7c066-0398-4a02-84d6-8cb9a07f9763 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:50.008661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7c066-0398-4a02-84d6-8cb9a07f9763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:50.051254 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-34d7c066-0398-4a02-84d6-8cb9a07f9763 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:50.053128 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-34d7c066-0398-4a02-84d6-8cb9a07f9763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:50.058409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95e5a4-7cbe-42f2-a652-6dce691e43cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:50.061889 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95e5a4-7cbe-42f2-a652-6dce691e43cb service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:50.061889 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95e5a4-7cbe-42f2-a652-6dce691e43cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:50.065529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95e5a4-7cbe-42f2-a652-6dce691e43cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:50.069217 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ea95e5a4-7cbe-42f2-a652-6dce691e43cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:50.087430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95e5a4-7cbe-42f2-a652-6dce691e43cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:50.089162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95e5a4-7cbe-42f2-a652-6dce691e43cb service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:50.102118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 871/1761] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:50.103127 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95e5a4-7cbe-42f2-a652-6dce691e43cb service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:50.105467 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ea95e5a4-7cbe-42f2-a652-6dce691e43cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:50.203081 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 891/1762] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:50.204436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7c066-0398-4a02-84d6-8cb9a07f9763 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:50.205822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-34d7c066-0398-4a02-84d6-8cb9a07f9763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:50.218906 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7c066-0398-4a02-84d6-8cb9a07f9763 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:50.224438 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60378a-3b7a-48b3-8554-92c005b09db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:50.225849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60378a-3b7a-48b3-8554-92c005b09db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:50.225849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60378a-3b7a-48b3-8554-92c005b09db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:50.226292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60378a-3b7a-48b3-8554-92c005b09db7 admin admin] PATH_INFO: `/v3/users/d589020615e247b5b529974a1fb9e621` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:50.227636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60378a-3b7a-48b3-8554-92c005b09db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d589020615e247b5b529974a1fb9e621)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:50.229737 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60378a-3b7a-48b3-8554-92c005b09db7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:50.232031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:50.232307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95e5a4-7cbe-42f2-a652-6dce691e43cb service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:50.242511 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe1d65-5454-481a-8bf0-f2ad56a9c41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:50.243794 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe1d65-5454-481a-8bf0-f2ad56a9c41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:50.244254 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe1d65-5454-481a-8bf0-f2ad56a9c41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:50.244711 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe1d65-5454-481a-8bf0-f2ad56a9c41e admin admin] PATH_INFO: `/v3/projects/cde5e4b4cad6485683a17fd692c225bd` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:50.250615 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe1d65-5454-481a-8bf0-f2ad56a9c41e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde5e4b4cad6485683a17fd692c225bd)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:50.253921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe1d65-5454-481a-8bf0-f2ad56a9c41e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:50.307532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ef60378a-3b7a-48b3-8554-92c005b09db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd589020615e247b5b529974a1fb9e621'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:50.308319 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ef60378a-3b7a-48b3-8554-92c005b09db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd589020615e247b5b529974a1fb9e621'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:50.320699 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ef60378a-3b7a-48b3-8554-92c005b09db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd589020615e247b5b529974a1fb9e621'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:50.327698 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:50.343446 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ef60378a-3b7a-48b3-8554-92c005b09db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd589020615e247b5b529974a1fb9e621'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:50.344377 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ef60378a-3b7a-48b3-8554-92c005b09db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd589020615e247b5b529974a1fb9e621'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:50.372403 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-36fe1d65-5454-481a-8bf0-f2ad56a9c41e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde5e4b4cad6485683a17fd692c225bd', 'request_id': 'req-36fe1d65-5454-481a-8bf0-f2ad56a9c41e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:50.378316 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 892/1763] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:01:50 2022] DELETE /identity/v3/users/d589020615e247b5b529974a1fb9e621 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:50.380835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60378a-3b7a-48b3-8554-92c005b09db7 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:50.385593 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ef60378a-3b7a-48b3-8554-92c005b09db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:50.387637 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-36fe1d65-5454-481a-8bf0-f2ad56a9c41e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde5e4b4cad6485683a17fd692c225bd', 'request_id': 'req-36fe1d65-5454-481a-8bf0-f2ad56a9c41e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:50.405023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-36fe1d65-5454-481a-8bf0-f2ad56a9c41e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde5e4b4cad6485683a17fd692c225bd', 'request_id': 'req-36fe1d65-5454-481a-8bf0-f2ad56a9c41e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:50.423156 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-36fe1d65-5454-481a-8bf0-f2ad56a9c41e admin admin] The token cache is being invalidate because project cde5e4b4cad6485683a17fd692c225bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:01:50.423481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-36fe1d65-5454-481a-8bf0-f2ad56a9c41e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:50.426634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-36fe1d65-5454-481a-8bf0-f2ad56a9c41e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:50.430695 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 872/1764] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:01:50 2022] DELETE /identity/v3/projects/cde5e4b4cad6485683a17fd692c225bd => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:50.432053 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75103dfe-91c7-4163-97ac-96668bc5e9c0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:50.432345 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75103dfe-91c7-4163-97ac-96668bc5e9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:50.432624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75103dfe-91c7-4163-97ac-96668bc5e9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:50.479387 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-75103dfe-91c7-4163-97ac-96668bc5e9c0 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:50.480870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-75103dfe-91c7-4163-97ac-96668bc5e9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:50.623140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60378a-3b7a-48b3-8554-92c005b09db7 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:50.640813 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e198a-a58c-4ce4-901b-08f27ec2ab5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:50.643258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e198a-a58c-4ce4-901b-08f27ec2ab5b service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:50.643737 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e198a-a58c-4ce4-901b-08f27ec2ab5b service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:50.644898 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e198a-a58c-4ce4-901b-08f27ec2ab5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:50.647430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fa5e198a-a58c-4ce4-901b-08f27ec2ab5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:50.676110 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e198a-a58c-4ce4-901b-08f27ec2ab5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:50.680365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e198a-a58c-4ce4-901b-08f27ec2ab5b service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:50.700305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 873/1765] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:50.704643 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75103dfe-91c7-4163-97ac-96668bc5e9c0 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:50.709238 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-75103dfe-91c7-4163-97ac-96668bc5e9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:50.737140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 893/1766] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:50.738726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e198a-a58c-4ce4-901b-08f27ec2ab5b service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:50.742124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75103dfe-91c7-4163-97ac-96668bc5e9c0 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:50.756183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef02e6-43d1-4ac3-9d05-6c3b8e935603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:50.759651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef02e6-43d1-4ac3-9d05-6c3b8e935603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:50.761272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef02e6-43d1-4ac3-9d05-6c3b8e935603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:50.761272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef02e6-43d1-4ac3-9d05-6c3b8e935603 admin admin] PATH_INFO: `/v3/users/61a5dcf4519f42b8bab7094ddc1ce818` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:50.770138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef02e6-43d1-4ac3-9d05-6c3b8e935603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a5dcf4519f42b8bab7094ddc1ce818)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:50.772357 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef02e6-43d1-4ac3-9d05-6c3b8e935603 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:50.789044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e198a-a58c-4ce4-901b-08f27ec2ab5b service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:50.802865 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacc3cc-cc44-433e-9283-d4ac84fc00be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:50.804011 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacc3cc-cc44-433e-9283-d4ac84fc00be admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:50.804316 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacc3cc-cc44-433e-9283-d4ac84fc00be admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:50.804538 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacc3cc-cc44-433e-9283-d4ac84fc00be admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:50.805465 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacc3cc-cc44-433e-9283-d4ac84fc00be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:50.806062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacc3cc-cc44-433e-9283-d4ac84fc00be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:50.807538 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacc3cc-cc44-433e-9283-d4ac84fc00be admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:50.836369 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 894/1767] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:50.841453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacc3cc-cc44-433e-9283-d4ac84fc00be admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:50.869586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacc3cc-cc44-433e-9283-d4ac84fc00be admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:50.903568 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ecbcb-98dd-4a38-a64a-c24eb654a4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:50.904469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ecbcb-98dd-4a38-a64a-c24eb654a4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:50.905349 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ecbcb-98dd-4a38-a64a-c24eb654a4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:50.905477 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ecbcb-98dd-4a38-a64a-c24eb654a4d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:50.906819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ecbcb-98dd-4a38-a64a-c24eb654a4d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:50.916709 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ecbcb-98dd-4a38-a64a-c24eb654a4d7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:50.934034 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d9ef02e6-43d1-4ac3-9d05-6c3b8e935603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a5dcf4519f42b8bab7094ddc1ce818'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:50.936867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d9ef02e6-43d1-4ac3-9d05-6c3b8e935603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a5dcf4519f42b8bab7094ddc1ce818'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:50.989566 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d9ef02e6-43d1-4ac3-9d05-6c3b8e935603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a5dcf4519f42b8bab7094ddc1ce818'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:51.043021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 895/1768] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:50 2022] POST /identity/v3/projects => generated 409 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:01:51.055639 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d9ef02e6-43d1-4ac3-9d05-6c3b8e935603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a5dcf4519f42b8bab7094ddc1ce818'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:51.057202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d9ef02e6-43d1-4ac3-9d05-6c3b8e935603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a5dcf4519f42b8bab7094ddc1ce818'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:51.068971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ecbcb-98dd-4a38-a64a-c24eb654a4d7 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:51.073380 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d26ecbcb-98dd-4a38-a64a-c24eb654a4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:51.096652 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 874/1769] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:01:50 2022] DELETE /identity/v3/users/61a5dcf4519f42b8bab7094ddc1ce818 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:51.129984 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:51.246086 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ecbcb-98dd-4a38-a64a-c24eb654a4d7 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:51.348309 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee61a6-c04b-4c0b-aa1f-f4aa7abeae31 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:51.348801 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee61a6-c04b-4c0b-aa1f-f4aa7abeae31 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:51.349230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee61a6-c04b-4c0b-aa1f-f4aa7abeae31 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:51.354212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 875/1770] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 2 19:01:51 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:01:51.380605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc0ed5-9ab9-42d9-81ed-d29d53fab1f7 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:51.381076 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc0ed5-9ab9-42d9-81ed-d29d53fab1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:51.385607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae9126-e60b-45cb-a1a8-93817a08cc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:51.386245 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae9126-e60b-45cb-a1a8-93817a08cc36 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:51.386839 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae9126-e60b-45cb-a1a8-93817a08cc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:51.386839 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae9126-e60b-45cb-a1a8-93817a08cc36 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:51.387801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae9126-e60b-45cb-a1a8-93817a08cc36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:51.389664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae9126-e60b-45cb-a1a8-93817a08cc36 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:51.395160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc0ed5-9ab9-42d9-81ed-d29d53fab1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:51.436538 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 896/1771] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:51 2022] POST /identity/v3/users => generated 305 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:51.441412 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae9126-e60b-45cb-a1a8-93817a08cc36 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:51.456135 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae9126-e60b-45cb-a1a8-93817a08cc36 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:51.462875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151f72e-db38-4e00-af71-af27d7cd25a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:51.463765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151f72e-db38-4e00-af71-af27d7cd25a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:51.465050 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151f72e-db38-4e00-af71-af27d7cd25a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:51.465050 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151f72e-db38-4e00-af71-af27d7cd25a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:51.465627 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151f72e-db38-4e00-af71-af27d7cd25a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:51.467750 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151f72e-db38-4e00-af71-af27d7cd25a1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:51.469224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-dbdc0ed5-9ab9-42d9-81ed-d29d53fab1f7 None None] MFA Rules not processed for user `6b8ff9f5032e498db3c70c79cc11989b`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:51.471524 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-dbdc0ed5-9ab9-42d9-81ed-d29d53fab1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:51.485022 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 897/1772] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:51.491230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151f72e-db38-4e00-af71-af27d7cd25a1 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:51.509311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151f72e-db38-4e00-af71-af27d7cd25a1 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:51.517183 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a567c0-44ce-479b-8495-1eb57538a37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:51.524037 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a567c0-44ce-479b-8495-1eb57538a37a admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:51.524604 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a567c0-44ce-479b-8495-1eb57538a37a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:51.525043 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a567c0-44ce-479b-8495-1eb57538a37a admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:51.526382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a567c0-44ce-479b-8495-1eb57538a37a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:51.535289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a567c0-44ce-479b-8495-1eb57538a37a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:51.553781 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 898/1773] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:01:51.560266 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a567c0-44ce-479b-8495-1eb57538a37a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:51.572621 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:51.582096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a567c0-44ce-479b-8495-1eb57538a37a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:51.596824 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee1414-7e98-49ad-82b6-cfef383e9102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:51.598620 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee1414-7e98-49ad-82b6-cfef383e9102 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:51.599800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee1414-7e98-49ad-82b6-cfef383e9102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:51.600287 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee1414-7e98-49ad-82b6-cfef383e9102 admin admin] PATH_INFO: `/v3/projects/24004c48398840dcbcdb1ae5b09f8ff0/users/74d2b6d84b8244e88a8d3758c7b873f0/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:51.659972 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 876/1774] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 2 19:01:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:51.660586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee1414-7e98-49ad-82b6-cfef383e9102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24004c48398840dcbcdb1ae5b09f8ff0, user_id=74d2b6d84b8244e88a8d3758c7b873f0, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:51.669860 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee1414-7e98-49ad-82b6-cfef383e9102 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:51.707137 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 899/1775] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:51 2022] PUT /identity/v3/projects/24004c48398840dcbcdb1ae5b09f8ff0/users/74d2b6d84b8244e88a8d3758c7b873f0/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:51.739367 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705855d-1132-4ae5-9347-ba862b7d9229 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:51.744620 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705855d-1132-4ae5-9347-ba862b7d9229 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:51.745687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705855d-1132-4ae5-9347-ba862b7d9229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:51.813909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e705855d-1132-4ae5-9347-ba862b7d9229 None None] MFA Rules not processed for user `74d2b6d84b8244e88a8d3758c7b873f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:51.815373 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e705855d-1132-4ae5-9347-ba862b7d9229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:51.961835 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 877/1776] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:51 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:51.965417 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee1414-7e98-49ad-82b6-cfef383e9102 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.009047 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705855d-1132-4ae5-9347-ba862b7d9229 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.012758 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e705855d-1132-4ae5-9347-ba862b7d9229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:52.106427 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee1414-7e98-49ad-82b6-cfef383e9102 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.113469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc95aaf-95c4-4f91-ada3-503c8da89cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.114526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc95aaf-95c4-4f91-ada3-503c8da89cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.115002 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc95aaf-95c4-4f91-ada3-503c8da89cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.115790 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc95aaf-95c4-4f91-ada3-503c8da89cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.117479 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc95aaf-95c4-4f91-ada3-503c8da89cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:52.120290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc95aaf-95c4-4f91-ada3-503c8da89cc6 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:52.137636 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705855d-1132-4ae5-9347-ba862b7d9229 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.145385 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68eee4-ffca-47fc-aaa5-ebf53b518333 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.147485 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68eee4-ffca-47fc-aaa5-ebf53b518333 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.147801 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68eee4-ffca-47fc-aaa5-ebf53b518333 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.148179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68eee4-ffca-47fc-aaa5-ebf53b518333 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.160583 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68eee4-ffca-47fc-aaa5-ebf53b518333 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:52.162754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68eee4-ffca-47fc-aaa5-ebf53b518333 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:52.167292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 900/1777] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:51 2022] POST /identity/v3/projects => generated 405 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:52.169003 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc95aaf-95c4-4f91-ada3-503c8da89cc6 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.171430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6cc95aaf-95c4-4f91-ada3-503c8da89cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:52.183762 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:52.187901 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 878/1778] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:01:52.189564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68eee4-ffca-47fc-aaa5-ebf53b518333 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.220553 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68eee4-ffca-47fc-aaa5-ebf53b518333 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.280322 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:52.293485 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc95aaf-95c4-4f91-ada3-503c8da89cc6 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.299514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b98c29-42de-40e4-ba13-a56acabf8f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.300527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b98c29-42de-40e4-ba13-a56acabf8f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.300811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b98c29-42de-40e4-ba13-a56acabf8f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.301140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b98c29-42de-40e4-ba13-a56acabf8f09 admin admin] PATH_INFO: `/v3/projects/e619bf7c8e7646a3b17ea1b231b5472c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.302437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b98c29-42de-40e4-ba13-a56acabf8f09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e619bf7c8e7646a3b17ea1b231b5472c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:52.304455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b98c29-42de-40e4-ba13-a56acabf8f09 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:52.321784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992b1e8-fd60-4344-8bf9-d02f20a192bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.322507 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992b1e8-fd60-4344-8bf9-d02f20a192bf admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.322863 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992b1e8-fd60-4344-8bf9-d02f20a192bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.323202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992b1e8-fd60-4344-8bf9-d02f20a192bf admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.324011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992b1e8-fd60-4344-8bf9-d02f20a192bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:52.326964 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992b1e8-fd60-4344-8bf9-d02f20a192bf admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:52.357442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 879/1779] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:52 2022] POST /identity/v3/users => generated 309 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:52.357442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992b1e8-fd60-4344-8bf9-d02f20a192bf admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.360295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f992b1e8-fd60-4344-8bf9-d02f20a192bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:52.387114 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992b1e8-fd60-4344-8bf9-d02f20a192bf admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.388654 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-58b98c29-42de-40e4-ba13-a56acabf8f09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e619bf7c8e7646a3b17ea1b231b5472c', 'request_id': 'req-58b98c29-42de-40e4-ba13-a56acabf8f09'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:52.402892 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-58b98c29-42de-40e4-ba13-a56acabf8f09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e619bf7c8e7646a3b17ea1b231b5472c', 'request_id': 'req-58b98c29-42de-40e4-ba13-a56acabf8f09'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:52.416455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-58b98c29-42de-40e4-ba13-a56acabf8f09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e619bf7c8e7646a3b17ea1b231b5472c', 'request_id': 'req-58b98c29-42de-40e4-ba13-a56acabf8f09'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:52.445411 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-58b98c29-42de-40e4-ba13-a56acabf8f09 admin admin] The token cache is being invalidate because project e619bf7c8e7646a3b17ea1b231b5472c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:01:52.445777 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-58b98c29-42de-40e4-ba13-a56acabf8f09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:52.446507 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-58b98c29-42de-40e4-ba13-a56acabf8f09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:52.451930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 901/1780] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:01:52 2022] DELETE /identity/v3/projects/e619bf7c8e7646a3b17ea1b231b5472c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:52.453276 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b98c29-42de-40e4-ba13-a56acabf8f09 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.454792 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-58b98c29-42de-40e4-ba13-a56acabf8f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:52.503403 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39deb71d-24a0-4b44-ad42-772b34e092b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.504311 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39deb71d-24a0-4b44-ad42-772b34e092b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.504575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39deb71d-24a0-4b44-ad42-772b34e092b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.504859 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39deb71d-24a0-4b44-ad42-772b34e092b5 admin admin] PATH_INFO: `/v3/projects/83ba569a1fab4591bea861d3ca8144d8` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.506292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39deb71d-24a0-4b44-ad42-772b34e092b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ba569a1fab4591bea861d3ca8144d8)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:52.508426 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39deb71d-24a0-4b44-ad42-772b34e092b5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:52.557233 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b98c29-42de-40e4-ba13-a56acabf8f09 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.573484 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-39deb71d-24a0-4b44-ad42-772b34e092b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ba569a1fab4591bea861d3ca8144d8', 'request_id': 'req-39deb71d-24a0-4b44-ad42-772b34e092b5'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:52.581186 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-39deb71d-24a0-4b44-ad42-772b34e092b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ba569a1fab4591bea861d3ca8144d8', 'request_id': 'req-39deb71d-24a0-4b44-ad42-772b34e092b5'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:52.589939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-39deb71d-24a0-4b44-ad42-772b34e092b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ba569a1fab4591bea861d3ca8144d8', 'request_id': 'req-39deb71d-24a0-4b44-ad42-772b34e092b5'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:52.603502 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:52.604629 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-39deb71d-24a0-4b44-ad42-772b34e092b5 admin admin] The token cache is being invalidate because project 83ba569a1fab4591bea861d3ca8144d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:01:52.605140 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-39deb71d-24a0-4b44-ad42-772b34e092b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:52.606342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-39deb71d-24a0-4b44-ad42-772b34e092b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:01:52.608215 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 880/1781] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:01:52 2022] DELETE /identity/v3/projects/83ba569a1fab4591bea861d3ca8144d8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:52.609512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed34a37-93b4-4ab5-b6d5-a87cd82d609c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.609818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed34a37-93b4-4ab5-b6d5-a87cd82d609c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.610103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed34a37-93b4-4ab5-b6d5-a87cd82d609c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.629490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577c53b-a062-40d8-b25f-93c830f330f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.630057 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-aed34a37-93b4-4ab5-b6d5-a87cd82d609c None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:52.630228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577c53b-a062-40d8-b25f-93c830f330f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.630489 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577c53b-a062-40d8-b25f-93c830f330f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.630763 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577c53b-a062-40d8-b25f-93c830f330f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.631302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-aed34a37-93b4-4ab5-b6d5-a87cd82d609c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:52.631502 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577c53b-a062-40d8-b25f-93c830f330f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:52.633154 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577c53b-a062-40d8-b25f-93c830f330f8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:52.639640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 881/1782] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:52.641064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206bd89-7537-41bc-8584-06ad7f34ca2b None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.641408 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206bd89-7537-41bc-8584-06ad7f34ca2b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.641693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206bd89-7537-41bc-8584-06ad7f34ca2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.649450 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 902/1783] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:52.651702 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba13cc-36b6-422c-9b07-34c5abb5c11e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.652234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba13cc-36b6-422c-9b07-34c5abb5c11e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.652761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba13cc-36b6-422c-9b07-34c5abb5c11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.660803 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4206bd89-7537-41bc-8584-06ad7f34ca2b None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:52.662072 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4206bd89-7537-41bc-8584-06ad7f34ca2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:52.670604 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 882/1784] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:52.671440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206bd89-7537-41bc-8584-06ad7f34ca2b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.672785 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4206bd89-7537-41bc-8584-06ad7f34ca2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:52.681505 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-54ba13cc-36b6-422c-9b07-34c5abb5c11e None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:52.682773 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-54ba13cc-36b6-422c-9b07-34c5abb5c11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:52.685508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206bd89-7537-41bc-8584-06ad7f34ca2b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.690319 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3895c-b361-42e9-a170-091553b4f695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.691228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3895c-b361-42e9-a170-091553b4f695 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.691384 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 903/1785] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:52.692798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b208107-d581-4a21-8aa2-0e408db32a96 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.693122 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b208107-d581-4a21-8aa2-0e408db32a96 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.693421 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b208107-d581-4a21-8aa2-0e408db32a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.694796 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3895c-b361-42e9-a170-091553b4f695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.695124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3895c-b361-42e9-a170-091553b4f695 admin admin] PATH_INFO: `/v3/projects/c7353ee3f4ed4e2fa7dd58940b6a009c/users/c0ab4c236ec94470ba3e9a84fe3dbb51/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.713170 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3895c-b361-42e9-a170-091553b4f695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7353ee3f4ed4e2fa7dd58940b6a009c, user_id=c0ab4c236ec94470ba3e9a84fe3dbb51, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:52.714139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6b208107-d581-4a21-8aa2-0e408db32a96 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:52.715702 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6b208107-d581-4a21-8aa2-0e408db32a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:52.716504 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3895c-b361-42e9-a170-091553b4f695 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:52.725988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 904/1786] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:52.726984 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b208107-d581-4a21-8aa2-0e408db32a96 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.739068 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 883/1787] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:52 2022] PUT /identity/v3/projects/c7353ee3f4ed4e2fa7dd58940b6a009c/users/c0ab4c236ec94470ba3e9a84fe3dbb51/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:52.740290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b208107-d581-4a21-8aa2-0e408db32a96 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.740573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3895c-b361-42e9-a170-091553b4f695 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.767435 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:52.818522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc0095-10a4-48e8-87f3-efcd3a6e033f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.819267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc0095-10a4-48e8-87f3-efcd3a6e033f admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.819482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc0095-10a4-48e8-87f3-efcd3a6e033f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.819767 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc0095-10a4-48e8-87f3-efcd3a6e033f admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.820497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc0095-10a4-48e8-87f3-efcd3a6e033f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:52.820803 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc0095-10a4-48e8-87f3-efcd3a6e033f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:52.821910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3895c-b361-42e9-a170-091553b4f695 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.822472 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc0095-10a4-48e8-87f3-efcd3a6e033f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:52.828254 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a2978-6c99-429d-b140-7032cfd1a20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.828853 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a2978-6c99-429d-b140-7032cfd1a20c admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.829136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a2978-6c99-429d-b140-7032cfd1a20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.829406 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a2978-6c99-429d-b140-7032cfd1a20c admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.830194 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a2978-6c99-429d-b140-7032cfd1a20c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:01:52.830497 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a2978-6c99-429d-b140-7032cfd1a20c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:52.832139 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a2978-6c99-429d-b140-7032cfd1a20c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:52.836737 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 905/1788] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:52.837517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc0095-10a4-48e8-87f3-efcd3a6e033f admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.845532 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 884/1789] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:01:52.846582 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a2978-6c99-429d-b140-7032cfd1a20c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.848090 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc0095-10a4-48e8-87f3-efcd3a6e033f admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.853003 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c95c49-2998-44bb-be56-2d82c66fa854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.853917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c95c49-2998-44bb-be56-2d82c66fa854 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.854384 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c95c49-2998-44bb-be56-2d82c66fa854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.854854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c95c49-2998-44bb-be56-2d82c66fa854 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.855636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c95c49-2998-44bb-be56-2d82c66fa854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:52.857325 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c95c49-2998-44bb-be56-2d82c66fa854 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:52.857763 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a2978-6c99-429d-b140-7032cfd1a20c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.863156 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbccf6-a62e-4eb1-9100-ad28bc319ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.863840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbccf6-a62e-4eb1-9100-ad28bc319ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.864121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbccf6-a62e-4eb1-9100-ad28bc319ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.864400 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbccf6-a62e-4eb1-9100-ad28bc319ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.865101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbccf6-a62e-4eb1-9100-ad28bc319ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:52.867134 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbccf6-a62e-4eb1-9100-ad28bc319ca7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:52.869728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 906/1790] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:52.870843 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c95c49-2998-44bb-be56-2d82c66fa854 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.884810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c95c49-2998-44bb-be56-2d82c66fa854 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:52.890652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ff130-f0a4-409b-95cd-cfcaf2585c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:52.891424 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ff130-f0a4-409b-95cd-cfcaf2585c78 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:52.891725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ff130-f0a4-409b-95cd-cfcaf2585c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:52.892386 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ff130-f0a4-409b-95cd-cfcaf2585c78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:52.893152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ff130-f0a4-409b-95cd-cfcaf2585c78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:52.895276 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ff130-f0a4-409b-95cd-cfcaf2585c78 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:52.900670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 885/1791] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:52 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:52.901820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbccf6-a62e-4eb1-9100-ad28bc319ca7 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.929700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 907/1792] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:52 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:52.930768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ff130-f0a4-409b-95cd-cfcaf2585c78 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:52.975182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbccf6-a62e-4eb1-9100-ad28bc319ca7 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.007639 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ff130-f0a4-409b-95cd-cfcaf2585c78 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.015530 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183e9d7-584f-4b79-86ae-5a4a3995fe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.016015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183e9d7-584f-4b79-86ae-5a4a3995fe7b admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.016454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183e9d7-584f-4b79-86ae-5a4a3995fe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.016696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183e9d7-584f-4b79-86ae-5a4a3995fe7b admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.017488 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183e9d7-584f-4b79-86ae-5a4a3995fe7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.019648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183e9d7-584f-4b79-86ae-5a4a3995fe7b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.043327 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ec9fd-edf0-4a3f-bb31-1eeafa43deaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.044422 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ec9fd-edf0-4a3f-bb31-1eeafa43deaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.044893 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 908/1793] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:52 2022] POST /identity/v3/users => generated 284 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:53.045037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ec9fd-edf0-4a3f-bb31-1eeafa43deaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.045343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ec9fd-edf0-4a3f-bb31-1eeafa43deaa admin admin] PATH_INFO: `/v3/projects/c7353ee3f4ed4e2fa7dd58940b6a009c/users/c0ab4c236ec94470ba3e9a84fe3dbb51/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.045550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183e9d7-584f-4b79-86ae-5a4a3995fe7b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.048047 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ec9fd-edf0-4a3f-bb31-1eeafa43deaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7353ee3f4ed4e2fa7dd58940b6a009c, user_id=c0ab4c236ec94470ba3e9a84fe3dbb51, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.050929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ec9fd-edf0-4a3f-bb31-1eeafa43deaa admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.057616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183e9d7-584f-4b79-86ae-5a4a3995fe7b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.073949 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 886/1794] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:52 2022] PUT /identity/v3/projects/c7353ee3f4ed4e2fa7dd58940b6a009c/users/c0ab4c236ec94470ba3e9a84fe3dbb51/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:53.073949 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ec9fd-edf0-4a3f-bb31-1eeafa43deaa admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.075510 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:53.143550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15840543-63d6-451b-9b31-bb0ebf8913aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.144416 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15840543-63d6-451b-9b31-bb0ebf8913aa admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.144838 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15840543-63d6-451b-9b31-bb0ebf8913aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.145119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15840543-63d6-451b-9b31-bb0ebf8913aa admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.145854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15840543-63d6-451b-9b31-bb0ebf8913aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.148326 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15840543-63d6-451b-9b31-bb0ebf8913aa admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.149833 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:53.180150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 909/1795] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:53 2022] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:53.182326 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c5645-e72c-430c-9a20-ddec0cabb982 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.183262 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c5645-e72c-430c-9a20-ddec0cabb982 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.183262 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c5645-e72c-430c-9a20-ddec0cabb982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.217135 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ec9fd-edf0-4a3f-bb31-1eeafa43deaa admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.223081 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4a3c5645-e72c-430c-9a20-ddec0cabb982 None None] MFA Rules not processed for user `c0ab4c236ec94470ba3e9a84fe3dbb51`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:53.224232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffad9c-669d-486d-8cdc-aa77e1c674ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.224447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4a3c5645-e72c-430c-9a20-ddec0cabb982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:53.225111 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffad9c-669d-486d-8cdc-aa77e1c674ec admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.225468 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffad9c-669d-486d-8cdc-aa77e1c674ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.225855 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffad9c-669d-486d-8cdc-aa77e1c674ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.226663 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffad9c-669d-486d-8cdc-aa77e1c674ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.228592 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffad9c-669d-486d-8cdc-aa77e1c674ec admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.243548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 887/1796] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:53.244646 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffad9c-669d-486d-8cdc-aa77e1c674ec admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.257549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffad9c-669d-486d-8cdc-aa77e1c674ec admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.268000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcbc97-d6a0-440f-8dfc-a159bf4ca149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.269049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcbc97-d6a0-440f-8dfc-a159bf4ca149 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.269335 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcbc97-d6a0-440f-8dfc-a159bf4ca149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.269616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcbc97-d6a0-440f-8dfc-a159bf4ca149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.270403 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcbc97-d6a0-440f-8dfc-a159bf4ca149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.272074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcbc97-d6a0-440f-8dfc-a159bf4ca149 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.287545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 888/1797] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:53.288571 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcbc97-d6a0-440f-8dfc-a159bf4ca149 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.299465 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcbc97-d6a0-440f-8dfc-a159bf4ca149 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.304338 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134fb1a-2198-4ed4-8d25-5f9c8892eb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.305030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134fb1a-2198-4ed4-8d25-5f9c8892eb87 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.305312 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134fb1a-2198-4ed4-8d25-5f9c8892eb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.305587 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134fb1a-2198-4ed4-8d25-5f9c8892eb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.306365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134fb1a-2198-4ed4-8d25-5f9c8892eb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.308015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134fb1a-2198-4ed4-8d25-5f9c8892eb87 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.320422 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 889/1798] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:53.321098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134fb1a-2198-4ed4-8d25-5f9c8892eb87 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.331073 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 910/1799] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:53 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:53.332184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c5645-e72c-430c-9a20-ddec0cabb982 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.337090 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134fb1a-2198-4ed4-8d25-5f9c8892eb87 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.343885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15075fdf-cc61-4ee1-b88f-98512a996417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.344646 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15075fdf-cc61-4ee1-b88f-98512a996417 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.344862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15075fdf-cc61-4ee1-b88f-98512a996417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.345125 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15075fdf-cc61-4ee1-b88f-98512a996417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.345905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15075fdf-cc61-4ee1-b88f-98512a996417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.346584 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c5645-e72c-430c-9a20-ddec0cabb982 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.347549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15075fdf-cc61-4ee1-b88f-98512a996417 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.351823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efb439-2512-4fd0-97bc-2da7a71ad235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.352749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efb439-2512-4fd0-97bc-2da7a71ad235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.353036 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efb439-2512-4fd0-97bc-2da7a71ad235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.353316 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efb439-2512-4fd0-97bc-2da7a71ad235 admin admin] PATH_INFO: `/v3/projects/400deee72b4c4de4bef32ea4f70d4692/users/7da0f3fd2d0a46438717cffe21554561/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.362905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 890/1800] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:53.363778 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15075fdf-cc61-4ee1-b88f-98512a996417 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.365846 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-15075fdf-cc61-4ee1-b88f-98512a996417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:53.375471 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efb439-2512-4fd0-97bc-2da7a71ad235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=400deee72b4c4de4bef32ea4f70d4692, user_id=7da0f3fd2d0a46438717cffe21554561, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.378651 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efb439-2512-4fd0-97bc-2da7a71ad235 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.397042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 911/1801] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:53 2022] PUT /identity/v3/projects/400deee72b4c4de4bef32ea4f70d4692/users/7da0f3fd2d0a46438717cffe21554561/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:53.410237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efb439-2512-4fd0-97bc-2da7a71ad235 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.441052 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15075fdf-cc61-4ee1-b88f-98512a996417 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.510668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efb439-2512-4fd0-97bc-2da7a71ad235 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.523006 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061efea9-42ea-4a7c-a93e-d9bab46d4e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.524413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061efea9-42ea-4a7c-a93e-d9bab46d4e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.524813 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061efea9-42ea-4a7c-a93e-d9bab46d4e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.525098 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061efea9-42ea-4a7c-a93e-d9bab46d4e42 admin admin] PATH_INFO: `/v3/projects/7d86d347280f44408ac4d138b1611509/users/8f8bb51612674e7698e5d9cd61af6355/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.526380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1797da-080a-4762-96cd-de68f9af16d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.527912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1797da-080a-4762-96cd-de68f9af16d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.528449 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1797da-080a-4762-96cd-de68f9af16d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.528924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1797da-080a-4762-96cd-de68f9af16d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.548702 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:53.554767 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061efea9-42ea-4a7c-a93e-d9bab46d4e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d86d347280f44408ac4d138b1611509, user_id=8f8bb51612674e7698e5d9cd61af6355, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.562449 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061efea9-42ea-4a7c-a93e-d9bab46d4e42 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.599358 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 912/1802] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:53 2022] PUT /identity/v3/projects/7d86d347280f44408ac4d138b1611509/users/8f8bb51612674e7698e5d9cd61af6355/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:53.600014 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596c7e9-e965-4c52-98c1-2e61fb27112a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.600461 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596c7e9-e965-4c52-98c1-2e61fb27112a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.601161 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596c7e9-e965-4c52-98c1-2e61fb27112a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.652562 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1797da-080a-4762-96cd-de68f9af16d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.655313 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1797da-080a-4762-96cd-de68f9af16d3 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.662232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:53.678087 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 891/1803] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:53 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:53.678578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-7596c7e9-e965-4c52-98c1-2e61fb27112a None None] MFA Rules not processed for user `7da0f3fd2d0a46438717cffe21554561`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:53.680118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7596c7e9-e965-4c52-98c1-2e61fb27112a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:53.683757 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38de7d-c904-4721-97ae-fb58fdf1b298 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.684649 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38de7d-c904-4721-97ae-fb58fdf1b298 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.685471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38de7d-c904-4721-97ae-fb58fdf1b298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.743998 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8d38de7d-c904-4721-97ae-fb58fdf1b298 None None] MFA Rules not processed for user `8f8bb51612674e7698e5d9cd61af6355`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:53.746015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8d38de7d-c904-4721-97ae-fb58fdf1b298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:53.848895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 892/1804] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:53.856382 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38de7d-c904-4721-97ae-fb58fdf1b298 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.861203 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 913/1805] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:53.867019 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596c7e9-e965-4c52-98c1-2e61fb27112a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:53.950950 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38de7d-c904-4721-97ae-fb58fdf1b298 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.963654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2696a-8e16-41ef-bb33-a0eb370679ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.964836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2696a-8e16-41ef-bb33-a0eb370679ad admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.965647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2696a-8e16-41ef-bb33-a0eb370679ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.966022 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2696a-8e16-41ef-bb33-a0eb370679ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.966765 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2696a-8e16-41ef-bb33-a0eb370679ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.968826 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2696a-8e16-41ef-bb33-a0eb370679ad admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:53.976167 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596c7e9-e965-4c52-98c1-2e61fb27112a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:53.983517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034e8cf-a2db-4995-b40f-9529b47d28b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:53.984499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034e8cf-a2db-4995-b40f-9529b47d28b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:53.984940 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034e8cf-a2db-4995-b40f-9529b47d28b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:53.985322 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034e8cf-a2db-4995-b40f-9529b47d28b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:53.986718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034e8cf-a2db-4995-b40f-9529b47d28b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:53.989838 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034e8cf-a2db-4995-b40f-9529b47d28b6 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:54.016064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 893/1806] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:53 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:54.020960 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2696a-8e16-41ef-bb33-a0eb370679ad admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:54.036584 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 914/1807] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:53 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:54.037980 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034e8cf-a2db-4995-b40f-9529b47d28b6 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:54.040700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2034e8cf-a2db-4995-b40f-9529b47d28b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:54.108186 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2696a-8e16-41ef-bb33-a0eb370679ad admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:54.140036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:54.149917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034e8cf-a2db-4995-b40f-9529b47d28b6 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:54.156251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c1c9e-a9f6-4bf5-a8dd-149da4f2d590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:54.157238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c1c9e-a9f6-4bf5-a8dd-149da4f2d590 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.157644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c1c9e-a9f6-4bf5-a8dd-149da4f2d590 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.158096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c1c9e-a9f6-4bf5-a8dd-149da4f2d590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.160841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6f7c1c9e-a9f6-4bf5-a8dd-149da4f2d590 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:54.187195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:54.208768 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378ebc5-1ebf-435c-b56d-676a87d771b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:54.209569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378ebc5-1ebf-435c-b56d-676a87d771b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.209897 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378ebc5-1ebf-435c-b56d-676a87d771b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.210179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378ebc5-1ebf-435c-b56d-676a87d771b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.210888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378ebc5-1ebf-435c-b56d-676a87d771b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:54.212855 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378ebc5-1ebf-435c-b56d-676a87d771b8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:54.242455 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 894/1808] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:54 2022] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:54.243439 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378ebc5-1ebf-435c-b56d-676a87d771b8 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:54.245732 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c1c9e-a9f6-4bf5-a8dd-149da4f2d590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:54.248730 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c1c9e-a9f6-4bf5-a8dd-149da4f2d590 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:54.256520 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378ebc5-1ebf-435c-b56d-676a87d771b8 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:54.259702 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 915/1809] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:54 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:54.260360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c1c9e-a9f6-4bf5-a8dd-149da4f2d590 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:54.261745 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55db62-30e9-4c9f-bf56-23d7459d218d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:54.262533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55db62-30e9-4c9f-bf56-23d7459d218d admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.262900 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55db62-30e9-4c9f-bf56-23d7459d218d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.263296 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55db62-30e9-4c9f-bf56-23d7459d218d admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.274134 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55db62-30e9-4c9f-bf56-23d7459d218d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:54.276452 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55db62-30e9-4c9f-bf56-23d7459d218d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:54.281171 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c1c9e-a9f6-4bf5-a8dd-149da4f2d590 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:54.290273 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d25a9-2338-4dd2-93dc-361524198bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:54.291030 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d25a9-2338-4dd2-93dc-361524198bed admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.291397 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d25a9-2338-4dd2-93dc-361524198bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.291680 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d25a9-2338-4dd2-93dc-361524198bed admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.292590 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d25a9-2338-4dd2-93dc-361524198bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:54.294971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d25a9-2338-4dd2-93dc-361524198bed admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:54.307324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 895/1810] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:54 2022] POST /identity/v3/users => generated 291 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:54.309327 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 916/1811] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:54.312470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55db62-30e9-4c9f-bf56-23d7459d218d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:54.312699 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d25a9-2338-4dd2-93dc-361524198bed admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:54.325992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55db62-30e9-4c9f-bf56-23d7459d218d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:54.329432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d25a9-2338-4dd2-93dc-361524198bed admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:54.334547 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fba61-34ba-41df-8faf-48f74fc3fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:54.336036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fba61-34ba-41df-8faf-48f74fc3fa8d admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.336713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fba61-34ba-41df-8faf-48f74fc3fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.337176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fba61-34ba-41df-8faf-48f74fc3fa8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.338462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fba61-34ba-41df-8faf-48f74fc3fa8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:54.340793 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fba61-34ba-41df-8faf-48f74fc3fa8d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:54.341297 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc69f79-928d-4e9b-9602-a225c6213772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:54.343001 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc69f79-928d-4e9b-9602-a225c6213772 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.343477 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc69f79-928d-4e9b-9602-a225c6213772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.344556 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc69f79-928d-4e9b-9602-a225c6213772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.346027 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc69f79-928d-4e9b-9602-a225c6213772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:54.349274 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc69f79-928d-4e9b-9602-a225c6213772 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:54.360452 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 896/1812] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:01:54.372971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 917/1813] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:54.374801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc69f79-928d-4e9b-9602-a225c6213772 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:54.380058 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fba61-34ba-41df-8faf-48f74fc3fa8d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:54.387167 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc69f79-928d-4e9b-9602-a225c6213772 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:54.396826 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222bd1a8-ad2a-421e-9dbe-b4542f6d263f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:54.398730 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bd1a8-ad2a-421e-9dbe-b4542f6d263f admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.399085 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bd1a8-ad2a-421e-9dbe-b4542f6d263f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.399443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bd1a8-ad2a-421e-9dbe-b4542f6d263f admin admin] PATH_INFO: `/v3/projects/f16de971db504253a02dc507c3f5ecec/users/75aa00cd29334b2ca7a0087a21f0fa67/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.401678 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fba61-34ba-41df-8faf-48f74fc3fa8d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:54.419399 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df069ded-feaa-485f-bd5e-b43422d1d9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:54.419905 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222bd1a8-ad2a-421e-9dbe-b4542f6d263f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16de971db504253a02dc507c3f5ecec, user_id=75aa00cd29334b2ca7a0087a21f0fa67, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:54.420762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df069ded-feaa-485f-bd5e-b43422d1d9ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.421210 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df069ded-feaa-485f-bd5e-b43422d1d9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.421646 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df069ded-feaa-485f-bd5e-b43422d1d9ec admin admin] PATH_INFO: `/v3/projects/8e09c300e5494cb784619cb4e5b6cbfe/users/11975c297b774e4f94cf3135884dc7cc/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.424158 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222bd1a8-ad2a-421e-9dbe-b4542f6d263f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:54.456346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df069ded-feaa-485f-bd5e-b43422d1d9ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e09c300e5494cb784619cb4e5b6cbfe, user_id=11975c297b774e4f94cf3135884dc7cc, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:54.459362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df069ded-feaa-485f-bd5e-b43422d1d9ec admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:54.459712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 918/1814] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:54 2022] PUT /identity/v3/projects/f16de971db504253a02dc507c3f5ecec/users/75aa00cd29334b2ca7a0087a21f0fa67/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:54.477634 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25fb92-23bb-48bd-a919-60aeb33dcf04 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.477988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25fb92-23bb-48bd-a919-60aeb33dcf04 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.478401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25fb92-23bb-48bd-a919-60aeb33dcf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.493885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 897/1815] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:54 2022] PUT /identity/v3/projects/8e09c300e5494cb784619cb4e5b6cbfe/users/11975c297b774e4f94cf3135884dc7cc/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:01:54.498286 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df069ded-feaa-485f-bd5e-b43422d1d9ec admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:54.523537 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-1e25fb92-23bb-48bd-a919-60aeb33dcf04 None None] MFA Rules not processed for user `75aa00cd29334b2ca7a0087a21f0fa67`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:54.523537 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1e25fb92-23bb-48bd-a919-60aeb33dcf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:54.623346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 919/1816] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:54.629685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25fb92-23bb-48bd-a919-60aeb33dcf04 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:54.643000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df069ded-feaa-485f-bd5e-b43422d1d9ec admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:54.668209 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25fb92-23bb-48bd-a919-60aeb33dcf04 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:54.678989 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df118f74-cecf-4c8a-be29-166fb44eb849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:54.684111 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df118f74-cecf-4c8a-be29-166fb44eb849 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.684641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df118f74-cecf-4c8a-be29-166fb44eb849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.685391 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df118f74-cecf-4c8a-be29-166fb44eb849 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.686795 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732281a8-1711-476e-a700-161039e4ad0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:54.687903 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732281a8-1711-476e-a700-161039e4ad0b admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.688576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732281a8-1711-476e-a700-161039e4ad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.688706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df118f74-cecf-4c8a-be29-166fb44eb849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:54.689129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732281a8-1711-476e-a700-161039e4ad0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.690421 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732281a8-1711-476e-a700-161039e4ad0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:54.694456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df118f74-cecf-4c8a-be29-166fb44eb849 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:54.697490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732281a8-1711-476e-a700-161039e4ad0b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:54.723145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 898/1817] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:54.728780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df118f74-cecf-4c8a-be29-166fb44eb849 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:54.772717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df118f74-cecf-4c8a-be29-166fb44eb849 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:54.779419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 920/1818] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:01:54 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:01:54.783705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732281a8-1711-476e-a700-161039e4ad0b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:54.784808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413b006-a894-4279-8540-39e7fe615802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:54.788365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413b006-a894-4279-8540-39e7fe615802 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.790020 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413b006-a894-4279-8540-39e7fe615802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.790793 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413b006-a894-4279-8540-39e7fe615802 admin admin] PATH_INFO: `/v3/projects/8e09c300e5494cb784619cb4e5b6cbfe/users/11975c297b774e4f94cf3135884dc7cc/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.801233 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413b006-a894-4279-8540-39e7fe615802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e09c300e5494cb784619cb4e5b6cbfe, user_id=11975c297b774e4f94cf3135884dc7cc, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:54.819302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413b006-a894-4279-8540-39e7fe615802 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:54.879818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 899/1819] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:54 2022] PUT /identity/v3/projects/8e09c300e5494cb784619cb4e5b6cbfe/users/11975c297b774e4f94cf3135884dc7cc/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:54.895984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9c135-66cd-45a9-9b64-648e284c63e2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:54.896295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9c135-66cd-45a9-9b64-648e284c63e2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:54.904449 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9c135-66cd-45a9-9b64-648e284c63e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:54.957523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:55.010848 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e4e9c135-66cd-45a9-9b64-648e284c63e2 None None] MFA Rules not processed for user `11975c297b774e4f94cf3135884dc7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:55.012555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e4e9c135-66cd-45a9-9b64-648e284c63e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:55.022622 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732281a8-1711-476e-a700-161039e4ad0b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:55.120725 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:55.251855 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4f816-5915-4ad6-ad55-260ef96d688c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:55.253271 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4f816-5915-4ad6-ad55-260ef96d688c admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:55.260569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 900/1820] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:55.262965 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4f816-5915-4ad6-ad55-260ef96d688c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:55.263545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4f816-5915-4ad6-ad55-260ef96d688c admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:55.272680 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4f816-5915-4ad6-ad55-260ef96d688c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:55.278681 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4f816-5915-4ad6-ad55-260ef96d688c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:55.309844 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9c135-66cd-45a9-9b64-648e284c63e2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:55.352429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 921/1821] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:01:54 2022] POST /identity/v3/users => generated 296 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:01:55.358847 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4f816-5915-4ad6-ad55-260ef96d688c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:55.389840 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4f816-5915-4ad6-ad55-260ef96d688c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:55.412447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab449b-234f-49c0-9707-d5c185ffdadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:55.414912 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab449b-234f-49c0-9707-d5c185ffdadc admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:55.415637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab449b-234f-49c0-9707-d5c185ffdadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:55.416168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab449b-234f-49c0-9707-d5c185ffdadc admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:55.419305 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab449b-234f-49c0-9707-d5c185ffdadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:55.434547 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab449b-234f-49c0-9707-d5c185ffdadc admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:55.496535 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 922/1822] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:55.510742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab449b-234f-49c0-9707-d5c185ffdadc admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:55.516551 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9c135-66cd-45a9-9b64-648e284c63e2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:55.527938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b97ab9-9777-4fe4-b990-42f5a170a316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:55.528707 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b97ab9-9777-4fe4-b990-42f5a170a316 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:55.529000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b97ab9-9777-4fe4-b990-42f5a170a316 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:55.529340 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b97ab9-9777-4fe4-b990-42f5a170a316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:55.542337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab449b-234f-49c0-9707-d5c185ffdadc admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:55.554722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b351dec-5f8c-4087-bf42-0480a2c6a209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:55.556520 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b97ab9-9777-4fe4-b990-42f5a170a316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:55.556803 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b351dec-5f8c-4087-bf42-0480a2c6a209 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:55.557347 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b351dec-5f8c-4087-bf42-0480a2c6a209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:55.557919 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b351dec-5f8c-4087-bf42-0480a2c6a209 admin admin] PATH_INFO: `/v3/projects/7c12c49b71bc4601a69746d3cf750b38/users/167cda337fc64361a192285f0ed73860/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:55.558165 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b97ab9-9777-4fe4-b990-42f5a170a316 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:55.584633 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 901/1823] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:55 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:01:55.605977 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b351dec-5f8c-4087-bf42-0480a2c6a209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c12c49b71bc4601a69746d3cf750b38, user_id=167cda337fc64361a192285f0ed73860, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:55.609111 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b351dec-5f8c-4087-bf42-0480a2c6a209 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:55.642861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 923/1824] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:55 2022] PUT /identity/v3/projects/7c12c49b71bc4601a69746d3cf750b38/users/167cda337fc64361a192285f0ed73860/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:55.647097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b97ab9-9777-4fe4-b990-42f5a170a316 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:55.666294 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b97ab9-9777-4fe4-b990-42f5a170a316 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:55.794517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b351dec-5f8c-4087-bf42-0480a2c6a209 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:55.869334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae19b91-15c6-44a2-80e7-9ffef819f6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:55.872684 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae19b91-15c6-44a2-80e7-9ffef819f6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:55.874281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae19b91-15c6-44a2-80e7-9ffef819f6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:55.874754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae19b91-15c6-44a2-80e7-9ffef819f6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:55.876033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae19b91-15c6-44a2-80e7-9ffef819f6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:55.881220 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae19b91-15c6-44a2-80e7-9ffef819f6d1 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:55.906098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 902/1825] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:01:55.907660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae19b91-15c6-44a2-80e7-9ffef819f6d1 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:55.924001 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae19b91-15c6-44a2-80e7-9ffef819f6d1 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:55.931444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08cc83-cff7-428e-b1a1-2b8d213c9064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:55.932700 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08cc83-cff7-428e-b1a1-2b8d213c9064 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:55.934161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08cc83-cff7-428e-b1a1-2b8d213c9064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:55.934161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08cc83-cff7-428e-b1a1-2b8d213c9064 admin admin] PATH_INFO: `/v3/projects/7c12c49b71bc4601a69746d3cf750b38/users/167cda337fc64361a192285f0ed73860/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:55.936531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08cc83-cff7-428e-b1a1-2b8d213c9064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c12c49b71bc4601a69746d3cf750b38, user_id=167cda337fc64361a192285f0ed73860, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:55.940227 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08cc83-cff7-428e-b1a1-2b8d213c9064 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:55.971589 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 903/1826] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:01:55 2022] PUT /identity/v3/projects/7c12c49b71bc4601a69746d3cf750b38/users/167cda337fc64361a192285f0ed73860/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:01:55.974359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47368bff-adc7-442e-9bf5-b6831fe53da6 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:55.974816 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47368bff-adc7-442e-9bf5-b6831fe53da6 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:55.975189 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47368bff-adc7-442e-9bf5-b6831fe53da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:56.018916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-47368bff-adc7-442e-9bf5-b6831fe53da6 None None] MFA Rules not processed for user `167cda337fc64361a192285f0ed73860`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:01:56.020459 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-47368bff-adc7-442e-9bf5-b6831fe53da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:01:56.029397 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b351dec-5f8c-4087-bf42-0480a2c6a209 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:56.133029 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:56.190912 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4e3c1-67a3-4ed2-92cd-1b9f926a6ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:56.194538 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4e3c1-67a3-4ed2-92cd-1b9f926a6ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:56.195044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4e3c1-67a3-4ed2-92cd-1b9f926a6ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:56.195544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4e3c1-67a3-4ed2-92cd-1b9f926a6ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:56.242607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:01:56.260810 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 904/1827] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:01:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:01:56.320060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4e3c1-67a3-4ed2-92cd-1b9f926a6ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:56.321541 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4e3c1-67a3-4ed2-92cd-1b9f926a6ad0 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:56.334950 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 924/1828] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:55 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:56.477859 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47368bff-adc7-442e-9bf5-b6831fe53da6 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:56.490144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47368bff-adc7-442e-9bf5-b6831fe53da6 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:56.495144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622cd62-f555-4654-b4cf-de44126d18cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:56.496121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622cd62-f555-4654-b4cf-de44126d18cb service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:56.496480 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622cd62-f555-4654-b4cf-de44126d18cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:56.496765 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622cd62-f555-4654-b4cf-de44126d18cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:56.509068 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622cd62-f555-4654-b4cf-de44126d18cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:56.510947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622cd62-f555-4654-b4cf-de44126d18cb service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:56.524586 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 905/1829] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:56 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:01:56.590943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4e3c1-67a3-4ed2-92cd-1b9f926a6ad0 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:01:56.604595 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4e3c1-67a3-4ed2-92cd-1b9f926a6ad0 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:01:56.609779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f55ef-2f2f-4b6a-bf37-9848ed840000 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:01:56.610626 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f55ef-2f2f-4b6a-bf37-9848ed840000 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:01:56.610784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f55ef-2f2f-4b6a-bf37-9848ed840000 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:01:56.611062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f55ef-2f2f-4b6a-bf37-9848ed840000 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:01:56.704567 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f55ef-2f2f-4b6a-bf37-9848ed840000 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:01:56.706962 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f55ef-2f2f-4b6a-bf37-9848ed840000 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:01:56.722828 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 925/1830] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:01:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:00.039770 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622cd62-f555-4654-b4cf-de44126d18cb service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:00.235135 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622cd62-f555-4654-b4cf-de44126d18cb service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:00.243636 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af5ce8-fdd6-44d4-ba7f-fdf4f62bdf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:00.245494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af5ce8-fdd6-44d4-ba7f-fdf4f62bdf88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:00.246752 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af5ce8-fdd6-44d4-ba7f-fdf4f62bdf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:00.247501 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af5ce8-fdd6-44d4-ba7f-fdf4f62bdf88 admin admin] PATH_INFO: `/v3/users/7da0f3fd2d0a46438717cffe21554561` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:00.249865 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af5ce8-fdd6-44d4-ba7f-fdf4f62bdf88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7da0f3fd2d0a46438717cffe21554561)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:00.253862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af5ce8-fdd6-44d4-ba7f-fdf4f62bdf88 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:00.332298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-01af5ce8-fdd6-44d4-ba7f-fdf4f62bdf88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7da0f3fd2d0a46438717cffe21554561'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:00.333463 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-01af5ce8-fdd6-44d4-ba7f-fdf4f62bdf88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7da0f3fd2d0a46438717cffe21554561'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:00.346090 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-01af5ce8-fdd6-44d4-ba7f-fdf4f62bdf88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7da0f3fd2d0a46438717cffe21554561'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:00.367430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-01af5ce8-fdd6-44d4-ba7f-fdf4f62bdf88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7da0f3fd2d0a46438717cffe21554561'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:00.368450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-01af5ce8-fdd6-44d4-ba7f-fdf4f62bdf88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7da0f3fd2d0a46438717cffe21554561'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:00.387441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861754a-a966-4703-8888-46acfa90e94f None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:00.388521 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861754a-a966-4703-8888-46acfa90e94f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:00.389404 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861754a-a966-4703-8888-46acfa90e94f None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:00.390797 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 906/1831] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:00 2022] DELETE /identity/v3/users/7da0f3fd2d0a46438717cffe21554561 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:00.392894 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 926/1832] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 2 19:02:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:00.396059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7259c-935e-471c-9d93-ea8746cbecf4 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:00.396420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7259c-935e-471c-9d93-ea8746cbecf4 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:00.396755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7259c-935e-471c-9d93-ea8746cbecf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:00.404875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bec24-252c-4633-b374-9255e9db2c9e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:00.405503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bec24-252c-4633-b374-9255e9db2c9e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:00.405969 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bec24-252c-4633-b374-9255e9db2c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:00.433399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4b6bec24-252c-4633-b374-9255e9db2c9e None None] MFA Rules not processed for user `6b8ff9f5032e498db3c70c79cc11989b`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:00.435389 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4b6bec24-252c-4633-b374-9255e9db2c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:00.446587 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a4f7259c-935e-471c-9d93-ea8746cbecf4 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:00.449388 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a4f7259c-935e-471c-9d93-ea8746cbecf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:00.537343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:00.582850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 907/1833] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:00.583028 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 927/1834] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 2 19:02:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:00.591603 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7259c-935e-471c-9d93-ea8746cbecf4 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:00.594677 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a4f7259c-935e-471c-9d93-ea8746cbecf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:00.599152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bec24-252c-4633-b374-9255e9db2c9e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:00.601238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4b6bec24-252c-4633-b374-9255e9db2c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:00.622004 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bec24-252c-4633-b374-9255e9db2c9e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:00.630127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d871fe-746a-4159-8d27-9a3dac248bba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:00.631170 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d871fe-746a-4159-8d27-9a3dac248bba service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:00.631673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d871fe-746a-4159-8d27-9a3dac248bba service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:00.632106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d871fe-746a-4159-8d27-9a3dac248bba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:00.648502 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d871fe-746a-4159-8d27-9a3dac248bba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:00.651924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d871fe-746a-4159-8d27-9a3dac248bba service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:00.673863 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 928/1835] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:00.686439 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7259c-935e-471c-9d93-ea8746cbecf4 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:00.693870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62faca-4190-487f-a314-6d40b8c47a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:00.695539 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62faca-4190-487f-a314-6d40b8c47a88 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:00.696260 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62faca-4190-487f-a314-6d40b8c47a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:00.696645 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62faca-4190-487f-a314-6d40b8c47a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:00.710777 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62faca-4190-487f-a314-6d40b8c47a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:00.713345 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62faca-4190-487f-a314-6d40b8c47a88 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:00.733368 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 908/1836] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:02:01.070040 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d871fe-746a-4159-8d27-9a3dac248bba service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:01.071536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c7d871fe-746a-4159-8d27-9a3dac248bba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:01.086763 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d871fe-746a-4159-8d27-9a3dac248bba service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:01.092159 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e721c5-24d1-4355-b921-6d9f4b8158f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:01.093101 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e721c5-24d1-4355-b921-6d9f4b8158f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:01.093348 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e721c5-24d1-4355-b921-6d9f4b8158f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:01.093617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e721c5-24d1-4355-b921-6d9f4b8158f2 admin admin] PATH_INFO: `/v3/projects/400deee72b4c4de4bef32ea4f70d4692` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:01.094999 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e721c5-24d1-4355-b921-6d9f4b8158f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=400deee72b4c4de4bef32ea4f70d4692)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:01.096986 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e721c5-24d1-4355-b921-6d9f4b8158f2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:01.126255 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:01.171710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f6e721c5-24d1-4355-b921-6d9f4b8158f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '400deee72b4c4de4bef32ea4f70d4692', 'request_id': 'req-f6e721c5-24d1-4355-b921-6d9f4b8158f2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:01.187095 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f6e721c5-24d1-4355-b921-6d9f4b8158f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '400deee72b4c4de4bef32ea4f70d4692', 'request_id': 'req-f6e721c5-24d1-4355-b921-6d9f4b8158f2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:01.195609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f6e721c5-24d1-4355-b921-6d9f4b8158f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '400deee72b4c4de4bef32ea4f70d4692', 'request_id': 'req-f6e721c5-24d1-4355-b921-6d9f4b8158f2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:01.209872 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f6e721c5-24d1-4355-b921-6d9f4b8158f2 admin admin] The token cache is being invalidate because project 400deee72b4c4de4bef32ea4f70d4692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:01.210164 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f6e721c5-24d1-4355-b921-6d9f4b8158f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:01.210825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f6e721c5-24d1-4355-b921-6d9f4b8158f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:01.212552 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 929/1837] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:01 2022] DELETE /identity/v3/projects/400deee72b4c4de4bef32ea4f70d4692 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:02:01.216775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62faca-4190-487f-a314-6d40b8c47a88 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:01.226733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62faca-4190-487f-a314-6d40b8c47a88 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:01.289439 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613087b-77ec-410d-a251-0c4f9d8b6ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:01.290378 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613087b-77ec-410d-a251-0c4f9d8b6ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:01.290662 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613087b-77ec-410d-a251-0c4f9d8b6ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:01.290940 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613087b-77ec-410d-a251-0c4f9d8b6ae2 admin admin] PATH_INFO: `/v3/users/11975c297b774e4f94cf3135884dc7cc` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:01.292244 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613087b-77ec-410d-a251-0c4f9d8b6ae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11975c297b774e4f94cf3135884dc7cc)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:01.294648 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613087b-77ec-410d-a251-0c4f9d8b6ae2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:01.354863 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c613087b-77ec-410d-a251-0c4f9d8b6ae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11975c297b774e4f94cf3135884dc7cc'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:01.361025 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c613087b-77ec-410d-a251-0c4f9d8b6ae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11975c297b774e4f94cf3135884dc7cc'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:01.370179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c613087b-77ec-410d-a251-0c4f9d8b6ae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11975c297b774e4f94cf3135884dc7cc'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:01.391867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c613087b-77ec-410d-a251-0c4f9d8b6ae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11975c297b774e4f94cf3135884dc7cc'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:01.392623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c613087b-77ec-410d-a251-0c4f9d8b6ae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11975c297b774e4f94cf3135884dc7cc'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:01.413274 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 909/1838] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:01 2022] DELETE /identity/v3/users/11975c297b774e4f94cf3135884dc7cc => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:02:01.774591 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e721c5-24d1-4355-b921-6d9f4b8158f2 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:01.776138 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f6e721c5-24d1-4355-b921-6d9f4b8158f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:01.790070 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e721c5-24d1-4355-b921-6d9f4b8158f2 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:01.856032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bddf4-8707-4832-89a3-602ae3e09e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:01.856797 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bddf4-8707-4832-89a3-602ae3e09e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:01.857081 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bddf4-8707-4832-89a3-602ae3e09e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:01.857352 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bddf4-8707-4832-89a3-602ae3e09e1e admin admin] PATH_INFO: `/v3/projects/8e09c300e5494cb784619cb4e5b6cbfe` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:01.858730 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442bddf4-8707-4832-89a3-602ae3e09e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e09c300e5494cb784619cb4e5b6cbfe)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:01.860722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442bddf4-8707-4832-89a3-602ae3e09e1e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:01.915731 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-442bddf4-8707-4832-89a3-602ae3e09e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e09c300e5494cb784619cb4e5b6cbfe', 'request_id': 'req-442bddf4-8707-4832-89a3-602ae3e09e1e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:01.924963 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-442bddf4-8707-4832-89a3-602ae3e09e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e09c300e5494cb784619cb4e5b6cbfe', 'request_id': 'req-442bddf4-8707-4832-89a3-602ae3e09e1e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:01.931891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-442bddf4-8707-4832-89a3-602ae3e09e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e09c300e5494cb784619cb4e5b6cbfe', 'request_id': 'req-442bddf4-8707-4832-89a3-602ae3e09e1e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:01.943054 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-442bddf4-8707-4832-89a3-602ae3e09e1e admin admin] The token cache is being invalidate because project 8e09c300e5494cb784619cb4e5b6cbfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:01.943322 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-442bddf4-8707-4832-89a3-602ae3e09e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:01.943965 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-442bddf4-8707-4832-89a3-602ae3e09e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:01.945523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 930/1839] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:01 2022] DELETE /identity/v3/projects/8e09c300e5494cb784619cb4e5b6cbfe => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:01.950684 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd67682-fb65-44e0-8656-93b584269974 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:01.950972 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd67682-fb65-44e0-8656-93b584269974 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:01.951243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd67682-fb65-44e0-8656-93b584269974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:01.959332 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:01.971863 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-3bd67682-fb65-44e0-8656-93b584269974 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:01.974143 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3bd67682-fb65-44e0-8656-93b584269974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:02.048089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 910/1840] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:02.056835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09ef0a-0f48-403b-917e-1b8a130ddb8b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.057199 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09ef0a-0f48-403b-917e-1b8a130ddb8b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.057490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09ef0a-0f48-403b-917e-1b8a130ddb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.077893 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-bf09ef0a-0f48-403b-917e-1b8a130ddb8b None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:02.079107 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-bf09ef0a-0f48-403b-917e-1b8a130ddb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:02.091652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 931/1841] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:02.096134 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd67682-fb65-44e0-8656-93b584269974 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:02.106455 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd67682-fb65-44e0-8656-93b584269974 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:02.111415 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e26c1-25ac-4f0a-b8d3-c2af1b9e9012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:02.112092 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e26c1-25ac-4f0a-b8d3-c2af1b9e9012 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.112377 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e26c1-25ac-4f0a-b8d3-c2af1b9e9012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.112633 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e26c1-25ac-4f0a-b8d3-c2af1b9e9012 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.113361 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e26c1-25ac-4f0a-b8d3-c2af1b9e9012 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:02.113653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e26c1-25ac-4f0a-b8d3-c2af1b9e9012 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:02.115320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e26c1-25ac-4f0a-b8d3-c2af1b9e9012 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:02.127679 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 911/1842] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:02.132941 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09ef0a-0f48-403b-917e-1b8a130ddb8b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:02.144157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09ef0a-0f48-403b-917e-1b8a130ddb8b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:02.148793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf105a-662b-45ca-8072-b01d6523fe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:02.149469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf105a-662b-45ca-8072-b01d6523fe2d admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.149750 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf105a-662b-45ca-8072-b01d6523fe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.150056 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf105a-662b-45ca-8072-b01d6523fe2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.150779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf105a-662b-45ca-8072-b01d6523fe2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:02.152735 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf105a-662b-45ca-8072-b01d6523fe2d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:02.185110 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 932/1843] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:02 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:02.186282 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e26c1-25ac-4f0a-b8d3-c2af1b9e9012 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:02.196718 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e26c1-25ac-4f0a-b8d3-c2af1b9e9012 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:02.256479 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f2bcb-d44d-4394-a571-0d84d3a5a5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:02.257163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f2bcb-d44d-4394-a571-0d84d3a5a5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.257427 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f2bcb-d44d-4394-a571-0d84d3a5a5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.257700 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f2bcb-d44d-4394-a571-0d84d3a5a5c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.258436 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f2bcb-d44d-4394-a571-0d84d3a5a5c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:02.260392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f2bcb-d44d-4394-a571-0d84d3a5a5c6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:02.284037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 912/1844] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:02 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:02.288736 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf105a-662b-45ca-8072-b01d6523fe2d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:02.301259 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf105a-662b-45ca-8072-b01d6523fe2d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:02.307767 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb5fca-eab2-4504-b831-87626fc16196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:02.309189 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb5fca-eab2-4504-b831-87626fc16196 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.309465 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb5fca-eab2-4504-b831-87626fc16196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.309736 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb5fca-eab2-4504-b831-87626fc16196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.311877 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb5fca-eab2-4504-b831-87626fc16196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:02.313599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb5fca-eab2-4504-b831-87626fc16196 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:02.329839 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 933/1845] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:02.333023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f2bcb-d44d-4394-a571-0d84d3a5a5c6 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:02.344517 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f2bcb-d44d-4394-a571-0d84d3a5a5c6 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:02.350172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577e600-eca7-4176-b598-e10e2edb2faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:02.350886 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577e600-eca7-4176-b598-e10e2edb2faa admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.351168 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577e600-eca7-4176-b598-e10e2edb2faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.351443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577e600-eca7-4176-b598-e10e2edb2faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.352183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577e600-eca7-4176-b598-e10e2edb2faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:02.353939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577e600-eca7-4176-b598-e10e2edb2faa admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:02.365733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 913/1846] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:02.370054 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb5fca-eab2-4504-b831-87626fc16196 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:02.375580 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:02.381309 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb5fca-eab2-4504-b831-87626fc16196 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:02.397979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729af91f-94db-4b2f-878e-f3053dfc7b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:02.399265 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729af91f-94db-4b2f-878e-f3053dfc7b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.399860 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729af91f-94db-4b2f-878e-f3053dfc7b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.400206 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729af91f-94db-4b2f-878e-f3053dfc7b50 admin admin] PATH_INFO: `/v3/projects/6a1e10578e214aba9e49b847a5c2c247/users/b7b99a0ab9b941739415e5af20f71075/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.425435 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729af91f-94db-4b2f-878e-f3053dfc7b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1e10578e214aba9e49b847a5c2c247, user_id=b7b99a0ab9b941739415e5af20f71075, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:02.430932 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729af91f-94db-4b2f-878e-f3053dfc7b50 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:02.453841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 934/1847] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:02 2022] PUT /identity/v3/projects/6a1e10578e214aba9e49b847a5c2c247/users/b7b99a0ab9b941739415e5af20f71075/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:02:02.471763 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403fd9-0de1-48e0-ab38-d6bb9b112bb3 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.472195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403fd9-0de1-48e0-ab38-d6bb9b112bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.472608 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403fd9-0de1-48e0-ab38-d6bb9b112bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.508159 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-fa403fd9-0de1-48e0-ab38-d6bb9b112bb3 None None] MFA Rules not processed for user `b7b99a0ab9b941739415e5af20f71075`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:02.509680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-fa403fd9-0de1-48e0-ab38-d6bb9b112bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:02.624506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:02.631340 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 914/1848] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:02:02.644444 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729af91f-94db-4b2f-878e-f3053dfc7b50 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:02.646437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-729af91f-94db-4b2f-878e-f3053dfc7b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:02.742453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729af91f-94db-4b2f-878e-f3053dfc7b50 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:02.750550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace800e-0e5c-43bb-ba76-eec8ec3f78d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:02.752010 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace800e-0e5c-43bb-ba76-eec8ec3f78d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:02.752673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace800e-0e5c-43bb-ba76-eec8ec3f78d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:02.753507 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace800e-0e5c-43bb-ba76-eec8ec3f78d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:02.773144 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace800e-0e5c-43bb-ba76-eec8ec3f78d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:02.775928 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace800e-0e5c-43bb-ba76-eec8ec3f78d8 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:02.796341 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 935/1849] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:02:10.604379 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa403fd9-0de1-48e0-ab38-d6bb9b112bb3 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:10.606629 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-fa403fd9-0de1-48e0-ab38-d6bb9b112bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:10.712746 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa403fd9-0de1-48e0-ab38-d6bb9b112bb3 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:10.723969 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92237ac4-ca2f-4498-92d6-808644bf7bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:10.726623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92237ac4-ca2f-4498-92d6-808644bf7bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:10.726938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92237ac4-ca2f-4498-92d6-808644bf7bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:10.727245 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92237ac4-ca2f-4498-92d6-808644bf7bcc admin admin] PATH_INFO: `/v3/users/74d2b6d84b8244e88a8d3758c7b873f0` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:10.728760 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92237ac4-ca2f-4498-92d6-808644bf7bcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d2b6d84b8244e88a8d3758c7b873f0)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:10.731481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92237ac4-ca2f-4498-92d6-808644bf7bcc admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:10.820742 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-92237ac4-ca2f-4498-92d6-808644bf7bcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d2b6d84b8244e88a8d3758c7b873f0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:10.821715 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-92237ac4-ca2f-4498-92d6-808644bf7bcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d2b6d84b8244e88a8d3758c7b873f0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:10.831729 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-92237ac4-ca2f-4498-92d6-808644bf7bcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d2b6d84b8244e88a8d3758c7b873f0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:10.848131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-92237ac4-ca2f-4498-92d6-808644bf7bcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d2b6d84b8244e88a8d3758c7b873f0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:10.848881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-92237ac4-ca2f-4498-92d6-808644bf7bcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d2b6d84b8244e88a8d3758c7b873f0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:10.867017 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 915/1850] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:10 2022] DELETE /identity/v3/users/74d2b6d84b8244e88a8d3758c7b873f0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:10.871578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594b3c4-c5d0-442a-b306-0b1133a59146 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:10.872146 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594b3c4-c5d0-442a-b306-0b1133a59146 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:10.872326 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594b3c4-c5d0-442a-b306-0b1133a59146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:10.908166 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9594b3c4-c5d0-442a-b306-0b1133a59146 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:10.909537 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9594b3c4-c5d0-442a-b306-0b1133a59146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:11.001711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 936/1851] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:11.013735 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92237ac4-ca2f-4498-92d6-808644bf7bcc admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:11.015557 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-92237ac4-ca2f-4498-92d6-808644bf7bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:11.084840 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594b3c4-c5d0-442a-b306-0b1133a59146 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:11.086460 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9594b3c4-c5d0-442a-b306-0b1133a59146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:11.100120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594b3c4-c5d0-442a-b306-0b1133a59146 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:11.118434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a6732-a756-4b9b-87b9-0f3244cc59e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:11.119997 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a6732-a756-4b9b-87b9-0f3244cc59e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:11.120989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a6732-a756-4b9b-87b9-0f3244cc59e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:11.121291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a6732-a756-4b9b-87b9-0f3244cc59e9 admin admin] PATH_INFO: `/v3/users/8f8bb51612674e7698e5d9cd61af6355` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:11.134237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a6732-a756-4b9b-87b9-0f3244cc59e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f8bb51612674e7698e5d9cd61af6355)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:11.137516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92237ac4-ca2f-4498-92d6-808644bf7bcc admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:11.137709 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a6732-a756-4b9b-87b9-0f3244cc59e9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:11.144969 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915e3de-e23f-4a0e-a1a5-8b24382f5bc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:11.145613 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915e3de-e23f-4a0e-a1a5-8b24382f5bc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:11.146047 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915e3de-e23f-4a0e-a1a5-8b24382f5bc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:11.146120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915e3de-e23f-4a0e-a1a5-8b24382f5bc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:11.157465 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915e3de-e23f-4a0e-a1a5-8b24382f5bc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:11.158958 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915e3de-e23f-4a0e-a1a5-8b24382f5bc1 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:11.170506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 916/1852] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:11.229218 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7b3a6732-a756-4b9b-87b9-0f3244cc59e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f8bb51612674e7698e5d9cd61af6355'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:11.231385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7b3a6732-a756-4b9b-87b9-0f3244cc59e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f8bb51612674e7698e5d9cd61af6355'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:11.243143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7b3a6732-a756-4b9b-87b9-0f3244cc59e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f8bb51612674e7698e5d9cd61af6355'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:11.257138 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7b3a6732-a756-4b9b-87b9-0f3244cc59e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f8bb51612674e7698e5d9cd61af6355'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:11.258254 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7b3a6732-a756-4b9b-87b9-0f3244cc59e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f8bb51612674e7698e5d9cd61af6355'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:11.274346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:11.285329 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 937/1853] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:11 2022] DELETE /identity/v3/users/8f8bb51612674e7698e5d9cd61af6355 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:02:11.290276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e59542-1612-4c48-90d0-f6109678e00e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:11.290582 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e59542-1612-4c48-90d0-f6109678e00e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:11.290862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e59542-1612-4c48-90d0-f6109678e00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:11.311186 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-54e59542-1612-4c48-90d0-f6109678e00e None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:11.312427 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-54e59542-1612-4c48-90d0-f6109678e00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:11.335518 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:11.393433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 917/1854] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:11.415459 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a6732-a756-4b9b-87b9-0f3244cc59e9 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:11.417209 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7b3a6732-a756-4b9b-87b9-0f3244cc59e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:11.514600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a6732-a756-4b9b-87b9-0f3244cc59e9 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:11.523563 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13b418-36e1-405d-965e-18fcce5ebbe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:11.525324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13b418-36e1-405d-965e-18fcce5ebbe1 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:11.525324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13b418-36e1-405d-965e-18fcce5ebbe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:11.525324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13b418-36e1-405d-965e-18fcce5ebbe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:11.542699 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13b418-36e1-405d-965e-18fcce5ebbe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:11.544399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13b418-36e1-405d-965e-18fcce5ebbe1 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:11.560805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e59542-1612-4c48-90d0-f6109678e00e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:11.563458 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-54e59542-1612-4c48-90d0-f6109678e00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:11.564469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 938/1855] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:02:11.587228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e59542-1612-4c48-90d0-f6109678e00e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:11.594443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c56894-0b44-4c3f-8558-29141b3b84a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:11.597112 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c56894-0b44-4c3f-8558-29141b3b84a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:11.597910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c56894-0b44-4c3f-8558-29141b3b84a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:11.598689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c56894-0b44-4c3f-8558-29141b3b84a8 admin admin] PATH_INFO: `/v3/projects/24004c48398840dcbcdb1ae5b09f8ff0` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:11.601063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c56894-0b44-4c3f-8558-29141b3b84a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24004c48398840dcbcdb1ae5b09f8ff0)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:11.603691 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c56894-0b44-4c3f-8558-29141b3b84a8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:11.693591 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-25c56894-0b44-4c3f-8558-29141b3b84a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24004c48398840dcbcdb1ae5b09f8ff0', 'request_id': 'req-25c56894-0b44-4c3f-8558-29141b3b84a8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:11.703996 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-25c56894-0b44-4c3f-8558-29141b3b84a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24004c48398840dcbcdb1ae5b09f8ff0', 'request_id': 'req-25c56894-0b44-4c3f-8558-29141b3b84a8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:11.715684 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-25c56894-0b44-4c3f-8558-29141b3b84a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24004c48398840dcbcdb1ae5b09f8ff0', 'request_id': 'req-25c56894-0b44-4c3f-8558-29141b3b84a8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:11.741059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-25c56894-0b44-4c3f-8558-29141b3b84a8 admin admin] The token cache is being invalidate because project 24004c48398840dcbcdb1ae5b09f8ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:11.741777 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-25c56894-0b44-4c3f-8558-29141b3b84a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:11.742965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-25c56894-0b44-4c3f-8558-29141b3b84a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:11.746458 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 918/1856] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:11 2022] DELETE /identity/v3/projects/24004c48398840dcbcdb1ae5b09f8ff0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:11.750637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13b418-36e1-405d-965e-18fcce5ebbe1 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:11.765644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13b418-36e1-405d-965e-18fcce5ebbe1 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:11.876700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61625349-7907-4748-8b85-78e86b52732a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:11.878667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61625349-7907-4748-8b85-78e86b52732a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:11.879728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61625349-7907-4748-8b85-78e86b52732a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:11.880172 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61625349-7907-4748-8b85-78e86b52732a admin admin] PATH_INFO: `/v3/users/c0ab4c236ec94470ba3e9a84fe3dbb51` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:11.881713 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61625349-7907-4748-8b85-78e86b52732a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ab4c236ec94470ba3e9a84fe3dbb51)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:11.884167 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61625349-7907-4748-8b85-78e86b52732a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:11.960566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-61625349-7907-4748-8b85-78e86b52732a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ab4c236ec94470ba3e9a84fe3dbb51'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:11.961649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-61625349-7907-4748-8b85-78e86b52732a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ab4c236ec94470ba3e9a84fe3dbb51'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:11.971719 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-61625349-7907-4748-8b85-78e86b52732a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ab4c236ec94470ba3e9a84fe3dbb51'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:11.984076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-61625349-7907-4748-8b85-78e86b52732a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ab4c236ec94470ba3e9a84fe3dbb51'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:11.985105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-61625349-7907-4748-8b85-78e86b52732a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ab4c236ec94470ba3e9a84fe3dbb51'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:12.012152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 939/1857] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:11 2022] DELETE /identity/v3/users/c0ab4c236ec94470ba3e9a84fe3dbb51 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:12.263237 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c56894-0b44-4c3f-8558-29141b3b84a8 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:12.264817 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-25c56894-0b44-4c3f-8558-29141b3b84a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:12.278612 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c56894-0b44-4c3f-8558-29141b3b84a8 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:12.412900 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b1c30-296e-466c-8d6a-40571e8aaf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:12.413789 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b1c30-296e-466c-8d6a-40571e8aaf53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:12.414097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b1c30-296e-466c-8d6a-40571e8aaf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:12.414368 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b1c30-296e-466c-8d6a-40571e8aaf53 admin admin] PATH_INFO: `/v3/projects/7d86d347280f44408ac4d138b1611509` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:12.415551 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b1c30-296e-466c-8d6a-40571e8aaf53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d86d347280f44408ac4d138b1611509)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:12.417612 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b1c30-296e-466c-8d6a-40571e8aaf53 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:12.508429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61625349-7907-4748-8b85-78e86b52732a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:12.509256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:12.511001 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-61625349-7907-4748-8b85-78e86b52732a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:12.514534 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-be3b1c30-296e-466c-8d6a-40571e8aaf53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d86d347280f44408ac4d138b1611509', 'request_id': 'req-be3b1c30-296e-466c-8d6a-40571e8aaf53'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:12.538950 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-be3b1c30-296e-466c-8d6a-40571e8aaf53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d86d347280f44408ac4d138b1611509', 'request_id': 'req-be3b1c30-296e-466c-8d6a-40571e8aaf53'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:12.551947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61625349-7907-4748-8b85-78e86b52732a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:12.556207 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-be3b1c30-296e-466c-8d6a-40571e8aaf53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d86d347280f44408ac4d138b1611509', 'request_id': 'req-be3b1c30-296e-466c-8d6a-40571e8aaf53'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:12.566200 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:12.579508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-be3b1c30-296e-466c-8d6a-40571e8aaf53 admin admin] The token cache is being invalidate because project 7d86d347280f44408ac4d138b1611509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:12.579773 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-be3b1c30-296e-466c-8d6a-40571e8aaf53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:12.580614 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-be3b1c30-296e-466c-8d6a-40571e8aaf53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:12.585634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 919/1858] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:12 2022] DELETE /identity/v3/projects/7d86d347280f44408ac4d138b1611509 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:12.587315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b1c30-296e-466c-8d6a-40571e8aaf53 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:12.588230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-be3b1c30-296e-466c-8d6a-40571e8aaf53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:12.626904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbdff6-71db-429b-b2b2-fba5ae802b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:12.627795 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbdff6-71db-429b-b2b2-fba5ae802b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:12.628061 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbdff6-71db-429b-b2b2-fba5ae802b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:12.628339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbdff6-71db-429b-b2b2-fba5ae802b28 admin admin] PATH_INFO: `/v3/projects/c7353ee3f4ed4e2fa7dd58940b6a009c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:12.629708 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbdff6-71db-429b-b2b2-fba5ae802b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7353ee3f4ed4e2fa7dd58940b6a009c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:12.631703 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbdff6-71db-429b-b2b2-fba5ae802b28 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:12.673531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b1c30-296e-466c-8d6a-40571e8aaf53 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:12.679329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002552f-9d63-4be5-8e08-5fb950bda241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:12.680228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002552f-9d63-4be5-8e08-5fb950bda241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:12.680511 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002552f-9d63-4be5-8e08-5fb950bda241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:12.680788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002552f-9d63-4be5-8e08-5fb950bda241 admin admin] PATH_INFO: `/v3/users/75aa00cd29334b2ca7a0087a21f0fa67` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:12.682198 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002552f-9d63-4be5-8e08-5fb950bda241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75aa00cd29334b2ca7a0087a21f0fa67)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:12.684218 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002552f-9d63-4be5-8e08-5fb950bda241 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:12.702270 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cfdbdff6-71db-429b-b2b2-fba5ae802b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7353ee3f4ed4e2fa7dd58940b6a009c', 'request_id': 'req-cfdbdff6-71db-429b-b2b2-fba5ae802b28'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:12.713992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cfdbdff6-71db-429b-b2b2-fba5ae802b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7353ee3f4ed4e2fa7dd58940b6a009c', 'request_id': 'req-cfdbdff6-71db-429b-b2b2-fba5ae802b28'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:12.721675 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cfdbdff6-71db-429b-b2b2-fba5ae802b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7353ee3f4ed4e2fa7dd58940b6a009c', 'request_id': 'req-cfdbdff6-71db-429b-b2b2-fba5ae802b28'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:12.734411 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cfdbdff6-71db-429b-b2b2-fba5ae802b28 admin admin] The token cache is being invalidate because project c7353ee3f4ed4e2fa7dd58940b6a009c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:12.734681 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cfdbdff6-71db-429b-b2b2-fba5ae802b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:12.735718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cfdbdff6-71db-429b-b2b2-fba5ae802b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:12.738262 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 940/1859] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:12 2022] DELETE /identity/v3/projects/c7353ee3f4ed4e2fa7dd58940b6a009c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:02:12.744350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54df79-ba75-4238-8bf3-593e9fdf79ab None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:12.744722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54df79-ba75-4238-8bf3-593e9fdf79ab None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:12.745057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54df79-ba75-4238-8bf3-593e9fdf79ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:12.752067 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c002552f-9d63-4be5-8e08-5fb950bda241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75aa00cd29334b2ca7a0087a21f0fa67'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:12.753487 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c002552f-9d63-4be5-8e08-5fb950bda241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75aa00cd29334b2ca7a0087a21f0fa67'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:12.763148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c002552f-9d63-4be5-8e08-5fb950bda241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75aa00cd29334b2ca7a0087a21f0fa67'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:12.768990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5a54df79-ba75-4238-8bf3-593e9fdf79ab None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:12.770774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5a54df79-ba75-4238-8bf3-593e9fdf79ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:12.778981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c002552f-9d63-4be5-8e08-5fb950bda241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75aa00cd29334b2ca7a0087a21f0fa67'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:12.779895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c002552f-9d63-4be5-8e08-5fb950bda241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75aa00cd29334b2ca7a0087a21f0fa67'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:12.805527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 920/1860] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:12 2022] DELETE /identity/v3/users/75aa00cd29334b2ca7a0087a21f0fa67 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:12.876033 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 941/1861] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:02:12.891225 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f83b0f-5495-47bc-9ef9-48ce3fe1f6e3 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:12.891540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f83b0f-5495-47bc-9ef9-48ce3fe1f6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:12.891858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f83b0f-5495-47bc-9ef9-48ce3fe1f6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:12.919904 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-31f83b0f-5495-47bc-9ef9-48ce3fe1f6e3 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:12.921306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-31f83b0f-5495-47bc-9ef9-48ce3fe1f6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:13.011644 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:13.032404 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 921/1862] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:13.037911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54df79-ba75-4238-8bf3-593e9fdf79ab None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:13.048397 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54df79-ba75-4238-8bf3-593e9fdf79ab None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:13.063312 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a960467-2b2e-4cb7-a713-85be11da8666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:13.064091 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a960467-2b2e-4cb7-a713-85be11da8666 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:13.064378 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a960467-2b2e-4cb7-a713-85be11da8666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:13.064711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a960467-2b2e-4cb7-a713-85be11da8666 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:13.065466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a960467-2b2e-4cb7-a713-85be11da8666 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:13.065779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a960467-2b2e-4cb7-a713-85be11da8666 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:13.067750 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a960467-2b2e-4cb7-a713-85be11da8666 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:13.126600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 942/1863] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:13.126837 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f83b0f-5495-47bc-9ef9-48ce3fe1f6e3 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:13.153279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f83b0f-5495-47bc-9ef9-48ce3fe1f6e3 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:13.166589 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a6dbd-f777-46fb-af34-cf01cad8c7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:13.166589 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a6dbd-f777-46fb-af34-cf01cad8c7df admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:13.166589 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a6dbd-f777-46fb-af34-cf01cad8c7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:13.167014 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a6dbd-f777-46fb-af34-cf01cad8c7df admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:13.167681 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a6dbd-f777-46fb-af34-cf01cad8c7df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:13.171792 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a6dbd-f777-46fb-af34-cf01cad8c7df admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:13.226685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a960467-2b2e-4cb7-a713-85be11da8666 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:13.227592 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 922/1864] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:13 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:13.246749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a960467-2b2e-4cb7-a713-85be11da8666 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:13.320096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:13.399164 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203013d3-039f-43dd-b28d-c446f8327863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:13.401635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203013d3-039f-43dd-b28d-c446f8327863 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:13.402322 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203013d3-039f-43dd-b28d-c446f8327863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:13.402708 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203013d3-039f-43dd-b28d-c446f8327863 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:13.403632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203013d3-039f-43dd-b28d-c446f8327863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:13.407014 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203013d3-039f-43dd-b28d-c446f8327863 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:13.435850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a6dbd-f777-46fb-af34-cf01cad8c7df admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:13.444026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-318a6dbd-f777-46fb-af34-cf01cad8c7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:13.450908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 943/1865] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:13 2022] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:02:13.456186 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203013d3-039f-43dd-b28d-c446f8327863 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:13.487041 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203013d3-039f-43dd-b28d-c446f8327863 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:13.502758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177922d-a6ee-432f-95a9-f2e2a498abb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:13.503458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177922d-a6ee-432f-95a9-f2e2a498abb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:13.503803 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177922d-a6ee-432f-95a9-f2e2a498abb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:13.504006 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177922d-a6ee-432f-95a9-f2e2a498abb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:13.504780 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177922d-a6ee-432f-95a9-f2e2a498abb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:13.506863 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177922d-a6ee-432f-95a9-f2e2a498abb7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:13.514941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a6dbd-f777-46fb-af34-cf01cad8c7df admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:13.523940 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 944/1866] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:02:13.531380 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177922d-a6ee-432f-95a9-f2e2a498abb7 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:13.557680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee38d70-15c2-4a25-871a-08a266888fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:13.563940 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee38d70-15c2-4a25-871a-08a266888fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:13.566737 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee38d70-15c2-4a25-871a-08a266888fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:13.568193 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee38d70-15c2-4a25-871a-08a266888fb9 admin admin] PATH_INFO: `/v3/projects/f16de971db504253a02dc507c3f5ecec` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:13.569324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177922d-a6ee-432f-95a9-f2e2a498abb7 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:13.574165 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee38d70-15c2-4a25-871a-08a266888fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16de971db504253a02dc507c3f5ecec)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:13.578098 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec902476-d5ba-4d8b-9ad9-09de09d3cdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:13.579838 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec902476-d5ba-4d8b-9ad9-09de09d3cdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:13.580143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec902476-d5ba-4d8b-9ad9-09de09d3cdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:13.580434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec902476-d5ba-4d8b-9ad9-09de09d3cdc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:13.581183 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec902476-d5ba-4d8b-9ad9-09de09d3cdc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:13.584196 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee38d70-15c2-4a25-871a-08a266888fb9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:13.584908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec902476-d5ba-4d8b-9ad9-09de09d3cdc7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:13.607649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 945/1867] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:13.608936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec902476-d5ba-4d8b-9ad9-09de09d3cdc7 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:13.622859 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec902476-d5ba-4d8b-9ad9-09de09d3cdc7 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:13.629528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e6e01-c8f3-401a-855e-0adf8a1e2704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:13.630905 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e6e01-c8f3-401a-855e-0adf8a1e2704 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:13.630905 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e6e01-c8f3-401a-855e-0adf8a1e2704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:13.631193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e6e01-c8f3-401a-855e-0adf8a1e2704 admin admin] PATH_INFO: `/v3/projects/4947db58a455423299c6428113a8aeef/users/d457f1eccb1f4177a5fdc8bc62f8f568/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:13.655205 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e6e01-c8f3-401a-855e-0adf8a1e2704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4947db58a455423299c6428113a8aeef, user_id=d457f1eccb1f4177a5fdc8bc62f8f568, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:13.659463 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e6e01-c8f3-401a-855e-0adf8a1e2704 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:13.689436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 946/1868] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:13 2022] PUT /identity/v3/projects/4947db58a455423299c6428113a8aeef/users/d457f1eccb1f4177a5fdc8bc62f8f568/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:13.712419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ce9ef-dc9c-4a07-ab63-7ccc23106ebf None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:13.716920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ce9ef-dc9c-4a07-ab63-7ccc23106ebf None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:13.719759 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ce9ef-dc9c-4a07-ab63-7ccc23106ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:13.725204 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1ee38d70-15c2-4a25-871a-08a266888fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16de971db504253a02dc507c3f5ecec', 'request_id': 'req-1ee38d70-15c2-4a25-871a-08a266888fb9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:13.753214 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1ee38d70-15c2-4a25-871a-08a266888fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16de971db504253a02dc507c3f5ecec', 'request_id': 'req-1ee38d70-15c2-4a25-871a-08a266888fb9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:13.764385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-143ce9ef-dc9c-4a07-ab63-7ccc23106ebf None None] MFA Rules not processed for user `d457f1eccb1f4177a5fdc8bc62f8f568`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:13.766274 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1ee38d70-15c2-4a25-871a-08a266888fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16de971db504253a02dc507c3f5ecec', 'request_id': 'req-1ee38d70-15c2-4a25-871a-08a266888fb9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:13.766401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-143ce9ef-dc9c-4a07-ab63-7ccc23106ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:13.789871 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1ee38d70-15c2-4a25-871a-08a266888fb9 admin admin] The token cache is being invalidate because project f16de971db504253a02dc507c3f5ecec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:13.790171 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1ee38d70-15c2-4a25-871a-08a266888fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:13.790886 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1ee38d70-15c2-4a25-871a-08a266888fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:13.793855 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 923/1869] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:13 2022] DELETE /identity/v3/projects/f16de971db504253a02dc507c3f5ecec => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:13.801514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee38d70-15c2-4a25-871a-08a266888fb9 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:13.809443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1ee38d70-15c2-4a25-871a-08a266888fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:13.885675 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 947/1870] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:02:13.891287 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ce9ef-dc9c-4a07-ab63-7ccc23106ebf None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:13.893253 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-143ce9ef-dc9c-4a07-ab63-7ccc23106ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:13.935579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee38d70-15c2-4a25-871a-08a266888fb9 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:13.946441 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c30c36-5e44-468d-936b-ad3b4896f324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:13.947841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c30c36-5e44-468d-936b-ad3b4896f324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:13.948440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c30c36-5e44-468d-936b-ad3b4896f324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:13.948912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c30c36-5e44-468d-936b-ad3b4896f324 admin admin] PATH_INFO: `/v3/users/167cda337fc64361a192285f0ed73860` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:13.950784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c30c36-5e44-468d-936b-ad3b4896f324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=167cda337fc64361a192285f0ed73860)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:13.954740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c30c36-5e44-468d-936b-ad3b4896f324 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:14.051777 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b8c30c36-5e44-468d-936b-ad3b4896f324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '167cda337fc64361a192285f0ed73860'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:14.052584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b8c30c36-5e44-468d-936b-ad3b4896f324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '167cda337fc64361a192285f0ed73860'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:14.063020 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b8c30c36-5e44-468d-936b-ad3b4896f324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '167cda337fc64361a192285f0ed73860'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:14.065448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:14.067175 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ce9ef-dc9c-4a07-ab63-7ccc23106ebf None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:14.084660 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba58a3-c436-45cc-bff6-0c23212f13fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:14.085318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba58a3-c436-45cc-bff6-0c23212f13fa admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:14.085769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba58a3-c436-45cc-bff6-0c23212f13fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:14.086204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba58a3-c436-45cc-bff6-0c23212f13fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:14.086942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba58a3-c436-45cc-bff6-0c23212f13fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:14.093190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba58a3-c436-45cc-bff6-0c23212f13fa admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:14.094488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b8c30c36-5e44-468d-936b-ad3b4896f324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '167cda337fc64361a192285f0ed73860'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:14.095458 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b8c30c36-5e44-468d-936b-ad3b4896f324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '167cda337fc64361a192285f0ed73860'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:14.116299 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 924/1871] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:13 2022] DELETE /identity/v3/users/167cda337fc64361a192285f0ed73860 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:14.122163 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:14.164715 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 948/1872] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:13 2022] POST /identity/v3/projects => generated 381 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:14.169759 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c30c36-5e44-468d-936b-ad3b4896f324 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:14.175466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b8c30c36-5e44-468d-936b-ad3b4896f324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:14.344696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c30c36-5e44-468d-936b-ad3b4896f324 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:14.551040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f88af3-4c82-41bf-aa44-bcd06ec78a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:14.553509 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f88af3-4c82-41bf-aa44-bcd06ec78a2b admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:14.553763 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f88af3-4c82-41bf-aa44-bcd06ec78a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:14.554190 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f88af3-4c82-41bf-aa44-bcd06ec78a2b admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:14.555618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f88af3-4c82-41bf-aa44-bcd06ec78a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:14.558504 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f88af3-4c82-41bf-aa44-bcd06ec78a2b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:14.594831 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 925/1873] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:14 2022] POST /identity/v3/users => generated 297 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:14.597778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba58a3-c436-45cc-bff6-0c23212f13fa admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:14.626572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba58a3-c436-45cc-bff6-0c23212f13fa admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:14.637050 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef1ac0-60df-4916-8044-0787f7b84e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:14.638567 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef1ac0-60df-4916-8044-0787f7b84e6b admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:14.638724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef1ac0-60df-4916-8044-0787f7b84e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:14.639434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef1ac0-60df-4916-8044-0787f7b84e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:14.640774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef1ac0-60df-4916-8044-0787f7b84e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:14.642039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef1ac0-60df-4916-8044-0787f7b84e6b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:14.671359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 949/1874] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:14.673934 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f88af3-4c82-41bf-aa44-bcd06ec78a2b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:14.690725 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f88af3-4c82-41bf-aa44-bcd06ec78a2b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:14.699760 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dc167-77cd-4fb8-840f-a806063ca6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:14.701242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dc167-77cd-4fb8-840f-a806063ca6b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:14.701640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dc167-77cd-4fb8-840f-a806063ca6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:14.702146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dc167-77cd-4fb8-840f-a806063ca6b6 admin admin] PATH_INFO: `/v3/projects/5ee4e438d09e4b99b0c5ce1c60eddeb0/users/e6b60b51e6e44caeb61f71c7eeef2455/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:14.735022 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17dc167-77cd-4fb8-840f-a806063ca6b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee4e438d09e4b99b0c5ce1c60eddeb0, user_id=e6b60b51e6e44caeb61f71c7eeef2455, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:14.742935 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17dc167-77cd-4fb8-840f-a806063ca6b6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:14.784435 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 926/1875] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:14 2022] PUT /identity/v3/projects/5ee4e438d09e4b99b0c5ce1c60eddeb0/users/e6b60b51e6e44caeb61f71c7eeef2455/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:14.786936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef1ac0-60df-4916-8044-0787f7b84e6b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:14.798994 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dc167-77cd-4fb8-840f-a806063ca6b6 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:14.805447 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e17dc167-77cd-4fb8-840f-a806063ca6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:14.809911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef1ac0-60df-4916-8044-0787f7b84e6b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:14.936234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:14.938209 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a58dc8-b191-4f93-9aa6-b8c2e7acf7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:14.939323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a58dc8-b191-4f93-9aa6-b8c2e7acf7dc admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:14.939486 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a58dc8-b191-4f93-9aa6-b8c2e7acf7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:14.939972 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a58dc8-b191-4f93-9aa6-b8c2e7acf7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:14.940991 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a58dc8-b191-4f93-9aa6-b8c2e7acf7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:14.946607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a58dc8-b191-4f93-9aa6-b8c2e7acf7dc admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:14.973394 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 950/1876] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:14.983996 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dc167-77cd-4fb8-840f-a806063ca6b6 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:14.985255 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a58dc8-b191-4f93-9aa6-b8c2e7acf7dc admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:15.006418 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc40e2-2846-48ca-90a0-0f3d4e4d48c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:15.007531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a58dc8-b191-4f93-9aa6-b8c2e7acf7dc admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:15.010601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc40e2-2846-48ca-90a0-0f3d4e4d48c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.013137 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15833be-12f1-463d-8ee0-f0778742d47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:15.013654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc40e2-2846-48ca-90a0-0f3d4e4d48c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.014107 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15833be-12f1-463d-8ee0-f0778742d47b admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.014320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc40e2-2846-48ca-90a0-0f3d4e4d48c3 admin admin] PATH_INFO: `/v3/projects/7c12c49b71bc4601a69746d3cf750b38` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.014658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15833be-12f1-463d-8ee0-f0778742d47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.014937 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15833be-12f1-463d-8ee0-f0778742d47b admin admin] PATH_INFO: `/v3/projects/5ee4e438d09e4b99b0c5ce1c60eddeb0/users/e6b60b51e6e44caeb61f71c7eeef2455/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.017841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15833be-12f1-463d-8ee0-f0778742d47b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee4e438d09e4b99b0c5ce1c60eddeb0, user_id=e6b60b51e6e44caeb61f71c7eeef2455, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:15.020279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc40e2-2846-48ca-90a0-0f3d4e4d48c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c12c49b71bc4601a69746d3cf750b38)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:15.021626 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15833be-12f1-463d-8ee0-f0778742d47b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:15.022313 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc40e2-2846-48ca-90a0-0f3d4e4d48c3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:15.041937 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 951/1877] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:14 2022] PUT /identity/v3/projects/5ee4e438d09e4b99b0c5ce1c60eddeb0/users/e6b60b51e6e44caeb61f71c7eeef2455/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:15.052653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1eff7c-a074-484d-891d-eb0b8a5d9608 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.052991 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1eff7c-a074-484d-891d-eb0b8a5d9608 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.053311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1eff7c-a074-484d-891d-eb0b8a5d9608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.127063 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4a1eff7c-a074-484d-891d-eb0b8a5d9608 None None] MFA Rules not processed for user `e6b60b51e6e44caeb61f71c7eeef2455`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:15.130308 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4a1eff7c-a074-484d-891d-eb0b8a5d9608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:15.182734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-65dc40e2-2846-48ca-90a0-0f3d4e4d48c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c12c49b71bc4601a69746d3cf750b38', 'request_id': 'req-65dc40e2-2846-48ca-90a0-0f3d4e4d48c3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:15.192956 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-65dc40e2-2846-48ca-90a0-0f3d4e4d48c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c12c49b71bc4601a69746d3cf750b38', 'request_id': 'req-65dc40e2-2846-48ca-90a0-0f3d4e4d48c3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:15.215104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-65dc40e2-2846-48ca-90a0-0f3d4e4d48c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c12c49b71bc4601a69746d3cf750b38', 'request_id': 'req-65dc40e2-2846-48ca-90a0-0f3d4e4d48c3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:15.270460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-65dc40e2-2846-48ca-90a0-0f3d4e4d48c3 admin admin] The token cache is being invalidate because project 7c12c49b71bc4601a69746d3cf750b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:15.270753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-65dc40e2-2846-48ca-90a0-0f3d4e4d48c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:15.274338 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-65dc40e2-2846-48ca-90a0-0f3d4e4d48c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:15.279136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 927/1878] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:14 2022] DELETE /identity/v3/projects/7c12c49b71bc4601a69746d3cf750b38 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:15.286327 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a37950-43b2-4370-9998-bee5870f8a62 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.287139 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a37950-43b2-4370-9998-bee5870f8a62 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.287670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a37950-43b2-4370-9998-bee5870f8a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.313627 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 952/1879] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:15.326984 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1eff7c-a074-484d-891d-eb0b8a5d9608 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:15.329266 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4a1eff7c-a074-484d-891d-eb0b8a5d9608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:15.333609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-c5a37950-43b2-4370-9998-bee5870f8a62 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:15.335177 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c5a37950-43b2-4370-9998-bee5870f8a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:15.416531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 928/1880] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:15.421945 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:15.427111 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1eff7c-a074-484d-891d-eb0b8a5d9608 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:15.430506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efa92d-236d-4758-b9d1-2744ace84cf2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.431316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efa92d-236d-4758-b9d1-2744ace84cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.431429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efa92d-236d-4758-b9d1-2744ace84cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.434609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b299a3-3e1d-4834-a367-e65347ca9b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:15.435637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b299a3-3e1d-4834-a367-e65347ca9b1e service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.436123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b299a3-3e1d-4834-a367-e65347ca9b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.436593 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b299a3-3e1d-4834-a367-e65347ca9b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.451795 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b299a3-3e1d-4834-a367-e65347ca9b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:15.454237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b299a3-3e1d-4834-a367-e65347ca9b1e service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:15.459294 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-84efa92d-236d-4758-b9d1-2744ace84cf2 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:15.461294 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-84efa92d-236d-4758-b9d1-2744ace84cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:15.473685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 929/1881] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:15.477410 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 953/1882] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:02:15.479489 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efa92d-236d-4758-b9d1-2744ace84cf2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:15.493090 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efa92d-236d-4758-b9d1-2744ace84cf2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:15.499494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfea48-22b9-4068-bd00-6de81eccdc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:15.500335 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfea48-22b9-4068-bd00-6de81eccdc31 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.500714 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfea48-22b9-4068-bd00-6de81eccdc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.501093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfea48-22b9-4068-bd00-6de81eccdc31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.501954 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dfea48-22b9-4068-bd00-6de81eccdc31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:15.502338 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dfea48-22b9-4068-bd00-6de81eccdc31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:15.504584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dfea48-22b9-4068-bd00-6de81eccdc31 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:15.524839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 930/1883] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:15.532360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b299a3-3e1d-4834-a367-e65347ca9b1e service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:15.557000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b299a3-3e1d-4834-a367-e65347ca9b1e service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:15.565316 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867f211-6ac6-41c5-a72a-3c8bb8179600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:15.569934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867f211-6ac6-41c5-a72a-3c8bb8179600 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.569934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867f211-6ac6-41c5-a72a-3c8bb8179600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.569934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867f211-6ac6-41c5-a72a-3c8bb8179600 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.569934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867f211-6ac6-41c5-a72a-3c8bb8179600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:15.572595 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867f211-6ac6-41c5-a72a-3c8bb8179600 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:15.617834 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 954/1884] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:15 2022] POST /identity/v3/projects => generated 367 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:02:15.620139 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfea48-22b9-4068-bd00-6de81eccdc31 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:15.632712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfea48-22b9-4068-bd00-6de81eccdc31 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:15.721861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867f211-6ac6-41c5-a72a-3c8bb8179600 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:15.723609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a60d3a-2c8f-4060-9317-96c474683ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:15.724329 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e867f211-6ac6-41c5-a72a-3c8bb8179600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:15.724463 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a60d3a-2c8f-4060-9317-96c474683ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.724783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a60d3a-2c8f-4060-9317-96c474683ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.725117 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a60d3a-2c8f-4060-9317-96c474683ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.726066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a60d3a-2c8f-4060-9317-96c474683ea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:15.729102 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a60d3a-2c8f-4060-9317-96c474683ea9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:15.737766 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:15.747161 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867f211-6ac6-41c5-a72a-3c8bb8179600 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:15.756282 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f926e15-fbd8-44c0-a9b2-03f1098888f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:15.757618 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f926e15-fbd8-44c0-a9b2-03f1098888f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.758087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f926e15-fbd8-44c0-a9b2-03f1098888f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.758552 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f926e15-fbd8-44c0-a9b2-03f1098888f4 admin admin] PATH_INFO: `/v3/users/a16bd7264a4545868bf145cc9dc729c8` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.764118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 931/1885] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:15 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:02:15.766028 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f926e15-fbd8-44c0-a9b2-03f1098888f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a16bd7264a4545868bf145cc9dc729c8)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:15.766535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a60d3a-2c8f-4060-9317-96c474683ea9 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:15.769576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f926e15-fbd8-44c0-a9b2-03f1098888f4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:15.780650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a60d3a-2c8f-4060-9317-96c474683ea9 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:15.786528 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dafdc2-ce6d-4a36-89cc-6774bed3fd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:15.787368 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dafdc2-ce6d-4a36-89cc-6774bed3fd0c admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.788169 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dafdc2-ce6d-4a36-89cc-6774bed3fd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.788169 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dafdc2-ce6d-4a36-89cc-6774bed3fd0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.789074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dafdc2-ce6d-4a36-89cc-6774bed3fd0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:15.791109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dafdc2-ce6d-4a36-89cc-6774bed3fd0c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:15.809558 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 932/1886] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:15.815722 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dafdc2-ce6d-4a36-89cc-6774bed3fd0c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:15.830850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dafdc2-ce6d-4a36-89cc-6774bed3fd0c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:15.839045 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04eba47-2d97-4ff0-8862-747e9e80dd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:15.840104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04eba47-2d97-4ff0-8862-747e9e80dd08 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.840728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04eba47-2d97-4ff0-8862-747e9e80dd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.841074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04eba47-2d97-4ff0-8862-747e9e80dd08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.842126 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04eba47-2d97-4ff0-8862-747e9e80dd08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:15.845016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04eba47-2d97-4ff0-8862-747e9e80dd08 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:15.869640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 933/1887] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:02:15.878304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04eba47-2d97-4ff0-8862-747e9e80dd08 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:15.879636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8f926e15-fbd8-44c0-a9b2-03f1098888f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a16bd7264a4545868bf145cc9dc729c8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:15.882718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8f926e15-fbd8-44c0-a9b2-03f1098888f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a16bd7264a4545868bf145cc9dc729c8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:15.894965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04eba47-2d97-4ff0-8862-747e9e80dd08 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:15.909325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec908f7-f40e-4c5f-b1f9-e174fd4cd8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:15.911117 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8f926e15-fbd8-44c0-a9b2-03f1098888f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a16bd7264a4545868bf145cc9dc729c8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:15.912443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec908f7-f40e-4c5f-b1f9-e174fd4cd8fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:15.912831 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec908f7-f40e-4c5f-b1f9-e174fd4cd8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:15.913574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec908f7-f40e-4c5f-b1f9-e174fd4cd8fc admin admin] PATH_INFO: `/v3/projects/b902341f1ffe42dc9904c60dcae231f1/users/4f525fc8753a4a4f835aa7c0b2637300/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:15.933196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8f926e15-fbd8-44c0-a9b2-03f1098888f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a16bd7264a4545868bf145cc9dc729c8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:15.934818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8f926e15-fbd8-44c0-a9b2-03f1098888f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a16bd7264a4545868bf145cc9dc729c8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:15.966943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec908f7-f40e-4c5f-b1f9-e174fd4cd8fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b902341f1ffe42dc9904c60dcae231f1, user_id=4f525fc8753a4a4f835aa7c0b2637300, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:15.971824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec908f7-f40e-4c5f-b1f9-e174fd4cd8fc admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:15.997835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 955/1888] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:15 2022] DELETE /identity/v3/users/a16bd7264a4545868bf145cc9dc729c8 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:15.999298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 934/1889] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:15 2022] PUT /identity/v3/projects/b902341f1ffe42dc9904c60dcae231f1/users/4f525fc8753a4a4f835aa7c0b2637300/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:02:16.027571 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb6b8-4807-4f54-9117-23d4dd9891a1 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.028281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53e3ab-1d5b-4585-856c-6a8ba4ebf04b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.028765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53e3ab-1d5b-4585-856c-6a8ba4ebf04b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.029160 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53e3ab-1d5b-4585-856c-6a8ba4ebf04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.030149 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb6b8-4807-4f54-9117-23d4dd9891a1 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.030690 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb6b8-4807-4f54-9117-23d4dd9891a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.065822 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-779eb6b8-4807-4f54-9117-23d4dd9891a1 None None] MFA Rules not processed for user `4f525fc8753a4a4f835aa7c0b2637300`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:16.067652 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-779eb6b8-4807-4f54-9117-23d4dd9891a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:16.091293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-7d53e3ab-1d5b-4585-856c-6a8ba4ebf04b None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:16.092529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7d53e3ab-1d5b-4585-856c-6a8ba4ebf04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:16.171874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 935/1890] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:16.178155 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eb6b8-4807-4f54-9117-23d4dd9891a1 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:16.179700 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-779eb6b8-4807-4f54-9117-23d4dd9891a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:16.218183 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 956/1891] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:16.234632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53e3ab-1d5b-4585-856c-6a8ba4ebf04b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:16.236886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7d53e3ab-1d5b-4585-856c-6a8ba4ebf04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:16.297104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eb6b8-4807-4f54-9117-23d4dd9891a1 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:16.304689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039b6db-a96d-4c12-b641-c73ed0b58d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:16.305957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039b6db-a96d-4c12-b641-c73ed0b58d35 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.306428 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039b6db-a96d-4c12-b641-c73ed0b58d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.307048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039b6db-a96d-4c12-b641-c73ed0b58d35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.308133 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039b6db-a96d-4c12-b641-c73ed0b58d35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:16.310520 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039b6db-a96d-4c12-b641-c73ed0b58d35 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:16.313436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:16.328562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53e3ab-1d5b-4585-856c-6a8ba4ebf04b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:16.334048 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f415e9c-edc9-40fc-9a94-49a5bc49b2e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:16.334783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f415e9c-edc9-40fc-9a94-49a5bc49b2e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.335267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f415e9c-edc9-40fc-9a94-49a5bc49b2e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.335730 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f415e9c-edc9-40fc-9a94-49a5bc49b2e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.356616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f415e9c-edc9-40fc-9a94-49a5bc49b2e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:16.358509 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f415e9c-edc9-40fc-9a94-49a5bc49b2e3 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:16.365841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 936/1892] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:16 2022] POST /identity/v3/projects => generated 365 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:02:16.369830 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039b6db-a96d-4c12-b641-c73ed0b58d35 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:16.376566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 957/1893] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:02:16.403870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:16.473522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f415e9c-edc9-40fc-9a94-49a5bc49b2e3 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:16.476516 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1f415e9c-edc9-40fc-9a94-49a5bc49b2e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:16.480113 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039b6db-a96d-4c12-b641-c73ed0b58d35 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:16.488064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78741036-7679-4c5a-a581-ee6a70dce85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:16.489353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78741036-7679-4c5a-a581-ee6a70dce85a admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.489830 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78741036-7679-4c5a-a581-ee6a70dce85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.491136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78741036-7679-4c5a-a581-ee6a70dce85a admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.492409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78741036-7679-4c5a-a581-ee6a70dce85a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:16.496585 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78741036-7679-4c5a-a581-ee6a70dce85a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:16.496958 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f415e9c-edc9-40fc-9a94-49a5bc49b2e3 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:16.503392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d7c30-7a0d-4ed9-9976-6c48c67f2015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:16.504442 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d7c30-7a0d-4ed9-9976-6c48c67f2015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.504924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d7c30-7a0d-4ed9-9976-6c48c67f2015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.505274 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d7c30-7a0d-4ed9-9976-6c48c67f2015 admin admin] PATH_INFO: `/v3/users/d457f1eccb1f4177a5fdc8bc62f8f568` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.508621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d7c30-7a0d-4ed9-9976-6c48c67f2015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d457f1eccb1f4177a5fdc8bc62f8f568)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:16.512310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d7c30-7a0d-4ed9-9976-6c48c67f2015 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:16.529598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 937/1894] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:16 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:16.532024 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78741036-7679-4c5a-a581-ee6a70dce85a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:16.553282 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78741036-7679-4c5a-a581-ee6a70dce85a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:16.562489 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41a189-b613-4c2a-b9d8-d7c2186a9021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:16.563345 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41a189-b613-4c2a-b9d8-d7c2186a9021 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.563646 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41a189-b613-4c2a-b9d8-d7c2186a9021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.563908 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41a189-b613-4c2a-b9d8-d7c2186a9021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.566053 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41a189-b613-4c2a-b9d8-d7c2186a9021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:16.567775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41a189-b613-4c2a-b9d8-d7c2186a9021 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:16.589666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 938/1895] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:16.593458 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41a189-b613-4c2a-b9d8-d7c2186a9021 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:16.604498 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41a189-b613-4c2a-b9d8-d7c2186a9021 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:16.605581 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-029d7c30-7a0d-4ed9-9976-6c48c67f2015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd457f1eccb1f4177a5fdc8bc62f8f568'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:16.606064 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-029d7c30-7a0d-4ed9-9976-6c48c67f2015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd457f1eccb1f4177a5fdc8bc62f8f568'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:16.609519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701a596-95d2-4c91-a582-f684921ba1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:16.610679 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a596-95d2-4c91-a582-f684921ba1af admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.610868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a596-95d2-4c91-a582-f684921ba1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.611660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a596-95d2-4c91-a582-f684921ba1af admin admin] PATH_INFO: `/v3/projects/8078d77c735c4a61b5f0d1e49b27cb48/users/dbee715ec86945e688d1b3c381a91b82/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.620098 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-029d7c30-7a0d-4ed9-9976-6c48c67f2015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd457f1eccb1f4177a5fdc8bc62f8f568'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:16.630343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701a596-95d2-4c91-a582-f684921ba1af admin admin] RBAC: Authorizing `identity:create_grant(project_id=8078d77c735c4a61b5f0d1e49b27cb48, user_id=dbee715ec86945e688d1b3c381a91b82, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:16.633615 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701a596-95d2-4c91-a582-f684921ba1af admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:16.638585 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-029d7c30-7a0d-4ed9-9976-6c48c67f2015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd457f1eccb1f4177a5fdc8bc62f8f568'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:16.639659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-029d7c30-7a0d-4ed9-9976-6c48c67f2015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd457f1eccb1f4177a5fdc8bc62f8f568'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:16.653953 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 939/1896] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:16 2022] PUT /identity/v3/projects/8078d77c735c4a61b5f0d1e49b27cb48/users/dbee715ec86945e688d1b3c381a91b82/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:02:16.659767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701a596-95d2-4c91-a582-f684921ba1af admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:16.662108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0701a596-95d2-4c91-a582-f684921ba1af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:16.666167 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 958/1897] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:16 2022] DELETE /identity/v3/users/d457f1eccb1f4177a5fdc8bc62f8f568 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:16.671383 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32654a-9b04-40a5-ac20-b247ee716b94 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.672290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32654a-9b04-40a5-ac20-b247ee716b94 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.672704 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32654a-9b04-40a5-ac20-b247ee716b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.697434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ea32654a-9b04-40a5-ac20-b247ee716b94 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:16.699521 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ea32654a-9b04-40a5-ac20-b247ee716b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:16.759639 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701a596-95d2-4c91-a582-f684921ba1af admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:16.793437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 959/1898] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:16.803917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32654a-9b04-40a5-ac20-b247ee716b94 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:16.805084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ea32654a-9b04-40a5-ac20-b247ee716b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:16.839905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2732f-2a3e-468a-8ac7-4c1a7eec6324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:16.842057 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2732f-2a3e-468a-8ac7-4c1a7eec6324 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.842632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2732f-2a3e-468a-8ac7-4c1a7eec6324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.843745 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2732f-2a3e-468a-8ac7-4c1a7eec6324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.847361 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2732f-2a3e-468a-8ac7-4c1a7eec6324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:16.850640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2732f-2a3e-468a-8ac7-4c1a7eec6324 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:16.882395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 940/1899] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:16.883552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2732f-2a3e-468a-8ac7-4c1a7eec6324 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:16.886846 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-37e2732f-2a3e-468a-8ac7-4c1a7eec6324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:16.890560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32654a-9b04-40a5-ac20-b247ee716b94 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:16.896399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28439aa-c196-4082-bb3c-07a9830833b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:16.897678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28439aa-c196-4082-bb3c-07a9830833b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.898029 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28439aa-c196-4082-bb3c-07a9830833b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.898308 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28439aa-c196-4082-bb3c-07a9830833b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.901283 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2732f-2a3e-468a-8ac7-4c1a7eec6324 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:16.906932 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321be0a6-725e-45a5-be39-89b1860ce9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:16.908075 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321be0a6-725e-45a5-be39-89b1860ce9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.908522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321be0a6-725e-45a5-be39-89b1860ce9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.908778 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321be0a6-725e-45a5-be39-89b1860ce9be admin admin] PATH_INFO: `/v3/users/b7b99a0ab9b941739415e5af20f71075` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.911260 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321be0a6-725e-45a5-be39-89b1860ce9be admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b99a0ab9b941739415e5af20f71075)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:16.911549 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28439aa-c196-4082-bb3c-07a9830833b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:16.913579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28439aa-c196-4082-bb3c-07a9830833b9 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:16.913928 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321be0a6-725e-45a5-be39-89b1860ce9be admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:16.921528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:16.927646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 960/1900] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:16.928586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28439aa-c196-4082-bb3c-07a9830833b9 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:16.929069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:16.930983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b28439aa-c196-4082-bb3c-07a9830833b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:16.947736 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28439aa-c196-4082-bb3c-07a9830833b9 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:16.956285 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ca0d6-1eb0-452b-a3dd-4027e874fdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:16.957371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ca0d6-1eb0-452b-a3dd-4027e874fdb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:16.957699 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ca0d6-1eb0-452b-a3dd-4027e874fdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:16.958056 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ca0d6-1eb0-452b-a3dd-4027e874fdb9 admin admin] PATH_INFO: `/v3/projects/96c76385e43a497ca267c3bc799ae35c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:16.959425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ca0d6-1eb0-452b-a3dd-4027e874fdb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c76385e43a497ca267c3bc799ae35c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:16.961567 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ca0d6-1eb0-452b-a3dd-4027e874fdb9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:16.991195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-321be0a6-725e-45a5-be39-89b1860ce9be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b99a0ab9b941739415e5af20f71075'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:16.992184 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-321be0a6-725e-45a5-be39-89b1860ce9be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b99a0ab9b941739415e5af20f71075'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.001812 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-321be0a6-725e-45a5-be39-89b1860ce9be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b99a0ab9b941739415e5af20f71075'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.018021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-321be0a6-725e-45a5-be39-89b1860ce9be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b99a0ab9b941739415e5af20f71075'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.018812 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-321be0a6-725e-45a5-be39-89b1860ce9be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b99a0ab9b941739415e5af20f71075'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.030200 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-967ca0d6-1eb0-452b-a3dd-4027e874fdb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c76385e43a497ca267c3bc799ae35c', 'request_id': 'req-967ca0d6-1eb0-452b-a3dd-4027e874fdb9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.036834 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 941/1901] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:16 2022] DELETE /identity/v3/users/b7b99a0ab9b941739415e5af20f71075 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:17.037665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321be0a6-725e-45a5-be39-89b1860ce9be admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:17.041297 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-321be0a6-725e-45a5-be39-89b1860ce9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:17.044393 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-967ca0d6-1eb0-452b-a3dd-4027e874fdb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c76385e43a497ca267c3bc799ae35c', 'request_id': 'req-967ca0d6-1eb0-452b-a3dd-4027e874fdb9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.054665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-967ca0d6-1eb0-452b-a3dd-4027e874fdb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c76385e43a497ca267c3bc799ae35c', 'request_id': 'req-967ca0d6-1eb0-452b-a3dd-4027e874fdb9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.073872 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-967ca0d6-1eb0-452b-a3dd-4027e874fdb9 admin admin] The token cache is being invalidate because project 96c76385e43a497ca267c3bc799ae35c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:17.077942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-967ca0d6-1eb0-452b-a3dd-4027e874fdb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.077942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-967ca0d6-1eb0-452b-a3dd-4027e874fdb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.078755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 961/1902] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:16 2022] DELETE /identity/v3/projects/96c76385e43a497ca267c3bc799ae35c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:17.081007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebad5de-21a2-4271-9b4f-93346c4fbaae None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:17.081539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebad5de-21a2-4271-9b4f-93346c4fbaae None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:17.082343 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebad5de-21a2-4271-9b4f-93346c4fbaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:17.113055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-2ebad5de-21a2-4271-9b4f-93346c4fbaae None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:17.115319 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2ebad5de-21a2-4271-9b4f-93346c4fbaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:17.179853 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321be0a6-725e-45a5-be39-89b1860ce9be admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:17.187059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a1368-a4d1-4666-affd-ccdf69981357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:17.189376 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a1368-a4d1-4666-affd-ccdf69981357 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:17.189913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a1368-a4d1-4666-affd-ccdf69981357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:17.190349 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a1368-a4d1-4666-affd-ccdf69981357 admin admin] PATH_INFO: `/v3/projects/8078d77c735c4a61b5f0d1e49b27cb48/users/dbee715ec86945e688d1b3c381a91b82/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:17.193161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a1368-a4d1-4666-affd-ccdf69981357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8078d77c735c4a61b5f0d1e49b27cb48, user_id=dbee715ec86945e688d1b3c381a91b82, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:17.198083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a1368-a4d1-4666-affd-ccdf69981357 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:17.217915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 942/1903] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:17 2022] PUT /identity/v3/projects/8078d77c735c4a61b5f0d1e49b27cb48/users/dbee715ec86945e688d1b3c381a91b82/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:17.219230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a1368-a4d1-4666-affd-ccdf69981357 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:17.221106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ad4a1368-a4d1-4666-affd-ccdf69981357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:17.268149 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 962/1904] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:17.268149 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2376337-f567-4a53-a684-1cb02ebfd241 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:17.268149 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2376337-f567-4a53-a684-1cb02ebfd241 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:17.268149 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2376337-f567-4a53-a684-1cb02ebfd241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:17.334952 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a2376337-f567-4a53-a684-1cb02ebfd241 None None] MFA Rules not processed for user `dbee715ec86945e688d1b3c381a91b82`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:17.337839 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a2376337-f567-4a53-a684-1cb02ebfd241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:17.344720 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a1368-a4d1-4666-affd-ccdf69981357 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:17.351383 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa24d2-4137-4dda-ab2f-34497e94410d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:17.352530 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa24d2-4137-4dda-ab2f-34497e94410d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:17.352873 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa24d2-4137-4dda-ab2f-34497e94410d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:17.353725 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa24d2-4137-4dda-ab2f-34497e94410d admin admin] PATH_INFO: `/v3/users/99126a5dcbff481e8956c33711df3f81` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:17.355044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa24d2-4137-4dda-ab2f-34497e94410d admin admin] RBAC: Authorizing `identity:delete_user(user_id=99126a5dcbff481e8956c33711df3f81)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:17.357828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa24d2-4137-4dda-ab2f-34497e94410d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:17.400213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:17.458789 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-67fa24d2-4137-4dda-ab2f-34497e94410d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99126a5dcbff481e8956c33711df3f81'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.459542 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-67fa24d2-4137-4dda-ab2f-34497e94410d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99126a5dcbff481e8956c33711df3f81'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.468726 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-67fa24d2-4137-4dda-ab2f-34497e94410d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99126a5dcbff481e8956c33711df3f81'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.486906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-67fa24d2-4137-4dda-ab2f-34497e94410d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99126a5dcbff481e8956c33711df3f81'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.488308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-67fa24d2-4137-4dda-ab2f-34497e94410d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99126a5dcbff481e8956c33711df3f81'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.507891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 943/1905] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:17 2022] DELETE /identity/v3/users/99126a5dcbff481e8956c33711df3f81 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:17.508711 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa24d2-4137-4dda-ab2f-34497e94410d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:17.510183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-67fa24d2-4137-4dda-ab2f-34497e94410d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:17.546953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 963/1906] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:17 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:17.548520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2376337-f567-4a53-a684-1cb02ebfd241 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:17.563662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a2376337-f567-4a53-a684-1cb02ebfd241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:17.591234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2376337-f567-4a53-a684-1cb02ebfd241 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:17.601749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:17.717416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa24d2-4137-4dda-ab2f-34497e94410d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:17.728318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0573a1-5bcb-4444-bcf4-1cdb7880af32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:17.730541 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0573a1-5bcb-4444-bcf4-1cdb7880af32 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:17.731660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0573a1-5bcb-4444-bcf4-1cdb7880af32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:17.732493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0573a1-5bcb-4444-bcf4-1cdb7880af32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:17.737062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0c0573a1-5bcb-4444-bcf4-1cdb7880af32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:17.752016 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50342f-c3d9-4776-bdb8-fc1ce37d2350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:17.753184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50342f-c3d9-4776-bdb8-fc1ce37d2350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:17.753701 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50342f-c3d9-4776-bdb8-fc1ce37d2350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:17.754369 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50342f-c3d9-4776-bdb8-fc1ce37d2350 admin admin] PATH_INFO: `/v3/projects/4947db58a455423299c6428113a8aeef` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:17.755835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50342f-c3d9-4776-bdb8-fc1ce37d2350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4947db58a455423299c6428113a8aeef)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:17.758509 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50342f-c3d9-4776-bdb8-fc1ce37d2350 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:17.840698 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0573a1-5bcb-4444-bcf4-1cdb7880af32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:17.841612 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fe50342f-c3d9-4776-bdb8-fc1ce37d2350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4947db58a455423299c6428113a8aeef', 'request_id': 'req-fe50342f-c3d9-4776-bdb8-fc1ce37d2350'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.842476 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0573a1-5bcb-4444-bcf4-1cdb7880af32 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:17.855938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 944/1907] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:17.856463 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fe50342f-c3d9-4776-bdb8-fc1ce37d2350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4947db58a455423299c6428113a8aeef', 'request_id': 'req-fe50342f-c3d9-4776-bdb8-fc1ce37d2350'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.856842 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0573a1-5bcb-4444-bcf4-1cdb7880af32 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:17.858543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0c0573a1-5bcb-4444-bcf4-1cdb7880af32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:17.872826 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fe50342f-c3d9-4776-bdb8-fc1ce37d2350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4947db58a455423299c6428113a8aeef', 'request_id': 'req-fe50342f-c3d9-4776-bdb8-fc1ce37d2350'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.887503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fe50342f-c3d9-4776-bdb8-fc1ce37d2350 admin admin] The token cache is being invalidate because project 4947db58a455423299c6428113a8aeef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:17.887936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fe50342f-c3d9-4776-bdb8-fc1ce37d2350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.889283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fe50342f-c3d9-4776-bdb8-fc1ce37d2350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:17.891605 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 964/1908] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:17 2022] DELETE /identity/v3/projects/4947db58a455423299c6428113a8aeef => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:17.898624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50342f-c3d9-4776-bdb8-fc1ce37d2350 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:17.900290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fe50342f-c3d9-4776-bdb8-fc1ce37d2350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:18.018268 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0573a1-5bcb-4444-bcf4-1cdb7880af32 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:18.030553 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:18.084811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50342f-c3d9-4776-bdb8-fc1ce37d2350 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:18.095650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26025e94-6a26-4560-938f-639505d79e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:18.096943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26025e94-6a26-4560-938f-639505d79e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:18.097449 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26025e94-6a26-4560-938f-639505d79e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:18.098016 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26025e94-6a26-4560-938f-639505d79e7d admin admin] PATH_INFO: `/v3/users/e6b60b51e6e44caeb61f71c7eeef2455` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:18.100916 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26025e94-6a26-4560-938f-639505d79e7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b60b51e6e44caeb61f71c7eeef2455)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:18.103938 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26025e94-6a26-4560-938f-639505d79e7d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:18.111832 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c045f-40be-4b6a-9da9-af60ac526353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:18.113571 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c045f-40be-4b6a-9da9-af60ac526353 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:18.113892 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c045f-40be-4b6a-9da9-af60ac526353 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:18.114181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c045f-40be-4b6a-9da9-af60ac526353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:18.116717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2c0c045f-40be-4b6a-9da9-af60ac526353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:18.177346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:18.192109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-26025e94-6a26-4560-938f-639505d79e7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b60b51e6e44caeb61f71c7eeef2455'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:18.193203 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-26025e94-6a26-4560-938f-639505d79e7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b60b51e6e44caeb61f71c7eeef2455'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:18.210703 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-26025e94-6a26-4560-938f-639505d79e7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b60b51e6e44caeb61f71c7eeef2455'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:18.227828 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-26025e94-6a26-4560-938f-639505d79e7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b60b51e6e44caeb61f71c7eeef2455'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:18.229210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-26025e94-6a26-4560-938f-639505d79e7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b60b51e6e44caeb61f71c7eeef2455'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:18.245738 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c045f-40be-4b6a-9da9-af60ac526353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:18.247247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c045f-40be-4b6a-9da9-af60ac526353 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:18.259859 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 945/1909] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:18.261592 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c045f-40be-4b6a-9da9-af60ac526353 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:18.264084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2c0c045f-40be-4b6a-9da9-af60ac526353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:18.270293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 965/1910] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:17 2022] DELETE /identity/v3/users/e6b60b51e6e44caeb61f71c7eeef2455 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:18.290619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c045f-40be-4b6a-9da9-af60ac526353 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:18.319246 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26025e94-6a26-4560-938f-639505d79e7d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:18.321182 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-26025e94-6a26-4560-938f-639505d79e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:18.419465 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cc326-887e-4b23-be40-572cac378c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:18.420564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cc326-887e-4b23-be40-572cac378c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:18.420852 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cc326-887e-4b23-be40-572cac378c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:18.421133 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cc326-887e-4b23-be40-572cac378c26 admin admin] PATH_INFO: `/v3/projects/49d795f8af4542e583a2f22c170655ae` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:18.422532 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cc326-887e-4b23-be40-572cac378c26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d795f8af4542e583a2f22c170655ae)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:18.424801 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cc326-887e-4b23-be40-572cac378c26 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:18.483894 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26025e94-6a26-4560-938f-639505d79e7d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:18.505762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6d7cc326-887e-4b23-be40-572cac378c26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d795f8af4542e583a2f22c170655ae', 'request_id': 'req-6d7cc326-887e-4b23-be40-572cac378c26'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:18.512388 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6d7cc326-887e-4b23-be40-572cac378c26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d795f8af4542e583a2f22c170655ae', 'request_id': 'req-6d7cc326-887e-4b23-be40-572cac378c26'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:18.514601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:18.535595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6d7cc326-887e-4b23-be40-572cac378c26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d795f8af4542e583a2f22c170655ae', 'request_id': 'req-6d7cc326-887e-4b23-be40-572cac378c26'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:18.555476 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6d7cc326-887e-4b23-be40-572cac378c26 admin admin] The token cache is being invalidate because project 49d795f8af4542e583a2f22c170655ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:18.555807 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6d7cc326-887e-4b23-be40-572cac378c26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:18.556901 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6d7cc326-887e-4b23-be40-572cac378c26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:18.559353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 946/1911] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:18 2022] DELETE /identity/v3/projects/49d795f8af4542e583a2f22c170655ae => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:18.560391 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cc326-887e-4b23-be40-572cac378c26 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:18.562089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6d7cc326-887e-4b23-be40-572cac378c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:18.585738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9198aa3-92e2-4355-977c-47e24fe0b880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:18.586970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9198aa3-92e2-4355-977c-47e24fe0b880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:18.587429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9198aa3-92e2-4355-977c-47e24fe0b880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:18.587878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9198aa3-92e2-4355-977c-47e24fe0b880 admin admin] PATH_INFO: `/v3/projects/6a1e10578e214aba9e49b847a5c2c247` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:18.591260 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9198aa3-92e2-4355-977c-47e24fe0b880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1e10578e214aba9e49b847a5c2c247)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:18.593869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9198aa3-92e2-4355-977c-47e24fe0b880 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:18.641413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cc326-887e-4b23-be40-572cac378c26 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:18.646321 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f743b0-bbee-4d5b-a5ff-f2eeda344979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:18.647003 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f743b0-bbee-4d5b-a5ff-f2eeda344979 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:18.648652 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f743b0-bbee-4d5b-a5ff-f2eeda344979 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:18.649053 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f743b0-bbee-4d5b-a5ff-f2eeda344979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:18.651488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c9f743b0-bbee-4d5b-a5ff-f2eeda344979 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:18.689141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e9198aa3-92e2-4355-977c-47e24fe0b880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1e10578e214aba9e49b847a5c2c247', 'request_id': 'req-e9198aa3-92e2-4355-977c-47e24fe0b880'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:18.702176 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e9198aa3-92e2-4355-977c-47e24fe0b880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1e10578e214aba9e49b847a5c2c247', 'request_id': 'req-e9198aa3-92e2-4355-977c-47e24fe0b880'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:18.719188 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e9198aa3-92e2-4355-977c-47e24fe0b880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1e10578e214aba9e49b847a5c2c247', 'request_id': 'req-e9198aa3-92e2-4355-977c-47e24fe0b880'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:18.729539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:18.740972 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e9198aa3-92e2-4355-977c-47e24fe0b880 admin admin] The token cache is being invalidate because project 6a1e10578e214aba9e49b847a5c2c247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:18.741332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e9198aa3-92e2-4355-977c-47e24fe0b880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:18.742697 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e9198aa3-92e2-4355-977c-47e24fe0b880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:18.745127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 966/1912] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:18 2022] DELETE /identity/v3/projects/6a1e10578e214aba9e49b847a5c2c247 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:18.747230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5e936-4d3e-4d82-83cf-300943b5f35d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:18.748030 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5e936-4d3e-4d82-83cf-300943b5f35d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:18.748572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5e936-4d3e-4d82-83cf-300943b5f35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:18.756015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f743b0-bbee-4d5b-a5ff-f2eeda344979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:18.758569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f743b0-bbee-4d5b-a5ff-f2eeda344979 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:18.774529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-33d5e936-4d3e-4d82-83cf-300943b5f35d None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:18.776517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-33d5e936-4d3e-4d82-83cf-300943b5f35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:18.779417 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 947/1913] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:18.781070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b908c97-fb94-42ba-ac22-04659be8b6f6 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:18.781503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b908c97-fb94-42ba-ac22-04659be8b6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:18.781948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b908c97-fb94-42ba-ac22-04659be8b6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:18.815072 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-6b908c97-fb94-42ba-ac22-04659be8b6f6 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:18.815072 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6b908c97-fb94-42ba-ac22-04659be8b6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:18.865073 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 967/1914] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:18.866266 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5e936-4d3e-4d82-83cf-300943b5f35d None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:18.868217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-33d5e936-4d3e-4d82-83cf-300943b5f35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:18.882182 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5e936-4d3e-4d82-83cf-300943b5f35d None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:18.888081 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998872a0-9389-42c3-916a-3bb8df082127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:18.888965 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998872a0-9389-42c3-916a-3bb8df082127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:18.889243 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998872a0-9389-42c3-916a-3bb8df082127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:18.889512 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998872a0-9389-42c3-916a-3bb8df082127 admin admin] PATH_INFO: `/v3/projects/5ee4e438d09e4b99b0c5ce1c60eddeb0` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:18.898737 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998872a0-9389-42c3-916a-3bb8df082127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee4e438d09e4b99b0c5ce1c60eddeb0)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:18.903242 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998872a0-9389-42c3-916a-3bb8df082127 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:18.933886 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 948/1915] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:18.937540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0159b2c-00db-45c9-befb-d20d93a4a799 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:18.938099 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0159b2c-00db-45c9-befb-d20d93a4a799 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:18.938573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0159b2c-00db-45c9-befb-d20d93a4a799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:18.967922 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-c0159b2c-00db-45c9-befb-d20d93a4a799 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:18.969330 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c0159b2c-00db-45c9-befb-d20d93a4a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:18.983949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-998872a0-9389-42c3-916a-3bb8df082127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee4e438d09e4b99b0c5ce1c60eddeb0', 'request_id': 'req-998872a0-9389-42c3-916a-3bb8df082127'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:18.996680 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-998872a0-9389-42c3-916a-3bb8df082127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee4e438d09e4b99b0c5ce1c60eddeb0', 'request_id': 'req-998872a0-9389-42c3-916a-3bb8df082127'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:19.005068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-998872a0-9389-42c3-916a-3bb8df082127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee4e438d09e4b99b0c5ce1c60eddeb0', 'request_id': 'req-998872a0-9389-42c3-916a-3bb8df082127'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:19.019372 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-998872a0-9389-42c3-916a-3bb8df082127 admin admin] The token cache is being invalidate because project 5ee4e438d09e4b99b0c5ce1c60eddeb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:19.019721 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-998872a0-9389-42c3-916a-3bb8df082127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:19.020416 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-998872a0-9389-42c3-916a-3bb8df082127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:19.022170 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 968/1916] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:18 2022] DELETE /identity/v3/projects/5ee4e438d09e4b99b0c5ce1c60eddeb0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:19.025974 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fb547-6303-498b-92a4-5e5af641ecbb None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.025974 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fb547-6303-498b-92a4-5e5af641ecbb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.025974 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fb547-6303-498b-92a4-5e5af641ecbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.030810 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:19.062679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-158fb547-6303-498b-92a4-5e5af641ecbb None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:19.067469 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 949/1917] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:19.067645 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-158fb547-6303-498b-92a4-5e5af641ecbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:19.067746 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb0881-8a33-4e5e-8d89-6c174a128a37 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.067746 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb0881-8a33-4e5e-8d89-6c174a128a37 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.067746 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb0881-8a33-4e5e-8d89-6c174a128a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.076707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 969/1918] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:19.082238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fb547-6303-498b-92a4-5e5af641ecbb None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.094759 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fb547-6303-498b-92a4-5e5af641ecbb None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.099593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-3fcb0881-8a33-4e5e-8d89-6c174a128a37 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:19.100579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dcf81-e1f6-4e33-9f55-a86abf399d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.101260 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dcf81-e1f6-4e33-9f55-a86abf399d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.101469 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3fcb0881-8a33-4e5e-8d89-6c174a128a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:19.101579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dcf81-e1f6-4e33-9f55-a86abf399d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.101846 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dcf81-e1f6-4e33-9f55-a86abf399d87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.102625 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dcf81-e1f6-4e33-9f55-a86abf399d87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:19.102933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dcf81-e1f6-4e33-9f55-a86abf399d87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.104762 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dcf81-e1f6-4e33-9f55-a86abf399d87 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.126476 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 950/1919] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:19.126476 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb0881-8a33-4e5e-8d89-6c174a128a37 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.133637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 970/1920] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:19.145603 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae5df-309b-481f-aeb9-118f01bf7aac None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.145603 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae5df-309b-481f-aeb9-118f01bf7aac None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.145603 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae5df-309b-481f-aeb9-118f01bf7aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.150669 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb0881-8a33-4e5e-8d89-6c174a128a37 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.162993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8b5b7-b064-4768-ab13-b6f3ebf79dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.164625 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8b5b7-b064-4768-ab13-b6f3ebf79dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.165451 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8b5b7-b064-4768-ab13-b6f3ebf79dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.166590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8b5b7-b064-4768-ab13-b6f3ebf79dc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.168037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8b5b7-b064-4768-ab13-b6f3ebf79dc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:19.168905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8b5b7-b064-4768-ab13-b6f3ebf79dc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.171576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-28eae5df-309b-481f-aeb9-118f01bf7aac None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:19.172930 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8b5b7-b064-4768-ab13-b6f3ebf79dc4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.173525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-28eae5df-309b-481f-aeb9-118f01bf7aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:19.191613 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 971/1921] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:19.192710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eae5df-309b-481f-aeb9-118f01bf7aac None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.207441 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 951/1922] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:19.207441 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8b5b7-b064-4768-ab13-b6f3ebf79dc4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.219812 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eae5df-309b-481f-aeb9-118f01bf7aac None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.221346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8b5b7-b064-4768-ab13-b6f3ebf79dc4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.225016 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0890c-7e48-4ac4-84e0-73c91ad3ab2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.225660 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0890c-7e48-4ac4-84e0-73c91ad3ab2a admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.226310 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a4bb6-e3e9-456b-89e0-d1ca1a042aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.226580 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0890c-7e48-4ac4-84e0-73c91ad3ab2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.226869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0890c-7e48-4ac4-84e0-73c91ad3ab2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.227039 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a4bb6-e3e9-456b-89e0-d1ca1a042aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.227331 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a4bb6-e3e9-456b-89e0-d1ca1a042aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.227587 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0890c-7e48-4ac4-84e0-73c91ad3ab2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.227694 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a4bb6-e3e9-456b-89e0-d1ca1a042aa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.228326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a4bb6-e3e9-456b-89e0-d1ca1a042aa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:19.228844 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a4bb6-e3e9-456b-89e0-d1ca1a042aa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.229927 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0890c-7e48-4ac4-84e0-73c91ad3ab2a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.230333 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a4bb6-e3e9-456b-89e0-d1ca1a042aa8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.246543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 952/1923] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:19.251159 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a4bb6-e3e9-456b-89e0-d1ca1a042aa8 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.267532 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a4bb6-e3e9-456b-89e0-d1ca1a042aa8 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.270419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 972/1924] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:19 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:19.274247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0890c-7e48-4ac4-84e0-73c91ad3ab2a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.277649 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa9378-cfda-475c-8c11-bf7b71ddb8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.278777 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa9378-cfda-475c-8c11-bf7b71ddb8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.279218 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa9378-cfda-475c-8c11-bf7b71ddb8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.279669 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa9378-cfda-475c-8c11-bf7b71ddb8a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.282009 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa9378-cfda-475c-8c11-bf7b71ddb8a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.286724 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa9378-cfda-475c-8c11-bf7b71ddb8a0 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.316707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:19.318303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 953/1925] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:19 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:19.319228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa9378-cfda-475c-8c11-bf7b71ddb8a0 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.353015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0890c-7e48-4ac4-84e0-73c91ad3ab2a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.390020 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa9378-cfda-475c-8c11-bf7b71ddb8a0 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.397231 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d3577-c37e-4324-8e46-ac0ddbf68d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.398146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d3577-c37e-4324-8e46-ac0ddbf68d43 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.398585 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d3577-c37e-4324-8e46-ac0ddbf68d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.398965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d3577-c37e-4324-8e46-ac0ddbf68d43 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.399794 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d3577-c37e-4324-8e46-ac0ddbf68d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.402592 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d3577-c37e-4324-8e46-ac0ddbf68d43 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.417195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc2e37-4e7e-4c55-998a-ce3cd12413e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.417968 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc2e37-4e7e-4c55-998a-ce3cd12413e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.418244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc2e37-4e7e-4c55-998a-ce3cd12413e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.418511 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc2e37-4e7e-4c55-998a-ce3cd12413e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.419206 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc2e37-4e7e-4c55-998a-ce3cd12413e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.421117 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc2e37-4e7e-4c55-998a-ce3cd12413e7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.427494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 954/1926] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:19 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:19.430770 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d3577-c37e-4324-8e46-ac0ddbf68d43 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.442023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d3577-c37e-4324-8e46-ac0ddbf68d43 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.447581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951249aa-2885-4918-a07f-6d9d293d79c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.448299 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951249aa-2885-4918-a07f-6d9d293d79c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.448574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951249aa-2885-4918-a07f-6d9d293d79c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.448842 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951249aa-2885-4918-a07f-6d9d293d79c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.448942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 973/1927] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:19 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:19.449537 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951249aa-2885-4918-a07f-6d9d293d79c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.449755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc2e37-4e7e-4c55-998a-ce3cd12413e7 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.451540 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951249aa-2885-4918-a07f-6d9d293d79c9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.480388 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 955/1928] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:19 2022] POST /identity/v3/users => generated 287 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:19.481659 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951249aa-2885-4918-a07f-6d9d293d79c9 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.493942 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951249aa-2885-4918-a07f-6d9d293d79c9 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.534622 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc2e37-4e7e-4c55-998a-ce3cd12413e7 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.540316 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ba328-dbeb-4ce5-ab5f-375edf577e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.541014 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ba328-dbeb-4ce5-ab5f-375edf577e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.541296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ba328-dbeb-4ce5-ab5f-375edf577e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.541731 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ba328-dbeb-4ce5-ab5f-375edf577e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.542702 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ba328-dbeb-4ce5-ab5f-375edf577e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.544345 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ba328-dbeb-4ce5-ab5f-375edf577e52 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.557933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 974/1929] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:19.557933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ba328-dbeb-4ce5-ab5f-375edf577e52 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.566238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ba328-dbeb-4ce5-ab5f-375edf577e52 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.571343 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56d31e-290e-4957-9e4a-da458129f4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.571887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e280c-37e6-41d1-b5f7-836f802c4779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.572030 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56d31e-290e-4957-9e4a-da458129f4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.572308 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56d31e-290e-4957-9e4a-da458129f4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.572570 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e280c-37e6-41d1-b5f7-836f802c4779 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.572717 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56d31e-290e-4957-9e4a-da458129f4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.572939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e280c-37e6-41d1-b5f7-836f802c4779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.573210 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e280c-37e6-41d1-b5f7-836f802c4779 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.573538 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56d31e-290e-4957-9e4a-da458129f4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.574292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e280c-37e6-41d1-b5f7-836f802c4779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.575226 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56d31e-290e-4957-9e4a-da458129f4a0 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.576293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e280c-37e6-41d1-b5f7-836f802c4779 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.583649 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:19.586898 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 975/1930] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:19.587762 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56d31e-290e-4957-9e4a-da458129f4a0 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.598186 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56d31e-290e-4957-9e4a-da458129f4a0 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.602414 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 956/1931] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:19 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:19.602956 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb72dd-16aa-423b-8616-310901bda254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.603230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e280c-37e6-41d1-b5f7-836f802c4779 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.603633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb72dd-16aa-423b-8616-310901bda254 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.603928 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb72dd-16aa-423b-8616-310901bda254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.604334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb72dd-16aa-423b-8616-310901bda254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.605273 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb72dd-16aa-423b-8616-310901bda254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.607513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb72dd-16aa-423b-8616-310901bda254 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.613987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e280c-37e6-41d1-b5f7-836f802c4779 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.618683 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d18306-1ee3-4699-bcac-9825b094fb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.619411 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d18306-1ee3-4699-bcac-9825b094fb78 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.619411 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d18306-1ee3-4699-bcac-9825b094fb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.619411 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d18306-1ee3-4699-bcac-9825b094fb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.621182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d18306-1ee3-4699-bcac-9825b094fb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.622444 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 976/1932] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:19.623304 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb72dd-16aa-423b-8616-310901bda254 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.625843 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d18306-1ee3-4699-bcac-9825b094fb78 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.633626 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb72dd-16aa-423b-8616-310901bda254 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.640217 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 957/1933] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:19.640217 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d18306-1ee3-4699-bcac-9825b094fb78 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.640504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed064c0-ddec-4660-a4a6-a38a36cb9818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.640504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed064c0-ddec-4660-a4a6-a38a36cb9818 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.640790 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed064c0-ddec-4660-a4a6-a38a36cb9818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.641015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed064c0-ddec-4660-a4a6-a38a36cb9818 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.641919 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed064c0-ddec-4660-a4a6-a38a36cb9818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.643544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed064c0-ddec-4660-a4a6-a38a36cb9818 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.648654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d18306-1ee3-4699-bcac-9825b094fb78 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.653787 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e607f-d77a-4134-b733-4b8a459b0f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.654477 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 977/1934] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:19.654716 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e607f-d77a-4134-b733-4b8a459b0f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.655000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e607f-d77a-4134-b733-4b8a459b0f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.655295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e607f-d77a-4134-b733-4b8a459b0f5b admin admin] PATH_INFO: `/v3/projects/8fa23f4bf07a40128ceb0738dad4c37e/users/7525b2ec31cb4410b5931355db1fdc0c/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.655424 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed064c0-ddec-4660-a4a6-a38a36cb9818 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.665944 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed064c0-ddec-4660-a4a6-a38a36cb9818 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.671434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abd963-3e79-44ff-bea9-08a9b7b5cf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.671776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e607f-d77a-4134-b733-4b8a459b0f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa23f4bf07a40128ceb0738dad4c37e, user_id=7525b2ec31cb4410b5931355db1fdc0c, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.672349 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abd963-3e79-44ff-bea9-08a9b7b5cf4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.672628 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abd963-3e79-44ff-bea9-08a9b7b5cf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.672901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abd963-3e79-44ff-bea9-08a9b7b5cf4f admin admin] PATH_INFO: `/v3/projects/f3b1deead3694a5eb3b65801a828e919/users/9187f07fdc8249ce97376433f7e59f0a/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.674515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e607f-d77a-4134-b733-4b8a459b0f5b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.690159 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 958/1935] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:19 2022] PUT /identity/v3/projects/8fa23f4bf07a40128ceb0738dad4c37e/users/7525b2ec31cb4410b5931355db1fdc0c/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:19.690750 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abd963-3e79-44ff-bea9-08a9b7b5cf4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b1deead3694a5eb3b65801a828e919, user_id=9187f07fdc8249ce97376433f7e59f0a, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.693920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abd963-3e79-44ff-bea9-08a9b7b5cf4f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.698962 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e607f-d77a-4134-b733-4b8a459b0f5b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.719658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 978/1936] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:19 2022] PUT /identity/v3/projects/f3b1deead3694a5eb3b65801a828e919/users/9187f07fdc8249ce97376433f7e59f0a/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:19.721081 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff54b8-0a03-4362-8552-b19d32253e52 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.721438 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff54b8-0a03-4362-8552-b19d32253e52 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.721783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff54b8-0a03-4362-8552-b19d32253e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.732299 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:19.755680 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-26ff54b8-0a03-4362-8552-b19d32253e52 None None] MFA Rules not processed for user `7525b2ec31cb4410b5931355db1fdc0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:19.757020 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-26ff54b8-0a03-4362-8552-b19d32253e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:19.769429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e607f-d77a-4134-b733-4b8a459b0f5b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.856580 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 979/1937] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:19.856580 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc46e1-996a-42f3-b848-be5bcfe5f455 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.856580 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc46e1-996a-42f3-b848-be5bcfe5f455 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.856580 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc46e1-996a-42f3-b848-be5bcfe5f455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.869041 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d57885-cce4-458d-b3bc-d055b598b76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.870035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d57885-cce4-458d-b3bc-d055b598b76a admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.870686 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d57885-cce4-458d-b3bc-d055b598b76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.870686 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d57885-cce4-458d-b3bc-d055b598b76a admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.871577 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d57885-cce4-458d-b3bc-d055b598b76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.873399 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d57885-cce4-458d-b3bc-d055b598b76a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.895597 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 959/1938] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:19.900438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d57885-cce4-458d-b3bc-d055b598b76a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.900616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d3bc46e1-996a-42f3-b848-be5bcfe5f455 None None] MFA Rules not processed for user `9187f07fdc8249ce97376433f7e59f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:19.901488 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d3bc46e1-996a-42f3-b848-be5bcfe5f455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:19.910276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d57885-cce4-458d-b3bc-d055b598b76a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.914973 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6d56f-36af-4b0b-8a21-0c5760bfc052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:19.915657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6d56f-36af-4b0b-8a21-0c5760bfc052 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:19.915920 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6d56f-36af-4b0b-8a21-0c5760bfc052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:19.916191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6d56f-36af-4b0b-8a21-0c5760bfc052 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:19.916959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6d56f-36af-4b0b-8a21-0c5760bfc052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:19.919252 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6d56f-36af-4b0b-8a21-0c5760bfc052 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:19.949764 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 960/1939] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:19 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:19.949764 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6d56f-36af-4b0b-8a21-0c5760bfc052 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.971002 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 980/1940] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:19.975491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc46e1-996a-42f3-b848-be5bcfe5f455 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:19.987076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc46e1-996a-42f3-b848-be5bcfe5f455 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:19.997053 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:20.022568 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6d56f-36af-4b0b-8a21-0c5760bfc052 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:20.028154 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23c57b-0a79-4d59-bceb-37dca90abeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:20.029066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23c57b-0a79-4d59-bceb-37dca90abeed admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.029345 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23c57b-0a79-4d59-bceb-37dca90abeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.029619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23c57b-0a79-4d59-bceb-37dca90abeed admin admin] PATH_INFO: `/v3/projects/ea85f7ee8da24148aa3ed0f0b446d25f/users/955b586ae2e0497793f41f9f7ea03de2/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.046175 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23c57b-0a79-4d59-bceb-37dca90abeed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea85f7ee8da24148aa3ed0f0b446d25f, user_id=955b586ae2e0497793f41f9f7ea03de2, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:20.046429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8596d-c682-4def-98e4-08a563ec60dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:20.047118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8596d-c682-4def-98e4-08a563ec60dd admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.047403 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8596d-c682-4def-98e4-08a563ec60dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.047683 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8596d-c682-4def-98e4-08a563ec60dd admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.048382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8596d-c682-4def-98e4-08a563ec60dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:20.048893 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23c57b-0a79-4d59-bceb-37dca90abeed admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:20.050351 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8596d-c682-4def-98e4-08a563ec60dd admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:20.064473 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 961/1941] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:19 2022] PUT /identity/v3/projects/ea85f7ee8da24148aa3ed0f0b446d25f/users/955b586ae2e0497793f41f9f7ea03de2/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:20.065376 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23c57b-0a79-4d59-bceb-37dca90abeed admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:20.066946 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5b23c57b-0a79-4d59-bceb-37dca90abeed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:20.082752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 981/1942] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:19 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:20.084313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce48436-9b3e-40b5-958f-caddad7a3c16 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.084792 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce48436-9b3e-40b5-958f-caddad7a3c16 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.085080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce48436-9b3e-40b5-958f-caddad7a3c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.105639 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:20.114219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-cce48436-9b3e-40b5-958f-caddad7a3c16 None None] MFA Rules not processed for user `955b586ae2e0497793f41f9f7ea03de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:20.115899 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-cce48436-9b3e-40b5-958f-caddad7a3c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:20.126686 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23c57b-0a79-4d59-bceb-37dca90abeed admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:20.130299 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d83a15-9e5d-4088-b4bf-fa291b6b3930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:20.130953 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d83a15-9e5d-4088-b4bf-fa291b6b3930 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.131238 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d83a15-9e5d-4088-b4bf-fa291b6b3930 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.131515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d83a15-9e5d-4088-b4bf-fa291b6b3930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.183653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 982/1943] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:20.184587 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce48436-9b3e-40b5-958f-caddad7a3c16 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:20.197403 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d83a15-9e5d-4088-b4bf-fa291b6b3930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:20.199183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d83a15-9e5d-4088-b4bf-fa291b6b3930 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:20.208808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 962/1944] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:20.209619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d83a15-9e5d-4088-b4bf-fa291b6b3930 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:20.211010 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e7d83a15-9e5d-4088-b4bf-fa291b6b3930 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:20.226018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d83a15-9e5d-4088-b4bf-fa291b6b3930 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:20.232890 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3f560-41a6-4301-8740-195cc7222ffd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:20.233788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3f560-41a6-4301-8740-195cc7222ffd service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.234165 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3f560-41a6-4301-8740-195cc7222ffd service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.235147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3f560-41a6-4301-8740-195cc7222ffd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.246839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3f560-41a6-4301-8740-195cc7222ffd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:20.249678 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3f560-41a6-4301-8740-195cc7222ffd service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:20.265874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 963/1945] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:20.272257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce48436-9b3e-40b5-958f-caddad7a3c16 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:20.290265 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b39ffb-c9fe-407b-9426-ac5192669ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:20.291309 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b39ffb-c9fe-407b-9426-ac5192669ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.292010 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b39ffb-c9fe-407b-9426-ac5192669ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.292739 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b39ffb-c9fe-407b-9426-ac5192669ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.294347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3f560-41a6-4301-8740-195cc7222ffd service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:20.294592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b39ffb-c9fe-407b-9426-ac5192669ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:20.299520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b39ffb-c9fe-407b-9426-ac5192669ecc admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:20.308973 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3f560-41a6-4301-8740-195cc7222ffd service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:20.314259 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab707d-605a-4801-9de0-3cece1cd153b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:20.315387 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab707d-605a-4801-9de0-3cece1cd153b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.315855 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab707d-605a-4801-9de0-3cece1cd153b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.316233 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab707d-605a-4801-9de0-3cece1cd153b admin admin] PATH_INFO: `/v3/users/955b586ae2e0497793f41f9f7ea03de2` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.320293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 983/1946] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:20.320392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab707d-605a-4801-9de0-3cece1cd153b admin admin] RBAC: Authorizing `identity:delete_user(user_id=955b586ae2e0497793f41f9f7ea03de2)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:20.320392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab707d-605a-4801-9de0-3cece1cd153b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:20.321235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b39ffb-c9fe-407b-9426-ac5192669ecc admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:20.334653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b39ffb-c9fe-407b-9426-ac5192669ecc admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:20.343524 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393af4ff-c758-4091-b662-35ec20d4132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:20.344700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393af4ff-c758-4091-b662-35ec20d4132e admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.345055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393af4ff-c758-4091-b662-35ec20d4132e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.345505 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393af4ff-c758-4091-b662-35ec20d4132e admin admin] PATH_INFO: `/v3/projects/7bce19f47a024453ae7ad5aa6cf6e8a3/users/303d0958d9844fe3a2a6f174d617b7e2/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.365076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393af4ff-c758-4091-b662-35ec20d4132e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bce19f47a024453ae7ad5aa6cf6e8a3, user_id=303d0958d9844fe3a2a6f174d617b7e2, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:20.368076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393af4ff-c758-4091-b662-35ec20d4132e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:20.390589 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 984/1947] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:20 2022] PUT /identity/v3/projects/7bce19f47a024453ae7ad5aa6cf6e8a3/users/303d0958d9844fe3a2a6f174d617b7e2/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:20.396454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393af4ff-c758-4091-b662-35ec20d4132e admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:20.406432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3bab707d-605a-4801-9de0-3cece1cd153b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '955b586ae2e0497793f41f9f7ea03de2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:20.407272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3bab707d-605a-4801-9de0-3cece1cd153b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '955b586ae2e0497793f41f9f7ea03de2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:20.420064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:20.422734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3bab707d-605a-4801-9de0-3cece1cd153b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '955b586ae2e0497793f41f9f7ea03de2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:20.443695 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3bab707d-605a-4801-9de0-3cece1cd153b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '955b586ae2e0497793f41f9f7ea03de2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:20.444490 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3bab707d-605a-4801-9de0-3cece1cd153b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '955b586ae2e0497793f41f9f7ea03de2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:20.473177 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 964/1948] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:20 2022] DELETE /identity/v3/users/955b586ae2e0497793f41f9f7ea03de2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:02:20.478486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2803457-d55e-4216-867e-ab05b224082a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.478778 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2803457-d55e-4216-867e-ab05b224082a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.479128 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2803457-d55e-4216-867e-ab05b224082a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.499498 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f2803457-d55e-4216-867e-ab05b224082a None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:20.500739 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f2803457-d55e-4216-867e-ab05b224082a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:20.518703 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393af4ff-c758-4091-b662-35ec20d4132e admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:20.545657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:20.616847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 965/1949] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:20.623728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e5c4d-3d94-4db6-9eed-e1c6079b8f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:20.626265 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e5c4d-3d94-4db6-9eed-e1c6079b8f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.626910 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e5c4d-3d94-4db6-9eed-e1c6079b8f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.628445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2803457-d55e-4216-867e-ab05b224082a None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:20.629434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e5c4d-3d94-4db6-9eed-e1c6079b8f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.631993 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e5c4d-3d94-4db6-9eed-e1c6079b8f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:20.633973 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f2803457-d55e-4216-867e-ab05b224082a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:20.635601 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e5c4d-3d94-4db6-9eed-e1c6079b8f0a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:20.656140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 985/1950] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:02:20.660779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e5c4d-3d94-4db6-9eed-e1c6079b8f0a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:20.667856 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-dd6e5c4d-3d94-4db6-9eed-e1c6079b8f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:20.683863 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e5c4d-3d94-4db6-9eed-e1c6079b8f0a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:20.690937 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae90ff-30d2-461e-a597-69aab9a6aa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:20.691935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae90ff-30d2-461e-a597-69aab9a6aa68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.692291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae90ff-30d2-461e-a597-69aab9a6aa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.692667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae90ff-30d2-461e-a597-69aab9a6aa68 admin admin] PATH_INFO: `/v3/projects/7bce19f47a024453ae7ad5aa6cf6e8a3/users/303d0958d9844fe3a2a6f174d617b7e2/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.694862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae90ff-30d2-461e-a597-69aab9a6aa68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bce19f47a024453ae7ad5aa6cf6e8a3, user_id=303d0958d9844fe3a2a6f174d617b7e2, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:20.697701 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae90ff-30d2-461e-a597-69aab9a6aa68 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:20.709843 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 986/1951] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:20 2022] PUT /identity/v3/projects/7bce19f47a024453ae7ad5aa6cf6e8a3/users/303d0958d9844fe3a2a6f174d617b7e2/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:20.715193 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2803457-d55e-4216-867e-ab05b224082a None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:20.720778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77db01-97ec-4851-a841-72db5ecb8beb None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.721145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77db01-97ec-4851-a841-72db5ecb8beb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.721497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77db01-97ec-4851-a841-72db5ecb8beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.750246 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ac77db01-97ec-4851-a841-72db5ecb8beb None None] MFA Rules not processed for user `303d0958d9844fe3a2a6f174d617b7e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:20.751519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ac77db01-97ec-4851-a841-72db5ecb8beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:20.769349 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224acd63-b70e-4e88-8c04-d0948737f1d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:20.770079 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224acd63-b70e-4e88-8c04-d0948737f1d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.770359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224acd63-b70e-4e88-8c04-d0948737f1d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.770625 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224acd63-b70e-4e88-8c04-d0948737f1d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.814929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:20.823587 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 987/1952] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:02:20.834855 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77db01-97ec-4851-a841-72db5ecb8beb None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:20.836255 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ac77db01-97ec-4851-a841-72db5ecb8beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:20.841315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224acd63-b70e-4e88-8c04-d0948737f1d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:20.842896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224acd63-b70e-4e88-8c04-d0948737f1d7 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:20.853002 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 966/1953] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:20.906272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77db01-97ec-4851-a841-72db5ecb8beb None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:20.910776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54fa90-167d-4019-b984-ce960af50f17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:20.911391 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54fa90-167d-4019-b984-ce960af50f17 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:20.911730 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54fa90-167d-4019-b984-ce960af50f17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:20.912563 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54fa90-167d-4019-b984-ce960af50f17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:20.924731 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54fa90-167d-4019-b984-ce960af50f17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:20.926270 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54fa90-167d-4019-b984-ce960af50f17 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:20.951936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 988/1954] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:02:21.058625 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224acd63-b70e-4e88-8c04-d0948737f1d7 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:21.069406 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224acd63-b70e-4e88-8c04-d0948737f1d7 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:21.075549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2466e5-120c-4898-b5e7-642ec69e6a08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:21.076226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2466e5-120c-4898-b5e7-642ec69e6a08 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:21.076517 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2466e5-120c-4898-b5e7-642ec69e6a08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:21.076786 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2466e5-120c-4898-b5e7-642ec69e6a08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:21.079542 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6a2466e5-120c-4898-b5e7-642ec69e6a08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:21.159198 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2466e5-120c-4898-b5e7-642ec69e6a08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:21.160692 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2466e5-120c-4898-b5e7-642ec69e6a08 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:21.172457 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 967/1955] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:21.257836 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54fa90-167d-4019-b984-ce960af50f17 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:21.260051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5a54fa90-167d-4019-b984-ce960af50f17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:21.334484 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54fa90-167d-4019-b984-ce960af50f17 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:21.342202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c21292-37eb-4b93-9f55-7a8f3a1e686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:21.344432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c21292-37eb-4b93-9f55-7a8f3a1e686c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:21.344432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c21292-37eb-4b93-9f55-7a8f3a1e686c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:21.344756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c21292-37eb-4b93-9f55-7a8f3a1e686c admin admin] PATH_INFO: `/v3/projects/ea85f7ee8da24148aa3ed0f0b446d25f` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:21.346439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c21292-37eb-4b93-9f55-7a8f3a1e686c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea85f7ee8da24148aa3ed0f0b446d25f)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:21.348566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c21292-37eb-4b93-9f55-7a8f3a1e686c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:21.387131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:21.409546 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f8c21292-37eb-4b93-9f55-7a8f3a1e686c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea85f7ee8da24148aa3ed0f0b446d25f', 'request_id': 'req-f8c21292-37eb-4b93-9f55-7a8f3a1e686c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:21.431127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f8c21292-37eb-4b93-9f55-7a8f3a1e686c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea85f7ee8da24148aa3ed0f0b446d25f', 'request_id': 'req-f8c21292-37eb-4b93-9f55-7a8f3a1e686c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:21.439458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f8c21292-37eb-4b93-9f55-7a8f3a1e686c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea85f7ee8da24148aa3ed0f0b446d25f', 'request_id': 'req-f8c21292-37eb-4b93-9f55-7a8f3a1e686c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:21.451563 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f8c21292-37eb-4b93-9f55-7a8f3a1e686c admin admin] The token cache is being invalidate because project ea85f7ee8da24148aa3ed0f0b446d25f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:21.451849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f8c21292-37eb-4b93-9f55-7a8f3a1e686c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:21.452981 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f8c21292-37eb-4b93-9f55-7a8f3a1e686c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:21.454843 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 989/1956] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:21 2022] DELETE /identity/v3/projects/ea85f7ee8da24148aa3ed0f0b446d25f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:21.462353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a739b2-ce23-4dfe-9792-1de2476e1566 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:21.462673 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a739b2-ce23-4dfe-9792-1de2476e1566 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:21.463697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a739b2-ce23-4dfe-9792-1de2476e1566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:21.486548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d2a739b2-ce23-4dfe-9792-1de2476e1566 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:21.487871 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d2a739b2-ce23-4dfe-9792-1de2476e1566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:21.606898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 968/1957] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:21.617308 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ee186-fab1-4aa9-93b7-b7ce8aa9d0ad None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:21.617643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ee186-fab1-4aa9-93b7-b7ce8aa9d0ad None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:21.618195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ee186-fab1-4aa9-93b7-b7ce8aa9d0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:21.650383 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-025ee186-fab1-4aa9-93b7-b7ce8aa9d0ad None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:21.651726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-025ee186-fab1-4aa9-93b7-b7ce8aa9d0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:21.667050 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 990/1958] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:02:21.676531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a739b2-ce23-4dfe-9792-1de2476e1566 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:21.702199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a739b2-ce23-4dfe-9792-1de2476e1566 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:21.707630 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cd757-8c81-48ca-8879-6a6531540cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:21.708622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cd757-8c81-48ca-8879-6a6531540cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:21.709006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cd757-8c81-48ca-8879-6a6531540cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:21.709395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cd757-8c81-48ca-8879-6a6531540cb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:21.710435 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cd757-8c81-48ca-8879-6a6531540cb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:21.710892 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cd757-8c81-48ca-8879-6a6531540cb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:21.712771 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cd757-8c81-48ca-8879-6a6531540cb8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:21.743899 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 969/1959] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:21.748258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ee186-fab1-4aa9-93b7-b7ce8aa9d0ad None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:21.757873 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ee186-fab1-4aa9-93b7-b7ce8aa9d0ad None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:21.765989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e06cd7-df1b-4412-867c-6bb2103a8451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:21.765989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e06cd7-df1b-4412-867c-6bb2103a8451 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:21.765989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e06cd7-df1b-4412-867c-6bb2103a8451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:21.765989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e06cd7-df1b-4412-867c-6bb2103a8451 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:21.766593 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e06cd7-df1b-4412-867c-6bb2103a8451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:21.767652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e06cd7-df1b-4412-867c-6bb2103a8451 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:21.803612 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 991/1960] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:21 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:02:21.810542 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cd757-8c81-48ca-8879-6a6531540cb8 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:21.822784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cd757-8c81-48ca-8879-6a6531540cb8 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:21.913275 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1004b3-e5bf-434a-955e-a2df09b1459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:21.913865 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1004b3-e5bf-434a-955e-a2df09b1459b admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:21.914111 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1004b3-e5bf-434a-955e-a2df09b1459b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:21.914412 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1004b3-e5bf-434a-955e-a2df09b1459b admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:21.915211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1004b3-e5bf-434a-955e-a2df09b1459b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:21.920619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1004b3-e5bf-434a-955e-a2df09b1459b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:21.936004 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:21.959172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 970/1961] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:21 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:21.963738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e06cd7-df1b-4412-867c-6bb2103a8451 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:21.979628 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e06cd7-df1b-4412-867c-6bb2103a8451 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:21.986742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d44d5f-6209-46a6-9a22-c06918f50688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:21.987844 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d44d5f-6209-46a6-9a22-c06918f50688 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:21.988040 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d44d5f-6209-46a6-9a22-c06918f50688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:21.988469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d44d5f-6209-46a6-9a22-c06918f50688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:21.989379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d44d5f-6209-46a6-9a22-c06918f50688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:21.991386 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d44d5f-6209-46a6-9a22-c06918f50688 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:22.006996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 992/1962] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:02:22.012220 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1004b3-e5bf-434a-955e-a2df09b1459b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:22.027634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1004b3-e5bf-434a-955e-a2df09b1459b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:22.037530 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67409842-c3f6-4def-950b-9dbcda54105f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:22.038265 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67409842-c3f6-4def-950b-9dbcda54105f admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:22.038672 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67409842-c3f6-4def-950b-9dbcda54105f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:22.038949 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67409842-c3f6-4def-950b-9dbcda54105f admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:22.039740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67409842-c3f6-4def-950b-9dbcda54105f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:22.041370 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67409842-c3f6-4def-950b-9dbcda54105f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:22.057129 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 971/1963] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:22.062881 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d44d5f-6209-46a6-9a22-c06918f50688 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:22.076911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d44d5f-6209-46a6-9a22-c06918f50688 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:22.083317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ac70d-3fc3-4cec-babc-12a4ea881317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:22.090225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ac70d-3fc3-4cec-babc-12a4ea881317 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:22.090225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ac70d-3fc3-4cec-babc-12a4ea881317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:22.090225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ac70d-3fc3-4cec-babc-12a4ea881317 admin admin] PATH_INFO: `/v3/projects/de978017e34e42c48c226b1f709feb4a/users/9e379a0d5c49465cbe2d61ab43fab6b1/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:22.107795 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ac70d-3fc3-4cec-babc-12a4ea881317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de978017e34e42c48c226b1f709feb4a, user_id=9e379a0d5c49465cbe2d61ab43fab6b1, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:22.111265 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ac70d-3fc3-4cec-babc-12a4ea881317 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:22.132866 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 993/1964] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:22 2022] PUT /identity/v3/projects/de978017e34e42c48c226b1f709feb4a/users/9e379a0d5c49465cbe2d61ab43fab6b1/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:22.148358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d1f7f-0f2b-4e71-a779-e950e1e9cb6c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:22.150901 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d1f7f-0f2b-4e71-a779-e950e1e9cb6c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:22.151362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d1f7f-0f2b-4e71-a779-e950e1e9cb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:22.203925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ad6d1f7f-0f2b-4e71-a779-e950e1e9cb6c None None] MFA Rules not processed for user `9e379a0d5c49465cbe2d61ab43fab6b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:22.205653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ad6d1f7f-0f2b-4e71-a779-e950e1e9cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:22.308102 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 972/1965] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:22.320437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ac70d-3fc3-4cec-babc-12a4ea881317 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:22.322299 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c72ac70d-3fc3-4cec-babc-12a4ea881317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:22.412698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ac70d-3fc3-4cec-babc-12a4ea881317 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:22.416798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbc899-c7a2-42e8-b9a0-1f81ab8a3502 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:22.417461 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbc899-c7a2-42e8-b9a0-1f81ab8a3502 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:22.417745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbc899-c7a2-42e8-b9a0-1f81ab8a3502 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:22.418080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbc899-c7a2-42e8-b9a0-1f81ab8a3502 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:22.427944 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbc899-c7a2-42e8-b9a0-1f81ab8a3502 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:22.429425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbc899-c7a2-42e8-b9a0-1f81ab8a3502 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:22.439348 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 994/1966] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:22.465204 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d1f7f-0f2b-4e71-a779-e950e1e9cb6c None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:22.538325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d1f7f-0f2b-4e71-a779-e950e1e9cb6c None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:22.543431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9b77c-2429-4895-a633-28a77c22be38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:22.544332 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9b77c-2429-4895-a633-28a77c22be38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:22.544613 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9b77c-2429-4895-a633-28a77c22be38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:22.544885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9b77c-2429-4895-a633-28a77c22be38 admin admin] PATH_INFO: `/v3/users/9e379a0d5c49465cbe2d61ab43fab6b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:22.546151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9b77c-2429-4895-a633-28a77c22be38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e379a0d5c49465cbe2d61ab43fab6b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:22.548263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9b77c-2429-4895-a633-28a77c22be38 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:22.610811 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-34f9b77c-2429-4895-a633-28a77c22be38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e379a0d5c49465cbe2d61ab43fab6b1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:22.611631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-34f9b77c-2429-4895-a633-28a77c22be38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e379a0d5c49465cbe2d61ab43fab6b1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:22.621073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-34f9b77c-2429-4895-a633-28a77c22be38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e379a0d5c49465cbe2d61ab43fab6b1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:22.659701 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-34f9b77c-2429-4895-a633-28a77c22be38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e379a0d5c49465cbe2d61ab43fab6b1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:22.660649 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-34f9b77c-2429-4895-a633-28a77c22be38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e379a0d5c49465cbe2d61ab43fab6b1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:22.664122 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:22.682711 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 973/1967] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:22 2022] DELETE /identity/v3/users/9e379a0d5c49465cbe2d61ab43fab6b1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:22.688408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e2f71-f3a6-4ec8-90a6-e5aef3ea8d50 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:22.688825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e2f71-f3a6-4ec8-90a6-e5aef3ea8d50 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:22.689298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e2f71-f3a6-4ec8-90a6-e5aef3ea8d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:22.714625 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-1b1e2f71-f3a6-4ec8-90a6-e5aef3ea8d50 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:22.715934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1b1e2f71-f3a6-4ec8-90a6-e5aef3ea8d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:22.789838 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:22.811394 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 995/1968] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:22.825230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9b77c-2429-4895-a633-28a77c22be38 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:22.827724 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-34f9b77c-2429-4895-a633-28a77c22be38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:22.919040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9b77c-2429-4895-a633-28a77c22be38 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:22.927514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cc671-4983-404a-b657-45e88fc7d14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:22.928444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cc671-4983-404a-b657-45e88fc7d14b service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:22.928815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cc671-4983-404a-b657-45e88fc7d14b service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:22.929388 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cc671-4983-404a-b657-45e88fc7d14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:22.941586 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cc671-4983-404a-b657-45e88fc7d14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:22.943571 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cc671-4983-404a-b657-45e88fc7d14b service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:22.961697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 974/1969] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:23.365608 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e2f71-f3a6-4ec8-90a6-e5aef3ea8d50 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:23.367783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1b1e2f71-f3a6-4ec8-90a6-e5aef3ea8d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:23.395789 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e2f71-f3a6-4ec8-90a6-e5aef3ea8d50 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:23.402571 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49431c-2c82-4c3b-9f8b-70701519d4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:23.404266 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49431c-2c82-4c3b-9f8b-70701519d4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:23.404961 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49431c-2c82-4c3b-9f8b-70701519d4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:23.405904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49431c-2c82-4c3b-9f8b-70701519d4ee admin admin] PATH_INFO: `/v3/projects/de978017e34e42c48c226b1f709feb4a` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:23.408991 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49431c-2c82-4c3b-9f8b-70701519d4ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=de978017e34e42c48c226b1f709feb4a)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:23.415818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49431c-2c82-4c3b-9f8b-70701519d4ee admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:23.542833 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ae49431c-2c82-4c3b-9f8b-70701519d4ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de978017e34e42c48c226b1f709feb4a', 'request_id': 'req-ae49431c-2c82-4c3b-9f8b-70701519d4ee'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:23.567969 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ae49431c-2c82-4c3b-9f8b-70701519d4ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de978017e34e42c48c226b1f709feb4a', 'request_id': 'req-ae49431c-2c82-4c3b-9f8b-70701519d4ee'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:23.589041 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ae49431c-2c82-4c3b-9f8b-70701519d4ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de978017e34e42c48c226b1f709feb4a', 'request_id': 'req-ae49431c-2c82-4c3b-9f8b-70701519d4ee'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:23.613279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ae49431c-2c82-4c3b-9f8b-70701519d4ee admin admin] The token cache is being invalidate because project de978017e34e42c48c226b1f709feb4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:23.613939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ae49431c-2c82-4c3b-9f8b-70701519d4ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:23.615587 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ae49431c-2c82-4c3b-9f8b-70701519d4ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:23.631465 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 996/1970] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:23 2022] DELETE /identity/v3/projects/de978017e34e42c48c226b1f709feb4a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:23.855141 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cc671-4983-404a-b657-45e88fc7d14b service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:23.858543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-105cc671-4983-404a-b657-45e88fc7d14b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:23.908273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cc671-4983-404a-b657-45e88fc7d14b service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:24.065926 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc7068-a378-41cb-b87d-d6568bd86512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:24.066342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc7068-a378-41cb-b87d-d6568bd86512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:24.066842 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc7068-a378-41cb-b87d-d6568bd86512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:24.067139 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc7068-a378-41cb-b87d-d6568bd86512 admin admin] PATH_INFO: `/v3/users/9187f07fdc8249ce97376433f7e59f0a` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:24.069156 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc7068-a378-41cb-b87d-d6568bd86512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9187f07fdc8249ce97376433f7e59f0a)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:24.071531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc7068-a378-41cb-b87d-d6568bd86512 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:24.082267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49431c-2c82-4c3b-9f8b-70701519d4ee admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:24.084817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ae49431c-2c82-4c3b-9f8b-70701519d4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:24.124314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49431c-2c82-4c3b-9f8b-70701519d4ee admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:24.138621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206483f6-e9bc-470f-84e3-5a6b792349f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:24.139809 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206483f6-e9bc-470f-84e3-5a6b792349f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:24.140105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206483f6-e9bc-470f-84e3-5a6b792349f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:24.140737 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206483f6-e9bc-470f-84e3-5a6b792349f1 admin admin] PATH_INFO: `/v3/users/7525b2ec31cb4410b5931355db1fdc0c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:24.147415 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206483f6-e9bc-470f-84e3-5a6b792349f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7525b2ec31cb4410b5931355db1fdc0c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:24.154241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206483f6-e9bc-470f-84e3-5a6b792349f1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:24.226489 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d2fc7068-a378-41cb-b87d-d6568bd86512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9187f07fdc8249ce97376433f7e59f0a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:24.232429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d2fc7068-a378-41cb-b87d-d6568bd86512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9187f07fdc8249ce97376433f7e59f0a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:24.268030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d2fc7068-a378-41cb-b87d-d6568bd86512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9187f07fdc8249ce97376433f7e59f0a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:24.306100 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-206483f6-e9bc-470f-84e3-5a6b792349f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7525b2ec31cb4410b5931355db1fdc0c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:24.313039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-206483f6-e9bc-470f-84e3-5a6b792349f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7525b2ec31cb4410b5931355db1fdc0c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:24.326634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d2fc7068-a378-41cb-b87d-d6568bd86512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9187f07fdc8249ce97376433f7e59f0a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:24.328414 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d2fc7068-a378-41cb-b87d-d6568bd86512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9187f07fdc8249ce97376433f7e59f0a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:24.336512 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-206483f6-e9bc-470f-84e3-5a6b792349f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7525b2ec31cb4410b5931355db1fdc0c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:24.355982 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-206483f6-e9bc-470f-84e3-5a6b792349f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7525b2ec31cb4410b5931355db1fdc0c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:24.357058 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-206483f6-e9bc-470f-84e3-5a6b792349f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7525b2ec31cb4410b5931355db1fdc0c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:24.389411 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 975/1971] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:23 2022] DELETE /identity/v3/users/9187f07fdc8249ce97376433f7e59f0a => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:24.390957 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 997/1972] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:24 2022] DELETE /identity/v3/users/7525b2ec31cb4410b5931355db1fdc0c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:02:24.394162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06b0be-b13c-4706-8965-1ca49dc65bb5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:24.394289 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06b0be-b13c-4706-8965-1ca49dc65bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:24.394714 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06b0be-b13c-4706-8965-1ca49dc65bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:24.397048 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cba704-0cc1-451f-9a94-179778fe983b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:24.397590 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cba704-0cc1-451f-9a94-179778fe983b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:24.398210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cba704-0cc1-451f-9a94-179778fe983b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:24.434593 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-71cba704-0cc1-451f-9a94-179778fe983b None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:24.437646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-71cba704-0cc1-451f-9a94-179778fe983b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:24.454609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4b06b0be-b13c-4706-8965-1ca49dc65bb5 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:24.456482 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4b06b0be-b13c-4706-8965-1ca49dc65bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:24.490491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:24.514451 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:24.544287 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 998/1973] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:24.556410 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cba704-0cc1-451f-9a94-179778fe983b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:24.558482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-71cba704-0cc1-451f-9a94-179778fe983b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:24.638304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 976/1974] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:24.653297 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06b0be-b13c-4706-8965-1ca49dc65bb5 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:24.658914 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4b06b0be-b13c-4706-8965-1ca49dc65bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:24.688305 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cba704-0cc1-451f-9a94-179778fe983b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:24.696094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1aae3-a722-43b6-adae-b1c0942b9c02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:24.697232 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1aae3-a722-43b6-adae-b1c0942b9c02 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:24.697773 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1aae3-a722-43b6-adae-b1c0942b9c02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:24.698343 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1aae3-a722-43b6-adae-b1c0942b9c02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:24.719817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1aae3-a722-43b6-adae-b1c0942b9c02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:24.727564 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1aae3-a722-43b6-adae-b1c0942b9c02 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:24.742768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 999/1975] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:24.800080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06b0be-b13c-4706-8965-1ca49dc65bb5 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:24.819923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4e2ac-7772-4f25-8f17-4e9957ae670d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:24.822702 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4e2ac-7772-4f25-8f17-4e9957ae670d service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:24.825129 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4e2ac-7772-4f25-8f17-4e9957ae670d service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:24.825933 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4e2ac-7772-4f25-8f17-4e9957ae670d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:24.856948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4e2ac-7772-4f25-8f17-4e9957ae670d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:24.859864 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4e2ac-7772-4f25-8f17-4e9957ae670d service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:24.879176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 977/1976] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:02:25.453675 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1aae3-a722-43b6-adae-b1c0942b9c02 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:25.456845 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c4e1aae3-a722-43b6-adae-b1c0942b9c02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:25.484183 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1aae3-a722-43b6-adae-b1c0942b9c02 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:25.492382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db8bd1-7063-445a-aee0-6134f3e525b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:25.493329 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db8bd1-7063-445a-aee0-6134f3e525b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:25.493842 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db8bd1-7063-445a-aee0-6134f3e525b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:25.494111 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db8bd1-7063-445a-aee0-6134f3e525b1 admin admin] PATH_INFO: `/v3/projects/8fa23f4bf07a40128ceb0738dad4c37e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:25.496867 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db8bd1-7063-445a-aee0-6134f3e525b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa23f4bf07a40128ceb0738dad4c37e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:25.504980 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db8bd1-7063-445a-aee0-6134f3e525b1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:25.611769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4e2ac-7772-4f25-8f17-4e9957ae670d service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:25.613980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-49b4e2ac-7772-4f25-8f17-4e9957ae670d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:25.636570 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4e2ac-7772-4f25-8f17-4e9957ae670d service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:25.651916 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e0db8bd1-7063-445a-aee0-6134f3e525b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa23f4bf07a40128ceb0738dad4c37e', 'request_id': 'req-e0db8bd1-7063-445a-aee0-6134f3e525b1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:25.704272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e0db8bd1-7063-445a-aee0-6134f3e525b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa23f4bf07a40128ceb0738dad4c37e', 'request_id': 'req-e0db8bd1-7063-445a-aee0-6134f3e525b1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:25.718287 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e0db8bd1-7063-445a-aee0-6134f3e525b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa23f4bf07a40128ceb0738dad4c37e', 'request_id': 'req-e0db8bd1-7063-445a-aee0-6134f3e525b1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:25.770402 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e0db8bd1-7063-445a-aee0-6134f3e525b1 admin admin] The token cache is being invalidate because project 8fa23f4bf07a40128ceb0738dad4c37e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:25.770679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e0db8bd1-7063-445a-aee0-6134f3e525b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:25.771329 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e0db8bd1-7063-445a-aee0-6134f3e525b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:25.772946 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4262e13-4eb1-4b8f-bf70-f0e12ec9ac4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:25.773355 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1000/1977] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:25 2022] DELETE /identity/v3/projects/8fa23f4bf07a40128ceb0738dad4c37e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:25.774719 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4262e13-4eb1-4b8f-bf70-f0e12ec9ac4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:25.775276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4262e13-4eb1-4b8f-bf70-f0e12ec9ac4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:25.775635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db8bd1-7063-445a-aee0-6134f3e525b1 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:25.775785 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4262e13-4eb1-4b8f-bf70-f0e12ec9ac4b admin admin] PATH_INFO: `/v3/projects/f3b1deead3694a5eb3b65801a828e919` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:25.777368 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e0db8bd1-7063-445a-aee0-6134f3e525b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:25.777507 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4262e13-4eb1-4b8f-bf70-f0e12ec9ac4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b1deead3694a5eb3b65801a828e919)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:25.780556 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4262e13-4eb1-4b8f-bf70-f0e12ec9ac4b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:25.801053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db8bd1-7063-445a-aee0-6134f3e525b1 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:25.806383 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f4479-c6c1-40c1-b250-14a62061975d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:25.809194 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f4479-c6c1-40c1-b250-14a62061975d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:25.809856 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f4479-c6c1-40c1-b250-14a62061975d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:25.810522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f4479-c6c1-40c1-b250-14a62061975d admin admin] PATH_INFO: `/v3/users/1abf5cf28f394ab79246c07b6f31318f` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:25.812767 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f4479-c6c1-40c1-b250-14a62061975d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1abf5cf28f394ab79246c07b6f31318f)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:25.814842 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f4479-c6c1-40c1-b250-14a62061975d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:25.853585 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e4262e13-4eb1-4b8f-bf70-f0e12ec9ac4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b1deead3694a5eb3b65801a828e919', 'request_id': 'req-e4262e13-4eb1-4b8f-bf70-f0e12ec9ac4b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:25.863873 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e4262e13-4eb1-4b8f-bf70-f0e12ec9ac4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b1deead3694a5eb3b65801a828e919', 'request_id': 'req-e4262e13-4eb1-4b8f-bf70-f0e12ec9ac4b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:25.867088 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:25.877722 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e4262e13-4eb1-4b8f-bf70-f0e12ec9ac4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b1deead3694a5eb3b65801a828e919', 'request_id': 'req-e4262e13-4eb1-4b8f-bf70-f0e12ec9ac4b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:25.891003 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f41f4479-c6c1-40c1-b250-14a62061975d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1abf5cf28f394ab79246c07b6f31318f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:25.891895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e4262e13-4eb1-4b8f-bf70-f0e12ec9ac4b admin admin] The token cache is being invalidate because project f3b1deead3694a5eb3b65801a828e919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:25.892036 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f41f4479-c6c1-40c1-b250-14a62061975d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1abf5cf28f394ab79246c07b6f31318f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:25.892495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e4262e13-4eb1-4b8f-bf70-f0e12ec9ac4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:25.893147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e4262e13-4eb1-4b8f-bf70-f0e12ec9ac4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:25.895762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 978/1978] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:25 2022] DELETE /identity/v3/projects/f3b1deead3694a5eb3b65801a828e919 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:02:25.896607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4262e13-4eb1-4b8f-bf70-f0e12ec9ac4b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:25.907713 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f41f4479-c6c1-40c1-b250-14a62061975d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1abf5cf28f394ab79246c07b6f31318f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:25.910276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e4262e13-4eb1-4b8f-bf70-f0e12ec9ac4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:25.920973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f41f4479-c6c1-40c1-b250-14a62061975d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1abf5cf28f394ab79246c07b6f31318f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:25.922078 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f41f4479-c6c1-40c1-b250-14a62061975d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1abf5cf28f394ab79246c07b6f31318f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:25.929559 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:25.952901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1001/1979] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:25 2022] DELETE /identity/v3/users/1abf5cf28f394ab79246c07b6f31318f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:25.954365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a4b5e-bb21-45d4-869b-b4357061df74 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:25.954651 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a4b5e-bb21-45d4-869b-b4357061df74 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:25.954926 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a4b5e-bb21-45d4-869b-b4357061df74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:25.978624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-de1a4b5e-bb21-45d4-869b-b4357061df74 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:25.980607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-de1a4b5e-bb21-45d4-869b-b4357061df74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:25.990789 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4262e13-4eb1-4b8f-bf70-f0e12ec9ac4b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:26.066264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1002/1980] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:26.067932 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861060f2-844a-4aca-9986-3c65903e10c7 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:26.068278 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861060f2-844a-4aca-9986-3c65903e10c7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:26.068615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861060f2-844a-4aca-9986-3c65903e10c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:26.085501 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9432f1-209e-46f6-b236-27c278d5ba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:26.086460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9432f1-209e-46f6-b236-27c278d5ba05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:26.086832 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9432f1-209e-46f6-b236-27c278d5ba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:26.087117 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9432f1-209e-46f6-b236-27c278d5ba05 admin admin] PATH_INFO: `/v3/users/303d0958d9844fe3a2a6f174d617b7e2` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:26.088478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9432f1-209e-46f6-b236-27c278d5ba05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=303d0958d9844fe3a2a6f174d617b7e2)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:26.089671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-861060f2-844a-4aca-9986-3c65903e10c7 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:26.090635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9432f1-209e-46f6-b236-27c278d5ba05 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:26.091092 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-861060f2-844a-4aca-9986-3c65903e10c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:26.099339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1003/1981] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:26.104491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b2352-a355-411a-93ce-566237377627 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:26.104491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b2352-a355-411a-93ce-566237377627 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:26.104722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b2352-a355-411a-93ce-566237377627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:26.127281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9f8b2352-a355-411a-93ce-566237377627 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:26.128673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9f8b2352-a355-411a-93ce-566237377627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:26.138956 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1004/1982] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:26.139552 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b2352-a355-411a-93ce-566237377627 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:26.140854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9f8b2352-a355-411a-93ce-566237377627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:26.162421 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0e9432f1-209e-46f6-b236-27c278d5ba05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '303d0958d9844fe3a2a6f174d617b7e2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:26.163213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0e9432f1-209e-46f6-b236-27c278d5ba05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '303d0958d9844fe3a2a6f174d617b7e2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:26.174665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0e9432f1-209e-46f6-b236-27c278d5ba05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '303d0958d9844fe3a2a6f174d617b7e2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:26.190289 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0e9432f1-209e-46f6-b236-27c278d5ba05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '303d0958d9844fe3a2a6f174d617b7e2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:26.190790 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0e9432f1-209e-46f6-b236-27c278d5ba05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '303d0958d9844fe3a2a6f174d617b7e2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:26.218869 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 979/1983] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:25 2022] DELETE /identity/v3/users/303d0958d9844fe3a2a6f174d617b7e2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:26.218869 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9432f1-209e-46f6-b236-27c278d5ba05 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:26.220684 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0e9432f1-209e-46f6-b236-27c278d5ba05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:26.233891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b2352-a355-411a-93ce-566237377627 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:26.238907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:26.375520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ef744-36b5-49a7-92b1-20ca055546e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:26.376202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ef744-36b5-49a7-92b1-20ca055546e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:26.376493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ef744-36b5-49a7-92b1-20ca055546e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:26.376752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ef744-36b5-49a7-92b1-20ca055546e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:26.382441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-980ef744-36b5-49a7-92b1-20ca055546e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:26.390211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9432f1-209e-46f6-b236-27c278d5ba05 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:26.396920 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97605c6-745d-4b16-aa82-7d8be9cddeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:26.397681 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97605c6-745d-4b16-aa82-7d8be9cddeab admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:26.398007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97605c6-745d-4b16-aa82-7d8be9cddeab admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:26.398316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97605c6-745d-4b16-aa82-7d8be9cddeab admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:26.399079 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97605c6-745d-4b16-aa82-7d8be9cddeab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:26.399949 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97605c6-745d-4b16-aa82-7d8be9cddeab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:26.402919 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97605c6-745d-4b16-aa82-7d8be9cddeab admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:26.405997 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ef744-36b5-49a7-92b1-20ca055546e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:26.407493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ef744-36b5-49a7-92b1-20ca055546e0 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:26.442322 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 980/1984] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:26.447685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97605c6-745d-4b16-aa82-7d8be9cddeab admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:26.454216 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1005/1985] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:26.476711 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97605c6-745d-4b16-aa82-7d8be9cddeab admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:26.492020 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34023e-60b0-45ab-aba6-d15244139dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:26.492899 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34023e-60b0-45ab-aba6-d15244139dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:26.494533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34023e-60b0-45ab-aba6-d15244139dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:26.494874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34023e-60b0-45ab-aba6-d15244139dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:26.498122 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34023e-60b0-45ab-aba6-d15244139dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:26.504406 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34023e-60b0-45ab-aba6-d15244139dc8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:26.602676 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ef744-36b5-49a7-92b1-20ca055546e0 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:26.605257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-980ef744-36b5-49a7-92b1-20ca055546e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:26.605757 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 981/1986] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:26 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:26.611523 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34023e-60b0-45ab-aba6-d15244139dc8 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:26.637309 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ef744-36b5-49a7-92b1-20ca055546e0 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:26.715184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:26.720043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34023e-60b0-45ab-aba6-d15244139dc8 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:26.735102 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e807a36-2389-4e86-aa8a-173a61c22835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:26.738778 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e807a36-2389-4e86-aa8a-173a61c22835 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:26.739301 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e807a36-2389-4e86-aa8a-173a61c22835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:26.739739 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e807a36-2389-4e86-aa8a-173a61c22835 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:26.741007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e807a36-2389-4e86-aa8a-173a61c22835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:26.744764 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e807a36-2389-4e86-aa8a-173a61c22835 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:26.798042 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 982/1987] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:26 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:02:26.799378 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e807a36-2389-4e86-aa8a-173a61c22835 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:26.803746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6df10-7897-44ef-b4d1-98a730624159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:26.805082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6df10-7897-44ef-b4d1-98a730624159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:26.806046 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2e807a36-2389-4e86-aa8a-173a61c22835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:26.806236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6df10-7897-44ef-b4d1-98a730624159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:26.808399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6df10-7897-44ef-b4d1-98a730624159 admin admin] PATH_INFO: `/v3/users/4f525fc8753a4a4f835aa7c0b2637300` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:26.809107 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6df10-7897-44ef-b4d1-98a730624159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f525fc8753a4a4f835aa7c0b2637300)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:26.816617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6df10-7897-44ef-b4d1-98a730624159 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:26.836483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e807a36-2389-4e86-aa8a-173a61c22835 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:26.847240 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f83f88-c83c-4e4c-9eaa-50ef145bf259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:26.851037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f83f88-c83c-4e4c-9eaa-50ef145bf259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:26.851037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f83f88-c83c-4e4c-9eaa-50ef145bf259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:26.851037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f83f88-c83c-4e4c-9eaa-50ef145bf259 admin admin] PATH_INFO: `/v3/projects/7bce19f47a024453ae7ad5aa6cf6e8a3` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:26.853837 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f83f88-c83c-4e4c-9eaa-50ef145bf259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bce19f47a024453ae7ad5aa6cf6e8a3)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:26.858957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f83f88-c83c-4e4c-9eaa-50ef145bf259 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:26.907145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6fe6df10-7897-44ef-b4d1-98a730624159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f525fc8753a4a4f835aa7c0b2637300'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:26.908158 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6fe6df10-7897-44ef-b4d1-98a730624159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f525fc8753a4a4f835aa7c0b2637300'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:26.928886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6fe6df10-7897-44ef-b4d1-98a730624159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f525fc8753a4a4f835aa7c0b2637300'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:26.947275 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6fe6df10-7897-44ef-b4d1-98a730624159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f525fc8753a4a4f835aa7c0b2637300'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:26.948339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6fe6df10-7897-44ef-b4d1-98a730624159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f525fc8753a4a4f835aa7c0b2637300'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:26.972703 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b2f83f88-c83c-4e4c-9eaa-50ef145bf259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bce19f47a024453ae7ad5aa6cf6e8a3', 'request_id': 'req-b2f83f88-c83c-4e4c-9eaa-50ef145bf259'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:26.984711 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b2f83f88-c83c-4e4c-9eaa-50ef145bf259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bce19f47a024453ae7ad5aa6cf6e8a3', 'request_id': 'req-b2f83f88-c83c-4e4c-9eaa-50ef145bf259'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:26.986262 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1006/1988] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:26 2022] DELETE /identity/v3/users/4f525fc8753a4a4f835aa7c0b2637300 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:26.987239 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6df10-7897-44ef-b4d1-98a730624159 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:26.990781 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6fe6df10-7897-44ef-b4d1-98a730624159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:27.000755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b2f83f88-c83c-4e4c-9eaa-50ef145bf259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bce19f47a024453ae7ad5aa6cf6e8a3', 'request_id': 'req-b2f83f88-c83c-4e4c-9eaa-50ef145bf259'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:27.026690 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:27.037212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b2f83f88-c83c-4e4c-9eaa-50ef145bf259 admin admin] The token cache is being invalidate because project 7bce19f47a024453ae7ad5aa6cf6e8a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:27.037212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b2f83f88-c83c-4e4c-9eaa-50ef145bf259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:27.049445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b2f83f88-c83c-4e4c-9eaa-50ef145bf259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:27.053657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 983/1989] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:26 2022] DELETE /identity/v3/projects/7bce19f47a024453ae7ad5aa6cf6e8a3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:27.058414 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7d332-db9b-4a89-9d13-7268eb848bab None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.058414 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7d332-db9b-4a89-9d13-7268eb848bab None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.058414 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7d332-db9b-4a89-9d13-7268eb848bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.096908 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-46e7d332-db9b-4a89-9d13-7268eb848bab None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:27.099016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-46e7d332-db9b-4a89-9d13-7268eb848bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:27.129544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6df10-7897-44ef-b4d1-98a730624159 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:27.136843 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648b1b8-9dc1-494b-95de-b2ab61bf6197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:27.137577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648b1b8-9dc1-494b-95de-b2ab61bf6197 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.137891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648b1b8-9dc1-494b-95de-b2ab61bf6197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.138167 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648b1b8-9dc1-494b-95de-b2ab61bf6197 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.139082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648b1b8-9dc1-494b-95de-b2ab61bf6197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:27.140716 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648b1b8-9dc1-494b-95de-b2ab61bf6197 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:27.164651 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1007/1990] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:27.165624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648b1b8-9dc1-494b-95de-b2ab61bf6197 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:27.168022 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5648b1b8-9dc1-494b-95de-b2ab61bf6197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:27.184072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648b1b8-9dc1-494b-95de-b2ab61bf6197 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:27.189442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 984/1991] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:27.190737 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de43e0a-5b89-4aff-8f6d-dd7d9657c11e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.191023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de43e0a-5b89-4aff-8f6d-dd7d9657c11e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.191297 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de43e0a-5b89-4aff-8f6d-dd7d9657c11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.198606 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b142d62-38a1-481a-9ee1-339dcf709266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:27.198606 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b142d62-38a1-481a-9ee1-339dcf709266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.198606 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b142d62-38a1-481a-9ee1-339dcf709266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.198606 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b142d62-38a1-481a-9ee1-339dcf709266 admin admin] PATH_INFO: `/v3/projects/54d8329301c643f4b57709c8e412c0ea` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.198923 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b142d62-38a1-481a-9ee1-339dcf709266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d8329301c643f4b57709c8e412c0ea)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:27.199329 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b142d62-38a1-481a-9ee1-339dcf709266 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:27.218830 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-3de43e0a-5b89-4aff-8f6d-dd7d9657c11e None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:27.220071 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3de43e0a-5b89-4aff-8f6d-dd7d9657c11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:27.231625 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 985/1992] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:27.239223 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de43e0a-5b89-4aff-8f6d-dd7d9657c11e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:27.241197 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3de43e0a-5b89-4aff-8f6d-dd7d9657c11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:27.263923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de43e0a-5b89-4aff-8f6d-dd7d9657c11e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:27.265912 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:27.270220 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4b142d62-38a1-481a-9ee1-339dcf709266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d8329301c643f4b57709c8e412c0ea', 'request_id': 'req-4b142d62-38a1-481a-9ee1-339dcf709266'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:27.283896 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4b142d62-38a1-481a-9ee1-339dcf709266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d8329301c643f4b57709c8e412c0ea', 'request_id': 'req-4b142d62-38a1-481a-9ee1-339dcf709266'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:27.296725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4b142d62-38a1-481a-9ee1-339dcf709266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d8329301c643f4b57709c8e412c0ea', 'request_id': 'req-4b142d62-38a1-481a-9ee1-339dcf709266'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:27.315135 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4b142d62-38a1-481a-9ee1-339dcf709266 admin admin] The token cache is being invalidate because project 54d8329301c643f4b57709c8e412c0ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:27.315433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4b142d62-38a1-481a-9ee1-339dcf709266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:27.316215 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4b142d62-38a1-481a-9ee1-339dcf709266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:27.318536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1008/1993] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:27 2022] DELETE /identity/v3/projects/54d8329301c643f4b57709c8e412c0ea => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:27.322149 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b142d62-38a1-481a-9ee1-339dcf709266 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:27.323854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4b142d62-38a1-481a-9ee1-339dcf709266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:27.362406 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f233f-96d7-48b5-b902-0401e32fdb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:27.363400 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f233f-96d7-48b5-b902-0401e32fdb6b admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.363513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f233f-96d7-48b5-b902-0401e32fdb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.363860 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f233f-96d7-48b5-b902-0401e32fdb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.366548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f233f-96d7-48b5-b902-0401e32fdb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:27.368308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f233f-96d7-48b5-b902-0401e32fdb6b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:27.383756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 986/1994] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:27.389392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74628b7-86a7-44ea-8a17-63e5b1ca8eb1 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.389777 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74628b7-86a7-44ea-8a17-63e5b1ca8eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.390094 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74628b7-86a7-44ea-8a17-63e5b1ca8eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.405647 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b142d62-38a1-481a-9ee1-339dcf709266 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:27.409455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fa519-3a6c-42b1-9a37-cf2e88742118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:27.410216 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fa519-3a6c-42b1-9a37-cf2e88742118 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.410562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fa519-3a6c-42b1-9a37-cf2e88742118 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.410955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fa519-3a6c-42b1-9a37-cf2e88742118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.412870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d74628b7-86a7-44ea-8a17-63e5b1ca8eb1 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:27.413230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3f2fa519-3a6c-42b1-9a37-cf2e88742118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:27.414772 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d74628b7-86a7-44ea-8a17-63e5b1ca8eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:27.427879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fa519-3a6c-42b1-9a37-cf2e88742118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:27.429168 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 987/1995] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:27.429284 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fa519-3a6c-42b1-9a37-cf2e88742118 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:27.430587 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74628b7-86a7-44ea-8a17-63e5b1ca8eb1 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:27.432564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d74628b7-86a7-44ea-8a17-63e5b1ca8eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:27.441448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1009/1996] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:27.442309 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fa519-3a6c-42b1-9a37-cf2e88742118 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:27.443854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3f2fa519-3a6c-42b1-9a37-cf2e88742118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:27.457624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fa519-3a6c-42b1-9a37-cf2e88742118 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:27.462856 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0e37d-fef2-40b3-92d1-52319118b33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:27.464028 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0e37d-fef2-40b3-92d1-52319118b33b admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.464366 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0e37d-fef2-40b3-92d1-52319118b33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.464711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0e37d-fef2-40b3-92d1-52319118b33b admin admin] PATH_INFO: `/v3/projects/9f56ecf8c55d4db69eaa62e872d9f169/users/7de00142413f4f57b4782279bc826f4f/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.467293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74628b7-86a7-44ea-8a17-63e5b1ca8eb1 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:27.483473 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0e37d-fef2-40b3-92d1-52319118b33b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f56ecf8c55d4db69eaa62e872d9f169, user_id=7de00142413f4f57b4782279bc826f4f, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:27.484925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1994e-bb03-483b-9130-b4c14faa74cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:27.486395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0e37d-fef2-40b3-92d1-52319118b33b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:27.486660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1994e-bb03-483b-9130-b4c14faa74cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.487150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1994e-bb03-483b-9130-b4c14faa74cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.487637 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1994e-bb03-483b-9130-b4c14faa74cf admin admin] PATH_INFO: `/v3/users/e7d0bf9f517f47df898309515457c575` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.491272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1994e-bb03-483b-9130-b4c14faa74cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7d0bf9f517f47df898309515457c575)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:27.494192 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1994e-bb03-483b-9130-b4c14faa74cf admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:27.509292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1010/1997] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:27 2022] PUT /identity/v3/projects/9f56ecf8c55d4db69eaa62e872d9f169/users/7de00142413f4f57b4782279bc826f4f/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:27.513756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0e37d-fef2-40b3-92d1-52319118b33b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:27.618249 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c1c1994e-bb03-483b-9130-b4c14faa74cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7d0bf9f517f47df898309515457c575'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:27.619025 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c1c1994e-bb03-483b-9130-b4c14faa74cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7d0bf9f517f47df898309515457c575'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:27.630872 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c1c1994e-bb03-483b-9130-b4c14faa74cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7d0bf9f517f47df898309515457c575'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:27.645542 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0e37d-fef2-40b3-92d1-52319118b33b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:27.651050 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a2a08-cb24-4621-bf1e-7844066206eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:27.651802 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a2a08-cb24-4621-bf1e-7844066206eb admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.652079 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a2a08-cb24-4621-bf1e-7844066206eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.652495 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a2a08-cb24-4621-bf1e-7844066206eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.653202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a2a08-cb24-4621-bf1e-7844066206eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:27.653551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a2a08-cb24-4621-bf1e-7844066206eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:27.655389 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a2a08-cb24-4621-bf1e-7844066206eb admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:27.658008 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c1c1994e-bb03-483b-9130-b4c14faa74cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7d0bf9f517f47df898309515457c575'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:27.661113 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c1c1994e-bb03-483b-9130-b4c14faa74cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7d0bf9f517f47df898309515457c575'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:27.666513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:27.670689 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1011/1998] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:27.672999 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472ac5d-253a-4dee-b1a6-9ba3ef251fec None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.673516 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472ac5d-253a-4dee-b1a6-9ba3ef251fec None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.674124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472ac5d-253a-4dee-b1a6-9ba3ef251fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.696431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e472ac5d-253a-4dee-b1a6-9ba3ef251fec None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:27.698417 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e472ac5d-253a-4dee-b1a6-9ba3ef251fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:27.698606 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 988/1999] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:27 2022] DELETE /identity/v3/users/e7d0bf9f517f47df898309515457c575 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:27.699737 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1994e-bb03-483b-9130-b4c14faa74cf admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:27.705272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c1c1994e-bb03-483b-9130-b4c14faa74cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:27.790109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:27.821918 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1012/2000] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:27.842882 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1994e-bb03-483b-9130-b4c14faa74cf admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:27.850254 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c3abc-f13e-4d8d-ab51-1f0e30211841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:27.851181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c3abc-f13e-4d8d-ab51-1f0e30211841 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:27.851491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c3abc-f13e-4d8d-ab51-1f0e30211841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:27.852037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c3abc-f13e-4d8d-ab51-1f0e30211841 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:27.852757 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c3abc-f13e-4d8d-ab51-1f0e30211841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:27.856193 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c3abc-f13e-4d8d-ab51-1f0e30211841 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:27.858879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472ac5d-253a-4dee-b1a6-9ba3ef251fec None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:27.860679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e472ac5d-253a-4dee-b1a6-9ba3ef251fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:27.931429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 989/2001] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:27 2022] POST /identity/v3/projects => generated 377 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:27.933341 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c3abc-f13e-4d8d-ab51-1f0e30211841 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:27.992886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472ac5d-253a-4dee-b1a6-9ba3ef251fec None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:28.089196 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c3abc-f13e-4d8d-ab51-1f0e30211841 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:28.107323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd19dbd-84c6-4a5c-9113-76e5e6836917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:28.108206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd19dbd-84c6-4a5c-9113-76e5e6836917 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.108330 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd19dbd-84c6-4a5c-9113-76e5e6836917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.108557 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd19dbd-84c6-4a5c-9113-76e5e6836917 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.109265 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd19dbd-84c6-4a5c-9113-76e5e6836917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:28.113872 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd19dbd-84c6-4a5c-9113-76e5e6836917 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:28.134798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5486fde-10e4-4490-9bec-d23e8cd7f580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:28.138403 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5486fde-10e4-4490-9bec-d23e8cd7f580 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.139302 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5486fde-10e4-4490-9bec-d23e8cd7f580 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.139607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5486fde-10e4-4490-9bec-d23e8cd7f580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.166118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 990/2002] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:27 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:28.166118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd19dbd-84c6-4a5c-9113-76e5e6836917 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:28.169222 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1fd19dbd-84c6-4a5c-9113-76e5e6836917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:28.195641 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5486fde-10e4-4490-9bec-d23e8cd7f580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:28.197105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5486fde-10e4-4490-9bec-d23e8cd7f580 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:28.200992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd19dbd-84c6-4a5c-9113-76e5e6836917 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:28.222937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84eec2-f545-4c61-ab95-59d02decf846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:28.224322 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84eec2-f545-4c61-ab95-59d02decf846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.224779 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84eec2-f545-4c61-ab95-59d02decf846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.225232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84eec2-f545-4c61-ab95-59d02decf846 admin admin] PATH_INFO: `/v3/projects/b902341f1ffe42dc9904c60dcae231f1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.226779 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84eec2-f545-4c61-ab95-59d02decf846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b902341f1ffe42dc9904c60dcae231f1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:28.228230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1013/2003] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:28.229249 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5486fde-10e4-4490-9bec-d23e8cd7f580 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:28.231167 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84eec2-f545-4c61-ab95-59d02decf846 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:28.245624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5486fde-10e4-4490-9bec-d23e8cd7f580 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:28.256249 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813beca-8f9f-4148-bbc5-f7d725890162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:28.256733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813beca-8f9f-4148-bbc5-f7d725890162 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.257011 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813beca-8f9f-4148-bbc5-f7d725890162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.257323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813beca-8f9f-4148-bbc5-f7d725890162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.258085 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813beca-8f9f-4148-bbc5-f7d725890162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:28.260361 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813beca-8f9f-4148-bbc5-f7d725890162 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:28.287428 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1014/2004] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:28.298980 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813beca-8f9f-4148-bbc5-f7d725890162 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:28.334926 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813beca-8f9f-4148-bbc5-f7d725890162 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:28.363315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4c84eec2-f545-4c61-ab95-59d02decf846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b902341f1ffe42dc9904c60dcae231f1', 'request_id': 'req-4c84eec2-f545-4c61-ab95-59d02decf846'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:28.374575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4c84eec2-f545-4c61-ab95-59d02decf846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b902341f1ffe42dc9904c60dcae231f1', 'request_id': 'req-4c84eec2-f545-4c61-ab95-59d02decf846'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:28.384665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:DELETE=8,keystone:SELECT=87,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:28.396774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4c84eec2-f545-4c61-ab95-59d02decf846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b902341f1ffe42dc9904c60dcae231f1', 'request_id': 'req-4c84eec2-f545-4c61-ab95-59d02decf846'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:28.439740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4c84eec2-f545-4c61-ab95-59d02decf846 admin admin] The token cache is being invalidate because project b902341f1ffe42dc9904c60dcae231f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:28.440034 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4c84eec2-f545-4c61-ab95-59d02decf846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:28.440894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4c84eec2-f545-4c61-ab95-59d02decf846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:28.445362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 991/2005] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:28 2022] DELETE /identity/v3/projects/b902341f1ffe42dc9904c60dcae231f1 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:28.451016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84eec2-f545-4c61-ab95-59d02decf846 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:28.453192 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4c84eec2-f545-4c61-ab95-59d02decf846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:28.454522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae60dd-928e-440d-be2a-1fcd01ce7c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:28.455472 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae60dd-928e-440d-be2a-1fcd01ce7c58 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.456671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae60dd-928e-440d-be2a-1fcd01ce7c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.456954 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae60dd-928e-440d-be2a-1fcd01ce7c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.460475 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae60dd-928e-440d-be2a-1fcd01ce7c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:28.463971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae60dd-928e-440d-be2a-1fcd01ce7c58 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:28.471544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84eec2-f545-4c61-ab95-59d02decf846 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:28.478693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cff5aa-d1ae-4325-9324-1f97c2d51b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:28.480907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cff5aa-d1ae-4325-9324-1f97c2d51b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.481748 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cff5aa-d1ae-4325-9324-1f97c2d51b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.482258 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cff5aa-d1ae-4325-9324-1f97c2d51b31 admin admin] PATH_INFO: `/v3/users/dbee715ec86945e688d1b3c381a91b82` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.485955 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cff5aa-d1ae-4325-9324-1f97c2d51b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbee715ec86945e688d1b3c381a91b82)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:28.488461 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cff5aa-d1ae-4325-9324-1f97c2d51b31 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:28.491895 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1015/2006] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:28.492173 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae60dd-928e-440d-be2a-1fcd01ce7c58 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:28.499727 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-69ae60dd-928e-440d-be2a-1fcd01ce7c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:28.527275 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae60dd-928e-440d-be2a-1fcd01ce7c58 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:28.539936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed8d15-3e99-408d-a33f-50093f70d509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:28.540861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed8d15-3e99-408d-a33f-50093f70d509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.541223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed8d15-3e99-408d-a33f-50093f70d509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.541518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed8d15-3e99-408d-a33f-50093f70d509 admin admin] PATH_INFO: `/v3/projects/6ae4d74e87694f718abcc7efda2bce9f` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.553206 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed8d15-3e99-408d-a33f-50093f70d509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae4d74e87694f718abcc7efda2bce9f)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:28.581861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed8d15-3e99-408d-a33f-50093f70d509 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:28.667122 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c2cff5aa-d1ae-4325-9324-1f97c2d51b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbee715ec86945e688d1b3c381a91b82'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:28.670749 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c2cff5aa-d1ae-4325-9324-1f97c2d51b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbee715ec86945e688d1b3c381a91b82'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:28.674807 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:28.693936 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c2cff5aa-d1ae-4325-9324-1f97c2d51b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbee715ec86945e688d1b3c381a91b82'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:28.727389 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f7ed8d15-3e99-408d-a33f-50093f70d509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae4d74e87694f718abcc7efda2bce9f', 'request_id': 'req-f7ed8d15-3e99-408d-a33f-50093f70d509'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:28.735982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c2cff5aa-d1ae-4325-9324-1f97c2d51b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbee715ec86945e688d1b3c381a91b82'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:28.737250 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c2cff5aa-d1ae-4325-9324-1f97c2d51b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbee715ec86945e688d1b3c381a91b82'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:28.743738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f7ed8d15-3e99-408d-a33f-50093f70d509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae4d74e87694f718abcc7efda2bce9f', 'request_id': 'req-f7ed8d15-3e99-408d-a33f-50093f70d509'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:28.755728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f7ed8d15-3e99-408d-a33f-50093f70d509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae4d74e87694f718abcc7efda2bce9f', 'request_id': 'req-f7ed8d15-3e99-408d-a33f-50093f70d509'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:28.769815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 992/2007] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:28 2022] DELETE /identity/v3/users/dbee715ec86945e688d1b3c381a91b82 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:28.772398 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cff5aa-d1ae-4325-9324-1f97c2d51b31 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:28.774614 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c2cff5aa-d1ae-4325-9324-1f97c2d51b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:28.776695 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f7ed8d15-3e99-408d-a33f-50093f70d509 admin admin] The token cache is being invalidate because project 6ae4d74e87694f718abcc7efda2bce9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:28.777062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f7ed8d15-3e99-408d-a33f-50093f70d509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:28.777784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f7ed8d15-3e99-408d-a33f-50093f70d509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:28.785136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1016/2008] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:28 2022] DELETE /identity/v3/projects/6ae4d74e87694f718abcc7efda2bce9f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:28.786820 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806a85e-848f-4ac0-9836-726148524f07 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.787108 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806a85e-848f-4ac0-9836-726148524f07 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.787385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806a85e-848f-4ac0-9836-726148524f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.815481 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c806a85e-848f-4ac0-9836-726148524f07 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:28.816847 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c806a85e-848f-4ac0-9836-726148524f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:28.870234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cff5aa-d1ae-4325-9324-1f97c2d51b31 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:28.878837 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882f46f-1f07-4a4d-95c4-94e6742c707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:28.880247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f46f-1f07-4a4d-95c4-94e6742c707e admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.880636 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f46f-1f07-4a4d-95c4-94e6742c707e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.881021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f46f-1f07-4a4d-95c4-94e6742c707e admin admin] PATH_INFO: `/v3/projects/ca4036e0ba744e259e06c68041dacb2e/users/bd3a54a9802647a4becbfcfb0450ed3d/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.904249 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882f46f-1f07-4a4d-95c4-94e6742c707e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4036e0ba744e259e06c68041dacb2e, user_id=bd3a54a9802647a4becbfcfb0450ed3d, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:28.911044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882f46f-1f07-4a4d-95c4-94e6742c707e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:28.941671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 993/2009] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:28 2022] PUT /identity/v3/projects/ca4036e0ba744e259e06c68041dacb2e/users/bd3a54a9802647a4becbfcfb0450ed3d/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:28.945547 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1017/2010] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:28.954133 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c797bb-dc52-4f10-856c-02228d53249f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.954490 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c797bb-dc52-4f10-856c-02228d53249f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.954687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c797bb-dc52-4f10-856c-02228d53249f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.961080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5ce09-7dd9-41d6-a291-4c33d5bd3fef None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:28.962370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5ce09-7dd9-41d6-a291-4c33d5bd3fef None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:28.963722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5ce09-7dd9-41d6-a291-4c33d5bd3fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:28.999111 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-18c797bb-dc52-4f10-856c-02228d53249f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:29.000822 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-18c797bb-dc52-4f10-856c-02228d53249f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:29.015033 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-38b5ce09-7dd9-41d6-a291-4c33d5bd3fef None None] MFA Rules not processed for user `bd3a54a9802647a4becbfcfb0450ed3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:29.016425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-38b5ce09-7dd9-41d6-a291-4c33d5bd3fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:29.113052 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1018/2011] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:29.127565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5ce09-7dd9-41d6-a291-4c33d5bd3fef None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:29.130682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:29.140058 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-38b5ce09-7dd9-41d6-a291-4c33d5bd3fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:29.203230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 994/2012] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:29.209242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c797bb-dc52-4f10-856c-02228d53249f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:29.221768 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c797bb-dc52-4f10-856c-02228d53249f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:29.228308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c88fc-0122-4046-9588-8aeef8d9a380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:29.229251 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c88fc-0122-4046-9588-8aeef8d9a380 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:29.229598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c88fc-0122-4046-9588-8aeef8d9a380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:29.230335 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c88fc-0122-4046-9588-8aeef8d9a380 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:29.230975 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c88fc-0122-4046-9588-8aeef8d9a380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:29.232680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c88fc-0122-4046-9588-8aeef8d9a380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:29.233391 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c88fc-0122-4046-9588-8aeef8d9a380 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:29.274755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 995/2013] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:29.276149 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c88fc-0122-4046-9588-8aeef8d9a380 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:29.278811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:29.295084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c88fc-0122-4046-9588-8aeef8d9a380 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:29.302495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98bd2d-7627-4ff0-aea4-f40f432a44ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:29.304568 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98bd2d-7627-4ff0-aea4-f40f432a44ad admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:29.305043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98bd2d-7627-4ff0-aea4-f40f432a44ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:29.305502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98bd2d-7627-4ff0-aea4-f40f432a44ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:29.308321 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98bd2d-7627-4ff0-aea4-f40f432a44ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:29.312024 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98bd2d-7627-4ff0-aea4-f40f432a44ad admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:29.314953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5ce09-7dd9-41d6-a291-4c33d5bd3fef None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:29.325860 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802175a0-bb7f-42f8-97cb-1a296a4e8be0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1b010003c44dc19643558167424d13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:29.326909 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802175a0-bb7f-42f8-97cb-1a296a4e8be0 service glance] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:29.327804 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802175a0-bb7f-42f8-97cb-1a296a4e8be0 service glance] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:29.328084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802175a0-bb7f-42f8-97cb-1a296a4e8be0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:29.361068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802175a0-bb7f-42f8-97cb-1a296a4e8be0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:29.364065 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802175a0-bb7f-42f8-97cb-1a296a4e8be0 service glance] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:29.399308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 996/2014] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:29 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:29.401909 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1019/2015] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:29.403815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98bd2d-7627-4ff0-aea4-f40f432a44ad admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:29.483224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802175a0-bb7f-42f8-97cb-1a296a4e8be0 service glance] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:29.484566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-802175a0-bb7f-42f8-97cb-1a296a4e8be0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:29.511155 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802175a0-bb7f-42f8-97cb-1a296a4e8be0 service glance] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:29.537653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab1ac1-ccd4-453b-bae4-3c47322703d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:29.538668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab1ac1-ccd4-453b-bae4-3c47322703d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:29.538785 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab1ac1-ccd4-453b-bae4-3c47322703d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:29.539095 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab1ac1-ccd4-453b-bae4-3c47322703d5 admin admin] PATH_INFO: `/v3/projects/8078d77c735c4a61b5f0d1e49b27cb48` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:29.540671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab1ac1-ccd4-453b-bae4-3c47322703d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8078d77c735c4a61b5f0d1e49b27cb48)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:29.543710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab1ac1-ccd4-453b-bae4-3c47322703d5 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:29.547885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98bd2d-7627-4ff0-aea4-f40f432a44ad admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:29.555003 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8825be1-ed2d-49e7-83ae-4937b457c1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:29.555785 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8825be1-ed2d-49e7-83ae-4937b457c1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:29.556329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8825be1-ed2d-49e7-83ae-4937b457c1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:29.556895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8825be1-ed2d-49e7-83ae-4937b457c1d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:29.557807 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8825be1-ed2d-49e7-83ae-4937b457c1d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:29.560640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8825be1-ed2d-49e7-83ae-4937b457c1d3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:29.605773 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 997/2016] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:29 2022] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:02:29.606985 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8825be1-ed2d-49e7-83ae-4937b457c1d3 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:29.633124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8825be1-ed2d-49e7-83ae-4937b457c1d3 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:29.662918 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352e0a6-ac84-4bd5-b3f2-e9d80d083883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:29.663308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352e0a6-ac84-4bd5-b3f2-e9d80d083883 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:29.663616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352e0a6-ac84-4bd5-b3f2-e9d80d083883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:29.663859 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352e0a6-ac84-4bd5-b3f2-e9d80d083883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:29.664599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352e0a6-ac84-4bd5-b3f2-e9d80d083883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:29.666316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352e0a6-ac84-4bd5-b3f2-e9d80d083883 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:29.676605 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-80ab1ac1-ccd4-453b-bae4-3c47322703d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8078d77c735c4a61b5f0d1e49b27cb48', 'request_id': 'req-80ab1ac1-ccd4-453b-bae4-3c47322703d5'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:29.706993 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-80ab1ac1-ccd4-453b-bae4-3c47322703d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8078d77c735c4a61b5f0d1e49b27cb48', 'request_id': 'req-80ab1ac1-ccd4-453b-bae4-3c47322703d5'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:29.713848 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 998/2017] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:29.713848 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352e0a6-ac84-4bd5-b3f2-e9d80d083883 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:29.729718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-80ab1ac1-ccd4-453b-bae4-3c47322703d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8078d77c735c4a61b5f0d1e49b27cb48', 'request_id': 'req-80ab1ac1-ccd4-453b-bae4-3c47322703d5'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:29.740523 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352e0a6-ac84-4bd5-b3f2-e9d80d083883 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:29.796014 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-80ab1ac1-ccd4-453b-bae4-3c47322703d5 admin admin] The token cache is being invalidate because project 8078d77c735c4a61b5f0d1e49b27cb48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:29.796680 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-80ab1ac1-ccd4-453b-bae4-3c47322703d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:29.798172 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-80ab1ac1-ccd4-453b-bae4-3c47322703d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:29.800313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1020/2018] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:29 2022] DELETE /identity/v3/projects/8078d77c735c4a61b5f0d1e49b27cb48 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:29.805072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9975c7-347c-47a9-9ea6-cdd1ecbb046c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:29.805369 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9975c7-347c-47a9-9ea6-cdd1ecbb046c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:29.805648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9975c7-347c-47a9-9ea6-cdd1ecbb046c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:29.845868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d233b3-f409-4b2f-8c91-43c8e7b87e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:29.846761 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d233b3-f409-4b2f-8c91-43c8e7b87e48 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:29.847157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d233b3-f409-4b2f-8c91-43c8e7b87e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:29.847321 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d233b3-f409-4b2f-8c91-43c8e7b87e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:29.848101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d233b3-f409-4b2f-8c91-43c8e7b87e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:29.849837 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d233b3-f409-4b2f-8c91-43c8e7b87e48 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:29.867688 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-0a9975c7-347c-47a9-9ea6-cdd1ecbb046c None None] MFA Rules not processed for user `7de00142413f4f57b4782279bc826f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:29.867688 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-0a9975c7-347c-47a9-9ea6-cdd1ecbb046c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:29.874304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 999/2019] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:29.874304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7d5be-0858-46d0-ac93-e2cfe209685f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:29.874304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7d5be-0858-46d0-ac93-e2cfe209685f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:29.874304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7d5be-0858-46d0-ac93-e2cfe209685f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:29.898545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-c9a7d5be-0858-46d0-ac93-e2cfe209685f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:29.899793 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c9a7d5be-0858-46d0-ac93-e2cfe209685f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:29.915815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1000/2020] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:29.917374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7d5be-0858-46d0-ac93-e2cfe209685f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:29.919646 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c9a7d5be-0858-46d0-ac93-e2cfe209685f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:29.937252 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7d5be-0858-46d0-ac93-e2cfe209685f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:29.943853 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de8f1b-3c3a-479f-a9c2-5cc18eb16d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:29.944787 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de8f1b-3c3a-479f-a9c2-5cc18eb16d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:29.945147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de8f1b-3c3a-479f-a9c2-5cc18eb16d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:29.945490 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de8f1b-3c3a-479f-a9c2-5cc18eb16d00 admin admin] PATH_INFO: `/v3/projects/26099bd013e64994beea6fafdfa0700b/users/743d272d962c4803887181a4ee9ac651/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:29.970607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de8f1b-3c3a-479f-a9c2-5cc18eb16d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26099bd013e64994beea6fafdfa0700b, user_id=743d272d962c4803887181a4ee9ac651, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:29.974035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de8f1b-3c3a-479f-a9c2-5cc18eb16d00 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:29.978889 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:30.002376 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1021/2021] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:30.004151 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96447a35-8251-4e7b-b306-4e0f408e7abf None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:30.004441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96447a35-8251-4e7b-b306-4e0f408e7abf None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:30.004717 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96447a35-8251-4e7b-b306-4e0f408e7abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:30.005774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1001/2022] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:29 2022] PUT /identity/v3/projects/26099bd013e64994beea6fafdfa0700b/users/743d272d962c4803887181a4ee9ac651/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:30.025509 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e435c2d-d9eb-45a5-926c-28d511a70feb None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:30.026429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e435c2d-d9eb-45a5-926c-28d511a70feb None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:30.026977 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e435c2d-d9eb-45a5-926c-28d511a70feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:30.043862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-96447a35-8251-4e7b-b306-4e0f408e7abf None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:30.045137 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-96447a35-8251-4e7b-b306-4e0f408e7abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:30.065479 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-1e435c2d-d9eb-45a5-926c-28d511a70feb None None] MFA Rules not processed for user `743d272d962c4803887181a4ee9ac651`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:30.066891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1e435c2d-d9eb-45a5-926c-28d511a70feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:30.154946 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:30.180281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1022/2023] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:30.185532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96447a35-8251-4e7b-b306-4e0f408e7abf None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:30.189296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-96447a35-8251-4e7b-b306-4e0f408e7abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:30.190753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1002/2024] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:30.191673 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e435c2d-d9eb-45a5-926c-28d511a70feb None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:30.210186 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e435c2d-d9eb-45a5-926c-28d511a70feb None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:30.216655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33b529-27a1-450f-a902-1ee05d9466eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:30.217348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33b529-27a1-450f-a902-1ee05d9466eb admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:30.217617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33b529-27a1-450f-a902-1ee05d9466eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:30.217928 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33b529-27a1-450f-a902-1ee05d9466eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:30.218677 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33b529-27a1-450f-a902-1ee05d9466eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:30.218991 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33b529-27a1-450f-a902-1ee05d9466eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:30.220794 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33b529-27a1-450f-a902-1ee05d9466eb admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:30.237227 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1003/2025] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:30.238774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33b529-27a1-450f-a902-1ee05d9466eb admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:30.252789 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33b529-27a1-450f-a902-1ee05d9466eb admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:30.258302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeefb22-c1c2-4de9-bbd2-acedbaaefe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:30.259120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeefb22-c1c2-4de9-bbd2-acedbaaefe77 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:30.259609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeefb22-c1c2-4de9-bbd2-acedbaaefe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:30.260101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeefb22-c1c2-4de9-bbd2-acedbaaefe77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:30.261624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeefb22-c1c2-4de9-bbd2-acedbaaefe77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:30.264856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeefb22-c1c2-4de9-bbd2-acedbaaefe77 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:30.303183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1004/2026] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:30 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:30.304025 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeefb22-c1c2-4de9-bbd2-acedbaaefe77 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:30.315053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96447a35-8251-4e7b-b306-4e0f408e7abf None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:30.374260 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62c067-4a29-49ee-a82d-2e80a76f787e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:30.374914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62c067-4a29-49ee-a82d-2e80a76f787e service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:30.375196 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62c067-4a29-49ee-a82d-2e80a76f787e service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:30.375465 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62c067-4a29-49ee-a82d-2e80a76f787e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:30.381826 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeefb22-c1c2-4de9-bbd2-acedbaaefe77 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:30.389548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1270480-4958-4bb2-b32b-e51e3c6d0d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:30.389548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1270480-4958-4bb2-b32b-e51e3c6d0d8c admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:30.389548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1270480-4958-4bb2-b32b-e51e3c6d0d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:30.389548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1270480-4958-4bb2-b32b-e51e3c6d0d8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:30.390198 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1270480-4958-4bb2-b32b-e51e3c6d0d8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:30.390782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1270480-4958-4bb2-b32b-e51e3c6d0d8c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:30.421852 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1005/2027] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:30 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:30.424084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1270480-4958-4bb2-b32b-e51e3c6d0d8c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:30.454655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62c067-4a29-49ee-a82d-2e80a76f787e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:30.456103 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62c067-4a29-49ee-a82d-2e80a76f787e service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:30.467370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1023/2028] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:30.468202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62c067-4a29-49ee-a82d-2e80a76f787e service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:30.479143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62c067-4a29-49ee-a82d-2e80a76f787e service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:30.497074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:30.534763 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1270480-4958-4bb2-b32b-e51e3c6d0d8c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:30.540888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f974b-670c-40fd-9599-ddee3cacc418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:30.541763 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f974b-670c-40fd-9599-ddee3cacc418 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:30.542077 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f974b-670c-40fd-9599-ddee3cacc418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:30.542346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f974b-670c-40fd-9599-ddee3cacc418 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:30.543806 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f974b-670c-40fd-9599-ddee3cacc418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:30.545092 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f974b-670c-40fd-9599-ddee3cacc418 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:30.561330 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60913057-17bb-40f9-8315-b5b71769bec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:30.563546 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60913057-17bb-40f9-8315-b5b71769bec4 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:30.563842 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60913057-17bb-40f9-8315-b5b71769bec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:30.565696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60913057-17bb-40f9-8315-b5b71769bec4 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:30.566385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60913057-17bb-40f9-8315-b5b71769bec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:30.570989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60913057-17bb-40f9-8315-b5b71769bec4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:30.576622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1006/2029] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:30 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:30.581461 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f974b-670c-40fd-9599-ddee3cacc418 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:30.596370 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f974b-670c-40fd-9599-ddee3cacc418 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:30.600367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:30.602837 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9a743-2406-4933-9ac3-0de8c974b99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:30.604045 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9a743-2406-4933-9ac3-0de8c974b99c admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:30.604972 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9a743-2406-4933-9ac3-0de8c974b99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:30.605450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9a743-2406-4933-9ac3-0de8c974b99c admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:30.606465 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9a743-2406-4933-9ac3-0de8c974b99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:30.608284 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9a743-2406-4933-9ac3-0de8c974b99c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:30.612377 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1024/2030] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:30 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:30.617041 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60913057-17bb-40f9-8315-b5b71769bec4 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:30.621365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1007/2031] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:02:30.626248 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9a743-2406-4933-9ac3-0de8c974b99c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:30.637304 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60913057-17bb-40f9-8315-b5b71769bec4 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:30.644033 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa06e6-76f1-45cf-a685-90c9ae5ad426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:30.644719 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa06e6-76f1-45cf-a685-90c9ae5ad426 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:30.645047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa06e6-76f1-45cf-a685-90c9ae5ad426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:30.645321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa06e6-76f1-45cf-a685-90c9ae5ad426 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:30.646259 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa06e6-76f1-45cf-a685-90c9ae5ad426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:30.648537 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa06e6-76f1-45cf-a685-90c9ae5ad426 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:30.655580 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9a743-2406-4933-9ac3-0de8c974b99c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:30.662471 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1025/2032] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:30.668697 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa06e6-76f1-45cf-a685-90c9ae5ad426 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:30.673426 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50375d-5312-48ce-90f5-d6747ad3ca80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:30.675151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50375d-5312-48ce-90f5-d6747ad3ca80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:30.675151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50375d-5312-48ce-90f5-d6747ad3ca80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:30.675493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50375d-5312-48ce-90f5-d6747ad3ca80 admin admin] PATH_INFO: `/v3/projects/1c85dbf4112446eca69847c52d1ee4cc/users/8bcc6d9085c6440db14f7386f5c40df9/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:30.686870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa06e6-76f1-45cf-a685-90c9ae5ad426 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:30.695229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ec792-5c35-4a13-834a-13ddb9668bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:30.695883 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ec792-5c35-4a13-834a-13ddb9668bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:30.696287 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ec792-5c35-4a13-834a-13ddb9668bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:30.696380 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ec792-5c35-4a13-834a-13ddb9668bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:30.696647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50375d-5312-48ce-90f5-d6747ad3ca80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c85dbf4112446eca69847c52d1ee4cc, user_id=8bcc6d9085c6440db14f7386f5c40df9, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:30.697486 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ec792-5c35-4a13-834a-13ddb9668bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:30.699552 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ec792-5c35-4a13-834a-13ddb9668bc6 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:30.700350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50375d-5312-48ce-90f5-d6747ad3ca80 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:30.714438 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1026/2033] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:02:30.720232 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ec792-5c35-4a13-834a-13ddb9668bc6 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:30.732810 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1008/2034] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:30 2022] PUT /identity/v3/projects/1c85dbf4112446eca69847c52d1ee4cc/users/8bcc6d9085c6440db14f7386f5c40df9/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:02:30.733991 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50375d-5312-48ce-90f5-d6747ad3ca80 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:30.735934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ec792-5c35-4a13-834a-13ddb9668bc6 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:30.812846 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb28ff-9045-4a33-a27b-7a7cf99853b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:30.813857 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb28ff-9045-4a33-a27b-7a7cf99853b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:30.814147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb28ff-9045-4a33-a27b-7a7cf99853b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:30.814489 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb28ff-9045-4a33-a27b-7a7cf99853b6 admin admin] PATH_INFO: `/v3/projects/f2896d463bc34fec828445fda2d97b24/users/bc22a509598b4975a3362f8272aeddd6/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:30.821951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50375d-5312-48ce-90f5-d6747ad3ca80 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:30.829840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcdb74-793f-42da-8d9b-019739b9df54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:30.829840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcdb74-793f-42da-8d9b-019739b9df54 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:30.829840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcdb74-793f-42da-8d9b-019739b9df54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:30.829840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcdb74-793f-42da-8d9b-019739b9df54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:30.830339 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcdb74-793f-42da-8d9b-019739b9df54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:30.832032 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcdb74-793f-42da-8d9b-019739b9df54 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:30.845489 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb28ff-9045-4a33-a27b-7a7cf99853b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2896d463bc34fec828445fda2d97b24, user_id=bc22a509598b4975a3362f8272aeddd6, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:30.848288 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb28ff-9045-4a33-a27b-7a7cf99853b6 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:30.850139 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1009/2035] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:30.864800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1027/2036] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:30 2022] PUT /identity/v3/projects/f2896d463bc34fec828445fda2d97b24/users/bc22a509598b4975a3362f8272aeddd6/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:02:30.872598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcdb74-793f-42da-8d9b-019739b9df54 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:30.882091 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddc1c3-9a22-43bc-99ad-665da86537de None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:30.882386 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddc1c3-9a22-43bc-99ad-665da86537de None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:30.882671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddc1c3-9a22-43bc-99ad-665da86537de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:30.897724 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcdb74-793f-42da-8d9b-019739b9df54 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:30.966684 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9fddc1c3-9a22-43bc-99ad-665da86537de None None] MFA Rules not processed for user `bc22a509598b4975a3362f8272aeddd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:30.968609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9fddc1c3-9a22-43bc-99ad-665da86537de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:31.005602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979592b-450c-4cb2-a105-378833db027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:31.006662 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979592b-450c-4cb2-a105-378833db027f admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:31.007052 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979592b-450c-4cb2-a105-378833db027f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:31.007575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979592b-450c-4cb2-a105-378833db027f admin admin] PATH_INFO: `/v3/projects/1c85dbf4112446eca69847c52d1ee4cc/users/8bcc6d9085c6440db14f7386f5c40df9/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:31.010661 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979592b-450c-4cb2-a105-378833db027f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c85dbf4112446eca69847c52d1ee4cc, user_id=8bcc6d9085c6440db14f7386f5c40df9, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:31.013101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979592b-450c-4cb2-a105-378833db027f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:31.035137 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1010/2037] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:30 2022] PUT /identity/v3/projects/1c85dbf4112446eca69847c52d1ee4cc/users/8bcc6d9085c6440db14f7386f5c40df9/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:31.046590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2cb82-1a30-4748-91ca-caa6edcaedc6 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:31.047621 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2cb82-1a30-4748-91ca-caa6edcaedc6 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:31.048418 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2cb82-1a30-4748-91ca-caa6edcaedc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:31.091420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-c6f2cb82-1a30-4748-91ca-caa6edcaedc6 None None] MFA Rules not processed for user `8bcc6d9085c6440db14f7386f5c40df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:31.092654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c6f2cb82-1a30-4748-91ca-caa6edcaedc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:31.103020 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:31.109788 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1028/2038] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:31.114443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddc1c3-9a22-43bc-99ad-665da86537de None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:31.128666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddc1c3-9a22-43bc-99ad-665da86537de None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:31.192499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1011/2039] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:02:31.209901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:31.210084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2cb82-1a30-4748-91ca-caa6edcaedc6 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:31.210084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c6f2cb82-1a30-4748-91ca-caa6edcaedc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:31.236983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece7485-8c24-4ea4-96f6-379c9d9d759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:31.238008 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece7485-8c24-4ea4-96f6-379c9d9d759d admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:31.238447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece7485-8c24-4ea4-96f6-379c9d9d759d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:31.238900 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece7485-8c24-4ea4-96f6-379c9d9d759d admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:31.239935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece7485-8c24-4ea4-96f6-379c9d9d759d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:31.242665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece7485-8c24-4ea4-96f6-379c9d9d759d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:31.281456 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1029/2040] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:31 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:02:31.285567 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece7485-8c24-4ea4-96f6-379c9d9d759d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:31.301136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2cb82-1a30-4748-91ca-caa6edcaedc6 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:31.390580 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2690f5-fc0f-48a5-a41b-840462b05a7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:31.391851 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2690f5-fc0f-48a5-a41b-840462b05a7f service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:31.392350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2690f5-fc0f-48a5-a41b-840462b05a7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:31.392795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2690f5-fc0f-48a5-a41b-840462b05a7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:31.400269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece7485-8c24-4ea4-96f6-379c9d9d759d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:31.405933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc2bde-9e62-4412-baad-9c30f97aa598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:31.406794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc2bde-9e62-4412-baad-9c30f97aa598 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:31.407079 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc2bde-9e62-4412-baad-9c30f97aa598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:31.407358 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc2bde-9e62-4412-baad-9c30f97aa598 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:31.408064 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc2bde-9e62-4412-baad-9c30f97aa598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:31.410037 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc2bde-9e62-4412-baad-9c30f97aa598 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:31.445835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1030/2041] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:31 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:31.451151 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc2bde-9e62-4412-baad-9c30f97aa598 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:31.467787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc2bde-9e62-4412-baad-9c30f97aa598 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:31.475185 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650acc2-5e3e-4c4c-99a1-02186bcbb1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:31.475736 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650acc2-5e3e-4c4c-99a1-02186bcbb1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:31.475736 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650acc2-5e3e-4c4c-99a1-02186bcbb1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:31.476846 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650acc2-5e3e-4c4c-99a1-02186bcbb1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:31.478027 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650acc2-5e3e-4c4c-99a1-02186bcbb1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:31.481618 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650acc2-5e3e-4c4c-99a1-02186bcbb1d3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:31.509016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2690f5-fc0f-48a5-a41b-840462b05a7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:31.510471 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1031/2042] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:02:31.511972 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2690f5-fc0f-48a5-a41b-840462b05a7f service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:31.514482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650acc2-5e3e-4c4c-99a1-02186bcbb1d3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:31.525193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650acc2-5e3e-4c4c-99a1-02186bcbb1d3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:31.526734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1012/2043] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:02:31.533103 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bab6de-ef6b-4aa5-9b2a-8a0340545724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:31.534241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bab6de-ef6b-4aa5-9b2a-8a0340545724 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:31.534564 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bab6de-ef6b-4aa5-9b2a-8a0340545724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:31.534875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bab6de-ef6b-4aa5-9b2a-8a0340545724 admin admin] PATH_INFO: `/v3/projects/7a9051c19aa94918801e9608bcf98256/users/8feb67e252e14429a74162614fe4f760/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:31.560755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bab6de-ef6b-4aa5-9b2a-8a0340545724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9051c19aa94918801e9608bcf98256, user_id=8feb67e252e14429a74162614fe4f760, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:31.563736 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bab6de-ef6b-4aa5-9b2a-8a0340545724 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:31.598120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1032/2044] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:31 2022] PUT /identity/v3/projects/7a9051c19aa94918801e9608bcf98256/users/8feb67e252e14429a74162614fe4f760/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:02:31.599686 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2690f5-fc0f-48a5-a41b-840462b05a7f service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:31.621554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2690f5-fc0f-48a5-a41b-840462b05a7f service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:31.631068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bab6de-ef6b-4aa5-9b2a-8a0340545724 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:31.634271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:31.702697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324a479-f27e-4d61-a45a-02d3dd263881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:31.703723 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324a479-f27e-4d61-a45a-02d3dd263881 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:31.703821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bab6de-ef6b-4aa5-9b2a-8a0340545724 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:31.704164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324a479-f27e-4d61-a45a-02d3dd263881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:31.704548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324a479-f27e-4d61-a45a-02d3dd263881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:31.705433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324a479-f27e-4d61-a45a-02d3dd263881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:31.707546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324a479-f27e-4d61-a45a-02d3dd263881 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:31.714660 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0aeb80-fb91-45a2-a4c7-28992e912fd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:31.715453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0aeb80-fb91-45a2-a4c7-28992e912fd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:31.715736 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0aeb80-fb91-45a2-a4c7-28992e912fd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:31.716011 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0aeb80-fb91-45a2-a4c7-28992e912fd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:31.721315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1013/2045] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:02:31.725415 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324a479-f27e-4d61-a45a-02d3dd263881 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:31.747593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324a479-f27e-4d61-a45a-02d3dd263881 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:31.753277 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0de0e1-50fb-4146-a1dc-d8adb7d465bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:31.753277 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0de0e1-50fb-4146-a1dc-d8adb7d465bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:31.753549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0de0e1-50fb-4146-a1dc-d8adb7d465bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:31.753761 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0de0e1-50fb-4146-a1dc-d8adb7d465bd admin admin] PATH_INFO: `/v3/projects/7a9051c19aa94918801e9608bcf98256/users/8feb67e252e14429a74162614fe4f760/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:31.755928 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0de0e1-50fb-4146-a1dc-d8adb7d465bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9051c19aa94918801e9608bcf98256, user_id=8feb67e252e14429a74162614fe4f760, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:31.758670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0de0e1-50fb-4146-a1dc-d8adb7d465bd admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:31.770648 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1014/2046] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:31 2022] PUT /identity/v3/projects/7a9051c19aa94918801e9608bcf98256/users/8feb67e252e14429a74162614fe4f760/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:02:31.771931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:31.783759 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896dce4-46a3-4970-b2c9-ddfa1b4f106d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:31.784044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896dce4-46a3-4970-b2c9-ddfa1b4f106d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:31.784319 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896dce4-46a3-4970-b2c9-ddfa1b4f106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:31.791481 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0aeb80-fb91-45a2-a4c7-28992e912fd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:31.793866 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0aeb80-fb91-45a2-a4c7-28992e912fd2 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:31.804441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1033/2047] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:02:31.820839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d896dce4-46a3-4970-b2c9-ddfa1b4f106d None None] MFA Rules not processed for user `8feb67e252e14429a74162614fe4f760`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:31.822212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d896dce4-46a3-4970-b2c9-ddfa1b4f106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:31.916410 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1015/2048] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:31 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:02:31.929134 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0aeb80-fb91-45a2-a4c7-28992e912fd2 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:31.941565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0aeb80-fb91-45a2-a4c7-28992e912fd2 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:32.013728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9aca9-cb36-4063-a5ef-35f83f7f0c39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:32.014586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9aca9-cb36-4063-a5ef-35f83f7f0c39 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:32.014943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9aca9-cb36-4063-a5ef-35f83f7f0c39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:32.015324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9aca9-cb36-4063-a5ef-35f83f7f0c39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:32.041095 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae3f8b-ec3a-4b17-835c-48cbfb811f28 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:32.042118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae3f8b-ec3a-4b17-835c-48cbfb811f28 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:32.042118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae3f8b-ec3a-4b17-835c-48cbfb811f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:32.061096 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-5bae3f8b-ec3a-4b17-835c-48cbfb811f28 None None] MFA Rules not processed for user `7de00142413f4f57b4782279bc826f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:32.062351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5bae3f8b-ec3a-4b17-835c-48cbfb811f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:32.095776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9aca9-cb36-4063-a5ef-35f83f7f0c39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:32.098143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9aca9-cb36-4063-a5ef-35f83f7f0c39 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:32.109290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1034/2049] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:32.134798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1016/2050] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:33.201124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ec135-388e-448f-8bed-be2e6c2a15c2 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:33.201887 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ec135-388e-448f-8bed-be2e6c2a15c2 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:33.201887 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ec135-388e-448f-8bed-be2e6c2a15c2 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:33.203709 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1035/2051] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 2 19:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:02:33.246108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8bf89-7ca1-456b-b513-b80e601174ca None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:33.246722 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8bf89-7ca1-456b-b513-b80e601174ca None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:33.247065 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8bf89-7ca1-456b-b513-b80e601174ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:33.283723 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-56f8bf89-7ca1-456b-b513-b80e601174ca None None] MFA Rules not processed for user `11a4152a82e1486887541afab2d4e5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:33.283723 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-56f8bf89-7ca1-456b-b513-b80e601174ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:33.315658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ec135-388e-448f-8bed-be2e6c2a15c2 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:33.318922 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2e5ec135-388e-448f-8bed-be2e6c2a15c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:33.333092 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:33.433513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ec135-388e-448f-8bed-be2e6c2a15c2 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:33.440171 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dde01c-ee0b-41db-801b-6b1e4d82c528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:33.441629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dde01c-ee0b-41db-801b-6b1e4d82c528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:33.442178 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dde01c-ee0b-41db-801b-6b1e4d82c528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:33.442692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dde01c-ee0b-41db-801b-6b1e4d82c528 admin admin] PATH_INFO: `/v3/users/daefcb4d04ee4bc5b2c1a7b755077a4a` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:33.444839 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dde01c-ee0b-41db-801b-6b1e4d82c528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daefcb4d04ee4bc5b2c1a7b755077a4a)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:33.446980 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dde01c-ee0b-41db-801b-6b1e4d82c528 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:33.455967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1017/2052] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 2 19:02:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:33.480944 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8bf89-7ca1-456b-b513-b80e601174ca None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:33.482648 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-56f8bf89-7ca1-456b-b513-b80e601174ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:33.510330 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8bf89-7ca1-456b-b513-b80e601174ca None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:33.523878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a7575-eb57-481b-b501-81b28a556cd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:33.534353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a7575-eb57-481b-b501-81b28a556cd5 service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:33.534353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a7575-eb57-481b-b501-81b28a556cd5 service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:33.534353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a7575-eb57-481b-b501-81b28a556cd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:33.554145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a7575-eb57-481b-b501-81b28a556cd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:33.556565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a7575-eb57-481b-b501-81b28a556cd5 service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:33.583331 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:33.587113 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1018/2053] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:02:33.608607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c5dde01c-ee0b-41db-801b-6b1e4d82c528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daefcb4d04ee4bc5b2c1a7b755077a4a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:33.612301 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c5dde01c-ee0b-41db-801b-6b1e4d82c528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daefcb4d04ee4bc5b2c1a7b755077a4a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:33.638302 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c5dde01c-ee0b-41db-801b-6b1e4d82c528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daefcb4d04ee4bc5b2c1a7b755077a4a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:33.658262 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c5dde01c-ee0b-41db-801b-6b1e4d82c528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daefcb4d04ee4bc5b2c1a7b755077a4a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:33.659482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c5dde01c-ee0b-41db-801b-6b1e4d82c528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daefcb4d04ee4bc5b2c1a7b755077a4a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:33.711090 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1036/2054] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:33 2022] DELETE /identity/v3/users/daefcb4d04ee4bc5b2c1a7b755077a4a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:33.949936 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a7575-eb57-481b-b501-81b28a556cd5 service placement] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:33.970511 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a7575-eb57-481b-b501-81b28a556cd5 service placement] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:34.053141 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db63f99-75d4-4f73-9a40-0527ca242f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:34.054075 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db63f99-75d4-4f73-9a40-0527ca242f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.054361 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db63f99-75d4-4f73-9a40-0527ca242f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.054638 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db63f99-75d4-4f73-9a40-0527ca242f18 admin admin] PATH_INFO: `/v3/projects/8e515ddd7313434f9e3dd34debc97877` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.055840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db63f99-75d4-4f73-9a40-0527ca242f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e515ddd7313434f9e3dd34debc97877)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:34.058032 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db63f99-75d4-4f73-9a40-0527ca242f18 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:34.112535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-9db63f99-75d4-4f73-9a40-0527ca242f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e515ddd7313434f9e3dd34debc97877', 'request_id': 'req-9db63f99-75d4-4f73-9a40-0527ca242f18'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:34.122964 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-9db63f99-75d4-4f73-9a40-0527ca242f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e515ddd7313434f9e3dd34debc97877', 'request_id': 'req-9db63f99-75d4-4f73-9a40-0527ca242f18'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:34.134140 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-9db63f99-75d4-4f73-9a40-0527ca242f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e515ddd7313434f9e3dd34debc97877', 'request_id': 'req-9db63f99-75d4-4f73-9a40-0527ca242f18'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:34.147679 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-9db63f99-75d4-4f73-9a40-0527ca242f18 admin admin] The token cache is being invalidate because project 8e515ddd7313434f9e3dd34debc97877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:34.147982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-9db63f99-75d4-4f73-9a40-0527ca242f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:34.148706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-9db63f99-75d4-4f73-9a40-0527ca242f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:34.150744 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1019/2055] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:33 2022] DELETE /identity/v3/projects/8e515ddd7313434f9e3dd34debc97877 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:34.156171 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222dd92-3f62-4b28-b567-d377b939f391 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.156493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222dd92-3f62-4b28-b567-d377b939f391 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.156799 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222dd92-3f62-4b28-b567-d377b939f391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.180965 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e222dd92-3f62-4b28-b567-d377b939f391 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:34.182556 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e222dd92-3f62-4b28-b567-d377b939f391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:34.280817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1037/2056] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:34.294302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74212f99-376b-4516-abcb-adc7451a9227 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.294940 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74212f99-376b-4516-abcb-adc7451a9227 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.294940 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74212f99-376b-4516-abcb-adc7451a9227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.319694 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-74212f99-376b-4516-abcb-adc7451a9227 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:34.321632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-74212f99-376b-4516-abcb-adc7451a9227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:34.332474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1020/2057] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:34.336522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222dd92-3f62-4b28-b567-d377b939f391 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:34.355749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222dd92-3f62-4b28-b567-d377b939f391 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:34.365546 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed364a0-2d13-4427-abe5-03bdd9068c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:34.365546 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed364a0-2d13-4427-abe5-03bdd9068c0e admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.365546 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed364a0-2d13-4427-abe5-03bdd9068c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.365546 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed364a0-2d13-4427-abe5-03bdd9068c0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.366022 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed364a0-2d13-4427-abe5-03bdd9068c0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:34.366022 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed364a0-2d13-4427-abe5-03bdd9068c0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:34.366633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed364a0-2d13-4427-abe5-03bdd9068c0e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:34.390277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1038/2058] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:34.390869 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74212f99-376b-4516-abcb-adc7451a9227 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:34.405015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74212f99-376b-4516-abcb-adc7451a9227 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:34.409784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fdbb4-d427-4b31-9d32-4bd6ca51a2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:34.410533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fdbb4-d427-4b31-9d32-4bd6ca51a2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.410816 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fdbb4-d427-4b31-9d32-4bd6ca51a2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.411095 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fdbb4-d427-4b31-9d32-4bd6ca51a2d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.411798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fdbb4-d427-4b31-9d32-4bd6ca51a2d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:34.413968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fdbb4-d427-4b31-9d32-4bd6ca51a2d4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:34.451768 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1021/2059] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:34 2022] POST /identity/v3/projects => generated 393 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:02:34.453867 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed364a0-2d13-4427-abe5-03bdd9068c0e admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:34.469254 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed364a0-2d13-4427-abe5-03bdd9068c0e admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:34.580861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a75f36-8635-497e-98c7-d23aa0bfb954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:34.581641 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a75f36-8635-497e-98c7-d23aa0bfb954 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.581969 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a75f36-8635-497e-98c7-d23aa0bfb954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.582280 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a75f36-8635-497e-98c7-d23aa0bfb954 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.583065 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a75f36-8635-497e-98c7-d23aa0bfb954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:34.585131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a75f36-8635-497e-98c7-d23aa0bfb954 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:34.614205 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1039/2060] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:34 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:34.618337 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fdbb4-d427-4b31-9d32-4bd6ca51a2d4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:34.629535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fdbb4-d427-4b31-9d32-4bd6ca51a2d4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:34.634157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45c9c-f978-49ef-ae19-d9ec4d78612a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:34.634929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45c9c-f978-49ef-ae19-d9ec4d78612a admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.635208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45c9c-f978-49ef-ae19-d9ec4d78612a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.635482 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45c9c-f978-49ef-ae19-d9ec4d78612a admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.636328 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e45c9c-f978-49ef-ae19-d9ec4d78612a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:34.637963 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e45c9c-f978-49ef-ae19-d9ec4d78612a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:34.640856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:34.654369 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1022/2061] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:34.655033 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a75f36-8635-497e-98c7-d23aa0bfb954 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:34.665764 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a75f36-8635-497e-98c7-d23aa0bfb954 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:34.671152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ba56c-f604-4a41-928f-82ffafc9bd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:34.672527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ba56c-f604-4a41-928f-82ffafc9bd2e admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.672798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ba56c-f604-4a41-928f-82ffafc9bd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.673070 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ba56c-f604-4a41-928f-82ffafc9bd2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.673838 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ba56c-f604-4a41-928f-82ffafc9bd2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:34.675504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ba56c-f604-4a41-928f-82ffafc9bd2e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:34.692665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1040/2062] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:34.694116 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45c9c-f978-49ef-ae19-d9ec4d78612a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:34.708626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45c9c-f978-49ef-ae19-d9ec4d78612a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:34.716528 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7d94a-40de-4eb1-821d-81c0830d1afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:34.717596 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7d94a-40de-4eb1-821d-81c0830d1afe admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.717914 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7d94a-40de-4eb1-821d-81c0830d1afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.718191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7d94a-40de-4eb1-821d-81c0830d1afe admin admin] PATH_INFO: `/v3/projects/e2d79077c0654e55973512bc6d36a9e8/users/4eda4b85484844ab8b424a1a42a97704/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.735640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7d94a-40de-4eb1-821d-81c0830d1afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d79077c0654e55973512bc6d36a9e8, user_id=4eda4b85484844ab8b424a1a42a97704, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:34.738428 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7d94a-40de-4eb1-821d-81c0830d1afe admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:34.757453 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1023/2063] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:34 2022] PUT /identity/v3/projects/e2d79077c0654e55973512bc6d36a9e8/users/4eda4b85484844ab8b424a1a42a97704/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:34.761014 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944d837-97f5-403d-a069-a55ec23dec13 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.761403 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944d837-97f5-403d-a069-a55ec23dec13 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.761770 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944d837-97f5-403d-a069-a55ec23dec13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.783695 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9944d837-97f5-403d-a069-a55ec23dec13 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:34.785039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9944d837-97f5-403d-a069-a55ec23dec13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:34.807433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:34.865432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1041/2064] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:02:34.876696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7d94a-40de-4eb1-821d-81c0830d1afe admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:34.879464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-75e7d94a-40de-4eb1-821d-81c0830d1afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:34.922931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944d837-97f5-403d-a069-a55ec23dec13 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:34.925082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9944d837-97f5-403d-a069-a55ec23dec13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:34.940804 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944d837-97f5-403d-a069-a55ec23dec13 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:34.951048 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8e119-7a0b-4860-86eb-35a0a6142652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:34.952727 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8e119-7a0b-4860-86eb-35a0a6142652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.952863 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8e119-7a0b-4860-86eb-35a0a6142652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.953481 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8e119-7a0b-4860-86eb-35a0a6142652 admin admin] PATH_INFO: `/v3/users/bc22a509598b4975a3362f8272aeddd6` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:34.954981 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8e119-7a0b-4860-86eb-35a0a6142652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc22a509598b4975a3362f8272aeddd6)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:34.957111 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8e119-7a0b-4860-86eb-35a0a6142652 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:34.986679 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7d94a-40de-4eb1-821d-81c0830d1afe admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:34.992787 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f2535-732d-4ff6-bf91-65783cafb388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:34.993905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f2535-732d-4ff6-bf91-65783cafb388 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:34.994160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f2535-732d-4ff6-bf91-65783cafb388 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:34.994675 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f2535-732d-4ff6-bf91-65783cafb388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:35.010717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f2535-732d-4ff6-bf91-65783cafb388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:35.012787 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f2535-732d-4ff6-bf91-65783cafb388 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:35.034065 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1024/2065] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:35.052898 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-80f8e119-7a0b-4860-86eb-35a0a6142652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc22a509598b4975a3362f8272aeddd6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:35.055085 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-80f8e119-7a0b-4860-86eb-35a0a6142652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc22a509598b4975a3362f8272aeddd6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:35.074117 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-80f8e119-7a0b-4860-86eb-35a0a6142652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc22a509598b4975a3362f8272aeddd6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:35.093126 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-80f8e119-7a0b-4860-86eb-35a0a6142652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc22a509598b4975a3362f8272aeddd6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:35.094655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-80f8e119-7a0b-4860-86eb-35a0a6142652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc22a509598b4975a3362f8272aeddd6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:35.122143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1042/2066] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:34 2022] DELETE /identity/v3/users/bc22a509598b4975a3362f8272aeddd6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:35.126973 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211aa4c-231e-464f-95f9-f543bed187a8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:35.128066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211aa4c-231e-464f-95f9-f543bed187a8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:35.128409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211aa4c-231e-464f-95f9-f543bed187a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:35.154905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0211aa4c-231e-464f-95f9-f543bed187a8 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:35.156530 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0211aa4c-231e-464f-95f9-f543bed187a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:35.245717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1025/2067] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:35.254542 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8e119-7a0b-4860-86eb-35a0a6142652 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:35.256761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-80f8e119-7a0b-4860-86eb-35a0a6142652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:35.330956 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8e119-7a0b-4860-86eb-35a0a6142652 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:35.336553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd62f47-28fe-4042-8ff4-9d5dd65f1940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:35.336910 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd62f47-28fe-4042-8ff4-9d5dd65f1940 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:35.337108 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd62f47-28fe-4042-8ff4-9d5dd65f1940 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:35.337388 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd62f47-28fe-4042-8ff4-9d5dd65f1940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:35.349968 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd62f47-28fe-4042-8ff4-9d5dd65f1940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:35.351547 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd62f47-28fe-4042-8ff4-9d5dd65f1940 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:35.377596 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1043/2068] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:36.109627 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211aa4c-231e-464f-95f9-f543bed187a8 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:36.112158 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0211aa4c-231e-464f-95f9-f543bed187a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:36.138434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211aa4c-231e-464f-95f9-f543bed187a8 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:36.150248 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627abac4-d16b-469f-8fc8-05b4534aece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:36.151274 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627abac4-d16b-469f-8fc8-05b4534aece8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:36.151859 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627abac4-d16b-469f-8fc8-05b4534aece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:36.152319 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627abac4-d16b-469f-8fc8-05b4534aece8 admin admin] PATH_INFO: `/v3/projects/f2896d463bc34fec828445fda2d97b24` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:36.154402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627abac4-d16b-469f-8fc8-05b4534aece8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2896d463bc34fec828445fda2d97b24)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:36.157641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627abac4-d16b-469f-8fc8-05b4534aece8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:36.267755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-627abac4-d16b-469f-8fc8-05b4534aece8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2896d463bc34fec828445fda2d97b24', 'request_id': 'req-627abac4-d16b-469f-8fc8-05b4534aece8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:36.276037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-627abac4-d16b-469f-8fc8-05b4534aece8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2896d463bc34fec828445fda2d97b24', 'request_id': 'req-627abac4-d16b-469f-8fc8-05b4534aece8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:36.287793 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-627abac4-d16b-469f-8fc8-05b4534aece8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2896d463bc34fec828445fda2d97b24', 'request_id': 'req-627abac4-d16b-469f-8fc8-05b4534aece8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:36.308461 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:36.312761 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-627abac4-d16b-469f-8fc8-05b4534aece8 admin admin] The token cache is being invalidate because project f2896d463bc34fec828445fda2d97b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:36.313341 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-627abac4-d16b-469f-8fc8-05b4534aece8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:36.315256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-627abac4-d16b-469f-8fc8-05b4534aece8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:36.319168 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1026/2069] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:36 2022] DELETE /identity/v3/projects/f2896d463bc34fec828445fda2d97b24 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:36.324067 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd62f47-28fe-4042-8ff4-9d5dd65f1940 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:36.345401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd62f47-28fe-4042-8ff4-9d5dd65f1940 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:36.403626 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:36.451364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7618584-b5c4-47ba-a2a0-12c7ca53646d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:36.452902 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7618584-b5c4-47ba-a2a0-12c7ca53646d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:36.453569 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7618584-b5c4-47ba-a2a0-12c7ca53646d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:36.454037 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7618584-b5c4-47ba-a2a0-12c7ca53646d admin admin] PATH_INFO: `/v3/users/8feb67e252e14429a74162614fe4f760` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:36.455742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7618584-b5c4-47ba-a2a0-12c7ca53646d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8feb67e252e14429a74162614fe4f760)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:36.458124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7618584-b5c4-47ba-a2a0-12c7ca53646d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:36.566299 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e7618584-b5c4-47ba-a2a0-12c7ca53646d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8feb67e252e14429a74162614fe4f760'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:36.567880 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e7618584-b5c4-47ba-a2a0-12c7ca53646d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8feb67e252e14429a74162614fe4f760'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:36.585439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e7618584-b5c4-47ba-a2a0-12c7ca53646d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8feb67e252e14429a74162614fe4f760'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:36.601560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e7618584-b5c4-47ba-a2a0-12c7ca53646d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8feb67e252e14429a74162614fe4f760'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:36.602738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e7618584-b5c4-47ba-a2a0-12c7ca53646d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8feb67e252e14429a74162614fe4f760'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:36.653028 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1044/2070] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:36 2022] DELETE /identity/v3/users/8feb67e252e14429a74162614fe4f760 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:37.071238 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627abac4-d16b-469f-8fc8-05b4534aece8 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:37.073202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-627abac4-d16b-469f-8fc8-05b4534aece8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:37.099430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627abac4-d16b-469f-8fc8-05b4534aece8 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:37.203153 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36149751-f63f-493b-9827-2cdb30ab9d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:37.204836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36149751-f63f-493b-9827-2cdb30ab9d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:37.205118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36149751-f63f-493b-9827-2cdb30ab9d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:37.205391 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36149751-f63f-493b-9827-2cdb30ab9d90 admin admin] PATH_INFO: `/v3/projects/7a9051c19aa94918801e9608bcf98256` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:37.207645 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36149751-f63f-493b-9827-2cdb30ab9d90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9051c19aa94918801e9608bcf98256)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:37.209911 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36149751-f63f-493b-9827-2cdb30ab9d90 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:37.320516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-36149751-f63f-493b-9827-2cdb30ab9d90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9051c19aa94918801e9608bcf98256', 'request_id': 'req-36149751-f63f-493b-9827-2cdb30ab9d90'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:37.329502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-36149751-f63f-493b-9827-2cdb30ab9d90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9051c19aa94918801e9608bcf98256', 'request_id': 'req-36149751-f63f-493b-9827-2cdb30ab9d90'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:37.343590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-36149751-f63f-493b-9827-2cdb30ab9d90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9051c19aa94918801e9608bcf98256', 'request_id': 'req-36149751-f63f-493b-9827-2cdb30ab9d90'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:37.371557 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-36149751-f63f-493b-9827-2cdb30ab9d90 admin admin] The token cache is being invalidate because project 7a9051c19aa94918801e9608bcf98256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:37.371557 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-36149751-f63f-493b-9827-2cdb30ab9d90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:37.371557 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-36149751-f63f-493b-9827-2cdb30ab9d90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:37.373877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1027/2071] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:37 2022] DELETE /identity/v3/projects/7a9051c19aa94918801e9608bcf98256 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:02:37.380024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133eaa7-8960-4234-9eba-e98732968601 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:37.380576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133eaa7-8960-4234-9eba-e98732968601 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:37.380654 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133eaa7-8960-4234-9eba-e98732968601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:37.413129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f133eaa7-8960-4234-9eba-e98732968601 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:37.420391 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f133eaa7-8960-4234-9eba-e98732968601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:37.537837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1045/2072] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:02:37.547717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2519c8a-9904-41f7-9655-2386f4d51e79 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:37.548006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2519c8a-9904-41f7-9655-2386f4d51e79 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:37.548285 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2519c8a-9904-41f7-9655-2386f4d51e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:37.591720 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b2519c8a-9904-41f7-9655-2386f4d51e79 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:37.593108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b2519c8a-9904-41f7-9655-2386f4d51e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:37.604213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1028/2073] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:37.609514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133eaa7-8960-4234-9eba-e98732968601 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:37.647590 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133eaa7-8960-4234-9eba-e98732968601 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:37.655284 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a8c22-0674-48e3-b8b4-5d0a9dbc458b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:37.656900 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a8c22-0674-48e3-b8b4-5d0a9dbc458b admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:37.657926 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a8c22-0674-48e3-b8b4-5d0a9dbc458b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:37.658499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a8c22-0674-48e3-b8b4-5d0a9dbc458b admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:37.659895 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a8c22-0674-48e3-b8b4-5d0a9dbc458b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:37.660664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a8c22-0674-48e3-b8b4-5d0a9dbc458b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:37.663064 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a8c22-0674-48e3-b8b4-5d0a9dbc458b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:37.680449 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1046/2074] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:37.684568 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2519c8a-9904-41f7-9655-2386f4d51e79 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:37.695157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2519c8a-9904-41f7-9655-2386f4d51e79 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:37.705592 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cef1b7-0ebf-4815-a6a0-e27c56417525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:37.706343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cef1b7-0ebf-4815-a6a0-e27c56417525 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:37.706631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cef1b7-0ebf-4815-a6a0-e27c56417525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:37.706903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cef1b7-0ebf-4815-a6a0-e27c56417525 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:37.707616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cef1b7-0ebf-4815-a6a0-e27c56417525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:37.711151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cef1b7-0ebf-4815-a6a0-e27c56417525 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:37.783637 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1029/2075] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:37 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:37.788045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a8c22-0674-48e3-b8b4-5d0a9dbc458b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:37.808476 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a8c22-0674-48e3-b8b4-5d0a9dbc458b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:37.873743 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:37.897632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d9f16-8214-43a5-b5d4-777fa0e79838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:37.898378 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d9f16-8214-43a5-b5d4-777fa0e79838 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:37.898719 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d9f16-8214-43a5-b5d4-777fa0e79838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:37.898989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d9f16-8214-43a5-b5d4-777fa0e79838 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:37.899718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d9f16-8214-43a5-b5d4-777fa0e79838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:37.902051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d9f16-8214-43a5-b5d4-777fa0e79838 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:37.941473 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1047/2076] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:37 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:37.943343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cef1b7-0ebf-4815-a6a0-e27c56417525 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:37.965838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cef1b7-0ebf-4815-a6a0-e27c56417525 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:37.973502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0d343-9d6c-4f91-bbf0-e93a3ef0e21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:37.974649 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0d343-9d6c-4f91-bbf0-e93a3ef0e21c admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:37.975053 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0d343-9d6c-4f91-bbf0-e93a3ef0e21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:37.976172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0d343-9d6c-4f91-bbf0-e93a3ef0e21c admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:37.977773 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0d343-9d6c-4f91-bbf0-e93a3ef0e21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:37.980497 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0d343-9d6c-4f91-bbf0-e93a3ef0e21c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:37.996447 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1030/2077] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:38.004491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d9f16-8214-43a5-b5d4-777fa0e79838 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:38.017907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d9f16-8214-43a5-b5d4-777fa0e79838 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:38.024187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154c1c5-a2a7-4ac0-9814-456c7d7795a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:38.025005 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154c1c5-a2a7-4ac0-9814-456c7d7795a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:38.025541 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154c1c5-a2a7-4ac0-9814-456c7d7795a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:38.025978 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154c1c5-a2a7-4ac0-9814-456c7d7795a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:38.026812 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154c1c5-a2a7-4ac0-9814-456c7d7795a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:38.028638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154c1c5-a2a7-4ac0-9814-456c7d7795a3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:38.049115 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1048/2078] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:38.050399 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0d343-9d6c-4f91-bbf0-e93a3ef0e21c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:38.073649 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0d343-9d6c-4f91-bbf0-e93a3ef0e21c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:38.080173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53545275-5c7e-4430-9af8-4d1444eea701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:38.081101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53545275-5c7e-4430-9af8-4d1444eea701 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:38.081378 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53545275-5c7e-4430-9af8-4d1444eea701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:38.081652 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53545275-5c7e-4430-9af8-4d1444eea701 admin admin] PATH_INFO: `/v3/projects/3cefe0d5fbae4b6ca7578bf08f275bac/users/9791fd04ff4045578041a3c7f613f495/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:38.106287 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53545275-5c7e-4430-9af8-4d1444eea701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cefe0d5fbae4b6ca7578bf08f275bac, user_id=9791fd04ff4045578041a3c7f613f495, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:38.110319 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53545275-5c7e-4430-9af8-4d1444eea701 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:38.142896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1031/2079] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:38 2022] PUT /identity/v3/projects/3cefe0d5fbae4b6ca7578bf08f275bac/users/9791fd04ff4045578041a3c7f613f495/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:38.146366 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf8e14-1038-4951-a33e-8e22751cde6b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:38.146894 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf8e14-1038-4951-a33e-8e22751cde6b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:38.147394 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf8e14-1038-4951-a33e-8e22751cde6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:38.198490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a4cf8e14-1038-4951-a33e-8e22751cde6b None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:38.204976 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a4cf8e14-1038-4951-a33e-8e22751cde6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:38.333053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1049/2080] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:38.350954 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53545275-5c7e-4430-9af8-4d1444eea701 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:38.352996 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-53545275-5c7e-4430-9af8-4d1444eea701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:38.406375 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:38.474106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53545275-5c7e-4430-9af8-4d1444eea701 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:38.479283 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ad4b8-77fc-4973-a6de-6e9b45a38882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:38.480446 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ad4b8-77fc-4973-a6de-6e9b45a38882 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:38.480916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ad4b8-77fc-4973-a6de-6e9b45a38882 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:38.481423 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ad4b8-77fc-4973-a6de-6e9b45a38882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:38.492773 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ad4b8-77fc-4973-a6de-6e9b45a38882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:38.495196 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ad4b8-77fc-4973-a6de-6e9b45a38882 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:38.508716 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1032/2081] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:42.028024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcdb98-3bb6-45d8-a408-0da0ace39f3b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:42.028024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcdb98-3bb6-45d8-a408-0da0ace39f3b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:42.028024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcdb98-3bb6-45d8-a408-0da0ace39f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:42.103823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-addcdb98-3bb6-45d8-a408-0da0ace39f3b None None] MFA Rules not processed for user `4eda4b85484844ab8b424a1a42a97704`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:42.111302 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-addcdb98-3bb6-45d8-a408-0da0ace39f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:42.334908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1050/2082] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:42.345617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee53698-852a-4fdb-a436-9134dc3d1528 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:42.346463 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee53698-852a-4fdb-a436-9134dc3d1528 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:42.346463 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee53698-852a-4fdb-a436-9134dc3d1528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:42.375516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4ee53698-852a-4fdb-a436-9134dc3d1528 None None] MFA Rules not processed for user `4eda4b85484844ab8b424a1a42a97704`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:42.376856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4ee53698-852a-4fdb-a436-9134dc3d1528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:42.387269 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1033/2083] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:02:42.399099 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcdb98-3bb6-45d8-a408-0da0ace39f3b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:42.401578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-addcdb98-3bb6-45d8-a408-0da0ace39f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:42.505072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:42.547234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcdb98-3bb6-45d8-a408-0da0ace39f3b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:42.554499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b52f53-42de-4c3b-9b77-0e51d3731919 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:42.555569 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b52f53-42de-4c3b-9b77-0e51d3731919 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:42.555901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b52f53-42de-4c3b-9b77-0e51d3731919 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:42.556652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b52f53-42de-4c3b-9b77-0e51d3731919 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:42.568507 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b52f53-42de-4c3b-9b77-0e51d3731919 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:42.570286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b52f53-42de-4c3b-9b77-0e51d3731919 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:42.584106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1051/2084] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:43.253361 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee53698-852a-4fdb-a436-9134dc3d1528 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:43.258766 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4ee53698-852a-4fdb-a436-9134dc3d1528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:43.303210 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee53698-852a-4fdb-a436-9134dc3d1528 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:43.318102 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c3938-b7cc-47ba-95b0-e5e0f5c5bd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:43.319005 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c3938-b7cc-47ba-95b0-e5e0f5c5bd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:43.319270 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c3938-b7cc-47ba-95b0-e5e0f5c5bd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:43.319546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c3938-b7cc-47ba-95b0-e5e0f5c5bd46 admin admin] PATH_INFO: `/v3/users/743d272d962c4803887181a4ee9ac651` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:43.324440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c3938-b7cc-47ba-95b0-e5e0f5c5bd46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=743d272d962c4803887181a4ee9ac651)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:43.330666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c3938-b7cc-47ba-95b0-e5e0f5c5bd46 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:43.487963 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-903c3938-b7cc-47ba-95b0-e5e0f5c5bd46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '743d272d962c4803887181a4ee9ac651'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:43.488644 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-903c3938-b7cc-47ba-95b0-e5e0f5c5bd46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '743d272d962c4803887181a4ee9ac651'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:43.502529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-903c3938-b7cc-47ba-95b0-e5e0f5c5bd46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '743d272d962c4803887181a4ee9ac651'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:43.553759 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-903c3938-b7cc-47ba-95b0-e5e0f5c5bd46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '743d272d962c4803887181a4ee9ac651'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:43.554746 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-903c3938-b7cc-47ba-95b0-e5e0f5c5bd46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '743d272d962c4803887181a4ee9ac651'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:43.563027 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ba1c7-f63e-45a7-87ea-740d87826ffc None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:43.564322 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ba1c7-f63e-45a7-87ea-740d87826ffc None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:43.571071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ba1c7-f63e-45a7-87ea-740d87826ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:43.590561 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1034/2085] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:43 2022] DELETE /identity/v3/users/743d272d962c4803887181a4ee9ac651 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:43.592304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727af8c4-3012-4d7e-a7ec-cf416d417103 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:43.592946 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727af8c4-3012-4d7e-a7ec-cf416d417103 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:43.593675 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727af8c4-3012-4d7e-a7ec-cf416d417103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:43.623741 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-de4ba1c7-f63e-45a7-87ea-740d87826ffc None None] MFA Rules not processed for user `4eda4b85484844ab8b424a1a42a97704`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:43.626204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-de4ba1c7-f63e-45a7-87ea-740d87826ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:43.646737 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-727af8c4-3012-4d7e-a7ec-cf416d417103 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:43.648552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-727af8c4-3012-4d7e-a7ec-cf416d417103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:43.812653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1052/2086] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:43.854466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1035/2087] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:43.866868 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ba1c7-f63e-45a7-87ea-740d87826ffc None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:43.868836 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-de4ba1c7-f63e-45a7-87ea-740d87826ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:44.033142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ba1c7-f63e-45a7-87ea-740d87826ffc None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:44.045052 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86e2ee-4907-4312-95ab-3726812f8cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:44.047118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86e2ee-4907-4312-95ab-3726812f8cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:44.048911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86e2ee-4907-4312-95ab-3726812f8cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:44.049731 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86e2ee-4907-4312-95ab-3726812f8cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:44.079487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86e2ee-4907-4312-95ab-3726812f8cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:44.081167 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86e2ee-4907-4312-95ab-3726812f8cd9 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:44.111856 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1053/2088] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:45.148044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727af8c4-3012-4d7e-a7ec-cf416d417103 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:45.149734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-727af8c4-3012-4d7e-a7ec-cf416d417103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:45.190961 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727af8c4-3012-4d7e-a7ec-cf416d417103 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:45.204503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1128f0-3550-47a3-a2b2-b0f6a9ed768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:45.206290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1128f0-3550-47a3-a2b2-b0f6a9ed768b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:45.206775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1128f0-3550-47a3-a2b2-b0f6a9ed768b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:45.207208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1128f0-3550-47a3-a2b2-b0f6a9ed768b admin admin] PATH_INFO: `/v3/projects/26099bd013e64994beea6fafdfa0700b` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:45.210150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1128f0-3550-47a3-a2b2-b0f6a9ed768b admin admin] RBAC: Authorizing `identity:delete_project(project_id=26099bd013e64994beea6fafdfa0700b)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:45.213132 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1128f0-3550-47a3-a2b2-b0f6a9ed768b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:45.303779 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:45.349174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ec1128f0-3550-47a3-a2b2-b0f6a9ed768b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26099bd013e64994beea6fafdfa0700b', 'request_id': 'req-ec1128f0-3550-47a3-a2b2-b0f6a9ed768b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:45.369870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ec1128f0-3550-47a3-a2b2-b0f6a9ed768b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26099bd013e64994beea6fafdfa0700b', 'request_id': 'req-ec1128f0-3550-47a3-a2b2-b0f6a9ed768b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:45.393125 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ec1128f0-3550-47a3-a2b2-b0f6a9ed768b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26099bd013e64994beea6fafdfa0700b', 'request_id': 'req-ec1128f0-3550-47a3-a2b2-b0f6a9ed768b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:45.424604 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ec1128f0-3550-47a3-a2b2-b0f6a9ed768b admin admin] The token cache is being invalidate because project 26099bd013e64994beea6fafdfa0700b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:45.424896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ec1128f0-3550-47a3-a2b2-b0f6a9ed768b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:45.428574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ec1128f0-3550-47a3-a2b2-b0f6a9ed768b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:45.431382 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1036/2089] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:45 2022] DELETE /identity/v3/projects/26099bd013e64994beea6fafdfa0700b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:45.436478 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86e2ee-4907-4312-95ab-3726812f8cd9 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:45.454133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86e2ee-4907-4312-95ab-3726812f8cd9 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:45.697363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4675dfa-b399-4d45-a8a0-b811abffce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:45.698694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4675dfa-b399-4d45-a8a0-b811abffce57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:45.699152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4675dfa-b399-4d45-a8a0-b811abffce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:45.699563 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4675dfa-b399-4d45-a8a0-b811abffce57 admin admin] PATH_INFO: `/v3/users/8bcc6d9085c6440db14f7386f5c40df9` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:45.702622 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4675dfa-b399-4d45-a8a0-b811abffce57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bcc6d9085c6440db14f7386f5c40df9)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:45.706020 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4675dfa-b399-4d45-a8a0-b811abffce57 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:45.761542 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:45.853789 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c4675dfa-b399-4d45-a8a0-b811abffce57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bcc6d9085c6440db14f7386f5c40df9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:45.856352 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c4675dfa-b399-4d45-a8a0-b811abffce57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bcc6d9085c6440db14f7386f5c40df9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:45.886330 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c4675dfa-b399-4d45-a8a0-b811abffce57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bcc6d9085c6440db14f7386f5c40df9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:45.919819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c4675dfa-b399-4d45-a8a0-b811abffce57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bcc6d9085c6440db14f7386f5c40df9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:45.921442 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c4675dfa-b399-4d45-a8a0-b811abffce57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bcc6d9085c6440db14f7386f5c40df9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:46.005127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1054/2090] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:45 2022] DELETE /identity/v3/users/8bcc6d9085c6440db14f7386f5c40df9 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:46.779061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1128f0-3550-47a3-a2b2-b0f6a9ed768b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:46.780738 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ec1128f0-3550-47a3-a2b2-b0f6a9ed768b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:46.816968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1128f0-3550-47a3-a2b2-b0f6a9ed768b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:46.958693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0061d5f-61e7-422d-8384-448704cd954f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:46.960066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0061d5f-61e7-422d-8384-448704cd954f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:46.960744 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0061d5f-61e7-422d-8384-448704cd954f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:46.961392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0061d5f-61e7-422d-8384-448704cd954f admin admin] PATH_INFO: `/v3/projects/1c85dbf4112446eca69847c52d1ee4cc` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:46.964597 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0061d5f-61e7-422d-8384-448704cd954f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c85dbf4112446eca69847c52d1ee4cc)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:46.968499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0061d5f-61e7-422d-8384-448704cd954f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:47.051897 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a0061d5f-61e7-422d-8384-448704cd954f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c85dbf4112446eca69847c52d1ee4cc', 'request_id': 'req-a0061d5f-61e7-422d-8384-448704cd954f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:47.062954 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a0061d5f-61e7-422d-8384-448704cd954f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c85dbf4112446eca69847c52d1ee4cc', 'request_id': 'req-a0061d5f-61e7-422d-8384-448704cd954f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:47.084089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a0061d5f-61e7-422d-8384-448704cd954f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c85dbf4112446eca69847c52d1ee4cc', 'request_id': 'req-a0061d5f-61e7-422d-8384-448704cd954f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:47.139477 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a0061d5f-61e7-422d-8384-448704cd954f admin admin] The token cache is being invalidate because project 1c85dbf4112446eca69847c52d1ee4cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:47.140072 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a0061d5f-61e7-422d-8384-448704cd954f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:47.142418 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a0061d5f-61e7-422d-8384-448704cd954f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:47.152555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1037/2091] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:46 2022] DELETE /identity/v3/projects/1c85dbf4112446eca69847c52d1ee4cc => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:47.152801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443d7d6-c8f2-4d00-8ce3-fac10bc9d99e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:47.153267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443d7d6-c8f2-4d00-8ce3-fac10bc9d99e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:47.153391 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443d7d6-c8f2-4d00-8ce3-fac10bc9d99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:47.193478 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e443d7d6-c8f2-4d00-8ce3-fac10bc9d99e None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:47.196320 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e443d7d6-c8f2-4d00-8ce3-fac10bc9d99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:47.345964 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1055/2092] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:47.359314 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f56f92-c11c-4e4b-a76b-1d5af11a8c74 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:47.359747 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f56f92-c11c-4e4b-a76b-1d5af11a8c74 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:47.360002 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f56f92-c11c-4e4b-a76b-1d5af11a8c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:47.392624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-84f56f92-c11c-4e4b-a76b-1d5af11a8c74 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:47.393926 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-84f56f92-c11c-4e4b-a76b-1d5af11a8c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:47.411139 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1038/2093] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:47.411883 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443d7d6-c8f2-4d00-8ce3-fac10bc9d99e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:47.430572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443d7d6-c8f2-4d00-8ce3-fac10bc9d99e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:47.437494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcdb42-77b9-4f03-98de-b3e624f8f008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:47.438393 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcdb42-77b9-4f03-98de-b3e624f8f008 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:47.438776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcdb42-77b9-4f03-98de-b3e624f8f008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:47.439109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcdb42-77b9-4f03-98de-b3e624f8f008 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:47.439977 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcdb42-77b9-4f03-98de-b3e624f8f008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:47.440336 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcdb42-77b9-4f03-98de-b3e624f8f008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:47.442568 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcdb42-77b9-4f03-98de-b3e624f8f008 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:47.500875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1056/2094] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:47.502919 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f56f92-c11c-4e4b-a76b-1d5af11a8c74 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:47.545414 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f56f92-c11c-4e4b-a76b-1d5af11a8c74 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:47.561709 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7ca4c-3847-4a2f-bb3b-8829e9a2d595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:47.562873 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7ca4c-3847-4a2f-bb3b-8829e9a2d595 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:47.563475 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7ca4c-3847-4a2f-bb3b-8829e9a2d595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:47.563948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7ca4c-3847-4a2f-bb3b-8829e9a2d595 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:47.564945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7ca4c-3847-4a2f-bb3b-8829e9a2d595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:47.569427 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7ca4c-3847-4a2f-bb3b-8829e9a2d595 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:47.615708 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1039/2095] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:47 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:47.621889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcdb42-77b9-4f03-98de-b3e624f8f008 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:47.648404 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcdb42-77b9-4f03-98de-b3e624f8f008 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:47.787734 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ca9a8-ff1e-4eb6-9cfc-4a9fee722d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:47.789909 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ca9a8-ff1e-4eb6-9cfc-4a9fee722d2c admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:47.789909 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ca9a8-ff1e-4eb6-9cfc-4a9fee722d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:47.790525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ca9a8-ff1e-4eb6-9cfc-4a9fee722d2c admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:47.791643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ca9a8-ff1e-4eb6-9cfc-4a9fee722d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:47.796444 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ca9a8-ff1e-4eb6-9cfc-4a9fee722d2c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:47.843432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1057/2096] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:47 2022] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:02:47.847432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7ca4c-3847-4a2f-bb3b-8829e9a2d595 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:47.862656 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7ca4c-3847-4a2f-bb3b-8829e9a2d595 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:47.870656 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f125f-791e-4e47-8310-723450d426f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:47.871811 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f125f-791e-4e47-8310-723450d426f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:47.872057 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f125f-791e-4e47-8310-723450d426f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:47.872648 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f125f-791e-4e47-8310-723450d426f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:47.874021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f125f-791e-4e47-8310-723450d426f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:47.877618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f125f-791e-4e47-8310-723450d426f0 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:47.914287 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1040/2097] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:47.916388 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ca9a8-ff1e-4eb6-9cfc-4a9fee722d2c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:47.935897 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ca9a8-ff1e-4eb6-9cfc-4a9fee722d2c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:47.946506 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600acf0-6eb3-45bd-8dd3-cda25b94c13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:47.950053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600acf0-6eb3-45bd-8dd3-cda25b94c13b admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:47.953349 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600acf0-6eb3-45bd-8dd3-cda25b94c13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:47.953924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600acf0-6eb3-45bd-8dd3-cda25b94c13b admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:47.954884 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600acf0-6eb3-45bd-8dd3-cda25b94c13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:47.958736 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600acf0-6eb3-45bd-8dd3-cda25b94c13b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:47.994347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f125f-791e-4e47-8310-723450d426f0 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:48.010342 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1058/2098] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:48.017371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f125f-791e-4e47-8310-723450d426f0 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:48.069321 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be214b1-91bd-4ae8-b13b-f782356d0573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:48.070307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be214b1-91bd-4ae8-b13b-f782356d0573 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:48.078924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be214b1-91bd-4ae8-b13b-f782356d0573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:48.079254 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be214b1-91bd-4ae8-b13b-f782356d0573 admin admin] PATH_INFO: `/v3/projects/b101865043524c0898ead451e6de777e/users/e2c3070f1bae44c2acc180f88c6f1343/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:48.091743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:48.147323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be214b1-91bd-4ae8-b13b-f782356d0573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b101865043524c0898ead451e6de777e, user_id=e2c3070f1bae44c2acc180f88c6f1343, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:48.151426 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be214b1-91bd-4ae8-b13b-f782356d0573 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:48.197711 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1041/2099] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:47 2022] PUT /identity/v3/projects/b101865043524c0898ead451e6de777e/users/e2c3070f1bae44c2acc180f88c6f1343/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:48.210094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b95d7-fb15-406b-bdfb-4f2748eafc38 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:48.211502 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b95d7-fb15-406b-bdfb-4f2748eafc38 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:48.211837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b95d7-fb15-406b-bdfb-4f2748eafc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:48.304358 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:48.326241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c24b95d7-fb15-406b-bdfb-4f2748eafc38 None None] MFA Rules not processed for user `e2c3070f1bae44c2acc180f88c6f1343`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:48.328225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c24b95d7-fb15-406b-bdfb-4f2748eafc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:48.496966 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1059/2100] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:48.498256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be214b1-91bd-4ae8-b13b-f782356d0573 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:48.638611 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b95d7-fb15-406b-bdfb-4f2748eafc38 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:48.640226 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c24b95d7-fb15-406b-bdfb-4f2748eafc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:48.766150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be214b1-91bd-4ae8-b13b-f782356d0573 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:48.780773 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e49641-9ba9-43b0-a915-0d1abb56804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:48.781449 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e49641-9ba9-43b0-a915-0d1abb56804b admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:48.781733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e49641-9ba9-43b0-a915-0d1abb56804b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:48.782042 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e49641-9ba9-43b0-a915-0d1abb56804b admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:48.796470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e49641-9ba9-43b0-a915-0d1abb56804b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:48.800760 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e49641-9ba9-43b0-a915-0d1abb56804b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:48.852179 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b95d7-fb15-406b-bdfb-4f2748eafc38 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:48.882262 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a280f-b707-4dc2-992e-4abccd5da8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:48.882537 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a280f-b707-4dc2-992e-4abccd5da8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:48.882625 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a280f-b707-4dc2-992e-4abccd5da8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:48.882890 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a280f-b707-4dc2-992e-4abccd5da8be admin admin] PATH_INFO: `/v3/users/bd3a54a9802647a4becbfcfb0450ed3d` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:48.889054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1042/2101] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:48 2022] POST /identity/v3/projects => generated 387 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:02:48.890222 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e49641-9ba9-43b0-a915-0d1abb56804b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:48.894824 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a280f-b707-4dc2-992e-4abccd5da8be admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd3a54a9802647a4becbfcfb0450ed3d)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:48.897351 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a280f-b707-4dc2-992e-4abccd5da8be admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:49.046288 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6e5a280f-b707-4dc2-992e-4abccd5da8be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd3a54a9802647a4becbfcfb0450ed3d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:49.047990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6e5a280f-b707-4dc2-992e-4abccd5da8be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd3a54a9802647a4becbfcfb0450ed3d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:49.063341 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6e5a280f-b707-4dc2-992e-4abccd5da8be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd3a54a9802647a4becbfcfb0450ed3d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:49.100193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6e5a280f-b707-4dc2-992e-4abccd5da8be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd3a54a9802647a4becbfcfb0450ed3d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:49.100986 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6e5a280f-b707-4dc2-992e-4abccd5da8be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd3a54a9802647a4becbfcfb0450ed3d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:49.109705 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e49641-9ba9-43b0-a915-0d1abb56804b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:49.142367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1060/2102] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:48 2022] DELETE /identity/v3/users/bd3a54a9802647a4becbfcfb0450ed3d => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:49.144441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e74e4-ce80-44a6-82ef-bab975c99970 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:49.144806 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e74e4-ce80-44a6-82ef-bab975c99970 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:49.145100 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e74e4-ce80-44a6-82ef-bab975c99970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:49.145493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fcd84-7fa8-420d-b8cd-59073a0a1451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:49.147549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fcd84-7fa8-420d-b8cd-59073a0a1451 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:49.154766 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fcd84-7fa8-420d-b8cd-59073a0a1451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:49.154766 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fcd84-7fa8-420d-b8cd-59073a0a1451 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:49.157727 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fcd84-7fa8-420d-b8cd-59073a0a1451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:49.165100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fcd84-7fa8-420d-b8cd-59073a0a1451 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:49.194313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-777e74e4-ce80-44a6-82ef-bab975c99970 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:49.202325 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-777e74e4-ce80-44a6-82ef-bab975c99970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:49.250144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1043/2103] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:48 2022] POST /identity/v3/users => generated 300 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:49.252632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fcd84-7fa8-420d-b8cd-59073a0a1451 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:49.255485 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:49.264832 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-685fcd84-7fa8-420d-b8cd-59073a0a1451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:49.313734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fcd84-7fa8-420d-b8cd-59073a0a1451 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:49.425005 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1061/2104] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:49.445041 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e74e4-ce80-44a6-82ef-bab975c99970 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:49.448049 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-777e74e4-ce80-44a6-82ef-bab975c99970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:49.506516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a3825-7429-4288-a259-321eb65903b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:49.507579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a3825-7429-4288-a259-321eb65903b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:49.508048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a3825-7429-4288-a259-321eb65903b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:49.508503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a3825-7429-4288-a259-321eb65903b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:49.509557 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a3825-7429-4288-a259-321eb65903b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:49.534558 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a3825-7429-4288-a259-321eb65903b1 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:49.534558 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:49.534883 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e74e4-ce80-44a6-82ef-bab975c99970 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:49.537853 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4baf1-7a16-48e5-a794-8d85a25d9b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:49.538792 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4baf1-7a16-48e5-a794-8d85a25d9b25 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:49.539073 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4baf1-7a16-48e5-a794-8d85a25d9b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:49.539415 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4baf1-7a16-48e5-a794-8d85a25d9b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:49.558334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1044/2105] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:49.559786 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4baf1-7a16-48e5-a794-8d85a25d9b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:49.566382 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a3825-7429-4288-a259-321eb65903b1 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:49.569837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4baf1-7a16-48e5-a794-8d85a25d9b25 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:49.621936 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a3825-7429-4288-a259-321eb65903b1 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:49.627964 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1062/2106] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:49.642419 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97fe1f-ccc6-4dd2-8ea6-d17b00baaa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:49.643415 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97fe1f-ccc6-4dd2-8ea6-d17b00baaa47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:49.643726 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97fe1f-ccc6-4dd2-8ea6-d17b00baaa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:49.643995 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97fe1f-ccc6-4dd2-8ea6-d17b00baaa47 admin admin] PATH_INFO: `/v3/projects/bae664b462364dfdbf6d6ec3e13dab25/users/0b41ee5e57b140bba1db740899816f8f/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:49.697303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97fe1f-ccc6-4dd2-8ea6-d17b00baaa47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bae664b462364dfdbf6d6ec3e13dab25, user_id=0b41ee5e57b140bba1db740899816f8f, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:49.702814 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97fe1f-ccc6-4dd2-8ea6-d17b00baaa47 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:49.748936 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1045/2107] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:49 2022] PUT /identity/v3/projects/bae664b462364dfdbf6d6ec3e13dab25/users/0b41ee5e57b140bba1db740899816f8f/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:49.753166 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4baf1-7a16-48e5-a794-8d85a25d9b25 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:49.767944 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4baf1-7a16-48e5-a794-8d85a25d9b25 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:49.847158 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0eba1-7100-4719-b5dc-06ad657d4162 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:49.847445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0eba1-7100-4719-b5dc-06ad657d4162 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:49.847716 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0eba1-7100-4719-b5dc-06ad657d4162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:49.946352 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-64a0eba1-7100-4719-b5dc-06ad657d4162 None None] MFA Rules not processed for user `9791fd04ff4045578041a3c7f613f495`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:49.950382 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-64a0eba1-7100-4719-b5dc-06ad657d4162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:49.987392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dd1ba-f2dc-4a0a-a1b5-a873b577bfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:49.989146 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dd1ba-f2dc-4a0a-a1b5-a873b577bfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:49.990321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dd1ba-f2dc-4a0a-a1b5-a873b577bfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:49.990709 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dd1ba-f2dc-4a0a-a1b5-a873b577bfd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:49.993727 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dd1ba-f2dc-4a0a-a1b5-a873b577bfd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:49.996189 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dd1ba-f2dc-4a0a-a1b5-a873b577bfd1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:50.023172 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1063/2108] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:50.028206 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dd1ba-f2dc-4a0a-a1b5-a873b577bfd1 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:50.078182 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dd1ba-f2dc-4a0a-a1b5-a873b577bfd1 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:50.084979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab93e23-4085-420c-8064-ae902e9af1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:50.085219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab93e23-4085-420c-8064-ae902e9af1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:50.085395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab93e23-4085-420c-8064-ae902e9af1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:50.085733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab93e23-4085-420c-8064-ae902e9af1a0 admin admin] PATH_INFO: `/v3/projects/bae664b462364dfdbf6d6ec3e13dab25/users/0b41ee5e57b140bba1db740899816f8f/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:50.088667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab93e23-4085-420c-8064-ae902e9af1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bae664b462364dfdbf6d6ec3e13dab25, user_id=0b41ee5e57b140bba1db740899816f8f, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:50.091985 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab93e23-4085-420c-8064-ae902e9af1a0 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:50.104909 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1064/2109] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:50 2022] PUT /identity/v3/projects/bae664b462364dfdbf6d6ec3e13dab25/users/0b41ee5e57b140bba1db740899816f8f/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:50.116709 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f041b9-2cf2-4a8c-ac39-6895a1885b2c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:50.117121 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f041b9-2cf2-4a8c-ac39-6895a1885b2c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:50.117310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f041b9-2cf2-4a8c-ac39-6895a1885b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:50.135835 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1046/2110] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:50.141028 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0eba1-7100-4719-b5dc-06ad657d4162 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:50.144929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-64a0eba1-7100-4719-b5dc-06ad657d4162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:50.175188 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-40f041b9-2cf2-4a8c-ac39-6895a1885b2c None None] MFA Rules not processed for user `0b41ee5e57b140bba1db740899816f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:50.175470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0eba1-7100-4719-b5dc-06ad657d4162 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:50.177412 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-40f041b9-2cf2-4a8c-ac39-6895a1885b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:50.258846 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:50.332947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44660ec4-5b2a-4e55-9eb3-c64bcf3dc0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:50.336433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44660ec4-5b2a-4e55-9eb3-c64bcf3dc0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:50.336731 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44660ec4-5b2a-4e55-9eb3-c64bcf3dc0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:50.346674 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44660ec4-5b2a-4e55-9eb3-c64bcf3dc0e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:50.348437 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44660ec4-5b2a-4e55-9eb3-c64bcf3dc0e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:50.354486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44660ec4-5b2a-4e55-9eb3-c64bcf3dc0e5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:50.368245 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1065/2111] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:50.370320 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f041b9-2cf2-4a8c-ac39-6895a1885b2c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:50.371672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-40f041b9-2cf2-4a8c-ac39-6895a1885b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:50.390976 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f041b9-2cf2-4a8c-ac39-6895a1885b2c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:50.398336 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312d36b-67b2-4e2e-83b9-6ae14f6338d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:50.399446 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312d36b-67b2-4e2e-83b9-6ae14f6338d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:50.400138 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312d36b-67b2-4e2e-83b9-6ae14f6338d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:50.400428 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312d36b-67b2-4e2e-83b9-6ae14f6338d0 admin admin] PATH_INFO: `/v3/projects/ca4036e0ba744e259e06c68041dacb2e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:50.402209 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312d36b-67b2-4e2e-83b9-6ae14f6338d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4036e0ba744e259e06c68041dacb2e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:50.404466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312d36b-67b2-4e2e-83b9-6ae14f6338d0 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:50.426026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1047/2112] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:50 2022] POST /identity/v3/projects => generated 385 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:50.427154 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44660ec4-5b2a-4e55-9eb3-c64bcf3dc0e5 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:50.429973 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-44660ec4-5b2a-4e55-9eb3-c64bcf3dc0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:50.489434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5312d36b-67b2-4e2e-83b9-6ae14f6338d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4036e0ba744e259e06c68041dacb2e', 'request_id': 'req-5312d36b-67b2-4e2e-83b9-6ae14f6338d0'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:50.517522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5312d36b-67b2-4e2e-83b9-6ae14f6338d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4036e0ba744e259e06c68041dacb2e', 'request_id': 'req-5312d36b-67b2-4e2e-83b9-6ae14f6338d0'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:50.531834 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5312d36b-67b2-4e2e-83b9-6ae14f6338d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4036e0ba744e259e06c68041dacb2e', 'request_id': 'req-5312d36b-67b2-4e2e-83b9-6ae14f6338d0'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:50.547262 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5312d36b-67b2-4e2e-83b9-6ae14f6338d0 admin admin] The token cache is being invalidate because project ca4036e0ba744e259e06c68041dacb2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:50.547939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5312d36b-67b2-4e2e-83b9-6ae14f6338d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:50.548778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5312d36b-67b2-4e2e-83b9-6ae14f6338d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:50.550588 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1066/2113] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:50 2022] DELETE /identity/v3/projects/ca4036e0ba744e259e06c68041dacb2e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:50.551583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312d36b-67b2-4e2e-83b9-6ae14f6338d0 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:50.552927 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5312d36b-67b2-4e2e-83b9-6ae14f6338d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:50.657951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:50.665070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44660ec4-5b2a-4e55-9eb3-c64bcf3dc0e5 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:50.721907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312d36b-67b2-4e2e-83b9-6ae14f6338d0 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:50.741707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157256d3-8dce-4994-bf79-960177157189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:50.742352 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157256d3-8dce-4994-bf79-960177157189 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:50.742633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157256d3-8dce-4994-bf79-960177157189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:50.742907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157256d3-8dce-4994-bf79-960177157189 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:50.743838 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157256d3-8dce-4994-bf79-960177157189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:50.755851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157256d3-8dce-4994-bf79-960177157189 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:50.795937 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1067/2114] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:50 2022] POST /identity/v3/users => generated 299 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:50.802023 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852aef3a-03b1-4ee5-bd4e-0a05d37b2ccd None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:50.802255 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852aef3a-03b1-4ee5-bd4e-0a05d37b2ccd None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:50.802756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745a366-3150-421f-a355-dc13453fa00c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:50.804106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745a366-3150-421f-a355-dc13453fa00c service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:50.804456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745a366-3150-421f-a355-dc13453fa00c service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:50.804797 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745a366-3150-421f-a355-dc13453fa00c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:50.805002 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852aef3a-03b1-4ee5-bd4e-0a05d37b2ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:50.809779 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8745a366-3150-421f-a355-dc13453fa00c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:50.840379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-852aef3a-03b1-4ee5-bd4e-0a05d37b2ccd None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:50.842514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-852aef3a-03b1-4ee5-bd4e-0a05d37b2ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:50.866566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1068/2115] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:50.866566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852aef3a-03b1-4ee5-bd4e-0a05d37b2ccd None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:50.880930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852aef3a-03b1-4ee5-bd4e-0a05d37b2ccd None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:50.887158 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8ee3e-b66b-46ab-a088-dc0bf2bfef06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:50.888991 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8ee3e-b66b-46ab-a088-dc0bf2bfef06 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:50.891057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8ee3e-b66b-46ab-a088-dc0bf2bfef06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:50.891057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8ee3e-b66b-46ab-a088-dc0bf2bfef06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:50.892043 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8ee3e-b66b-46ab-a088-dc0bf2bfef06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:50.893730 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8ee3e-b66b-46ab-a088-dc0bf2bfef06 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:50.906734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745a366-3150-421f-a355-dc13453fa00c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:50.908279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1069/2116] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:50.908582 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745a366-3150-421f-a355-dc13453fa00c service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:50.914024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bcb8f-6750-4ded-915e-6158dc0e35da None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:50.914324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bcb8f-6750-4ded-915e-6158dc0e35da None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:50.914603 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bcb8f-6750-4ded-915e-6158dc0e35da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:50.922983 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1048/2117] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:50.923758 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745a366-3150-421f-a355-dc13453fa00c service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:50.949063 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-864bcb8f-6750-4ded-915e-6158dc0e35da None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:50.950057 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745a366-3150-421f-a355-dc13453fa00c service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:50.950521 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-864bcb8f-6750-4ded-915e-6158dc0e35da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:50.963242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791ca45-cd52-492e-96f6-1d3d8ba408f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:50.966328 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791ca45-cd52-492e-96f6-1d3d8ba408f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:50.967823 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791ca45-cd52-492e-96f6-1d3d8ba408f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:50.968288 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791ca45-cd52-492e-96f6-1d3d8ba408f1 admin admin] PATH_INFO: `/v3/projects/63e83d012e1643358b11637c0279658f/users/276e34228e454afba1a20007fb6776e1/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:50.969198 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1070/2118] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:50.970237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bcb8f-6750-4ded-915e-6158dc0e35da None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:50.992215 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bcb8f-6750-4ded-915e-6158dc0e35da None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:50.997625 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791ca45-cd52-492e-96f6-1d3d8ba408f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e83d012e1643358b11637c0279658f, user_id=276e34228e454afba1a20007fb6776e1, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:50.999819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220b9d2-74a1-4ed6-a6de-b261d46e3d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:51.000560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791ca45-cd52-492e-96f6-1d3d8ba408f1 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:51.000864 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220b9d2-74a1-4ed6-a6de-b261d46e3d1b admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.001332 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220b9d2-74a1-4ed6-a6de-b261d46e3d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.001715 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220b9d2-74a1-4ed6-a6de-b261d46e3d1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.002805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220b9d2-74a1-4ed6-a6de-b261d46e3d1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:51.003070 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220b9d2-74a1-4ed6-a6de-b261d46e3d1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:51.005105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220b9d2-74a1-4ed6-a6de-b261d46e3d1b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:51.025539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1071/2119] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:51.025539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220b9d2-74a1-4ed6-a6de-b261d46e3d1b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:51.025539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b220b9d2-74a1-4ed6-a6de-b261d46e3d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:51.030003 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1049/2120] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:50 2022] PUT /identity/v3/projects/63e83d012e1643358b11637c0279658f/users/276e34228e454afba1a20007fb6776e1/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:51.035434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791ca45-cd52-492e-96f6-1d3d8ba408f1 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:51.038032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220b9d2-74a1-4ed6-a6de-b261d46e3d1b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:51.057676 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:51.163526 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791ca45-cd52-492e-96f6-1d3d8ba408f1 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:51.171255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886f88d-6771-4e0e-abc9-73629bb5ae73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:51.172615 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886f88d-6771-4e0e-abc9-73629bb5ae73 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.173005 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886f88d-6771-4e0e-abc9-73629bb5ae73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.173658 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886f88d-6771-4e0e-abc9-73629bb5ae73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.174871 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886f88d-6771-4e0e-abc9-73629bb5ae73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:51.178624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886f88d-6771-4e0e-abc9-73629bb5ae73 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:51.190381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa9df1-1e20-4d3a-bef7-0d0742fff384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:51.191785 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa9df1-1e20-4d3a-bef7-0d0742fff384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.192221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa9df1-1e20-4d3a-bef7-0d0742fff384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.192644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa9df1-1e20-4d3a-bef7-0d0742fff384 admin admin] PATH_INFO: `/v3/users/e2c3070f1bae44c2acc180f88c6f1343` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.194408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa9df1-1e20-4d3a-bef7-0d0742fff384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c3070f1bae44c2acc180f88c6f1343)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:51.196515 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa9df1-1e20-4d3a-bef7-0d0742fff384 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:51.238883 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1050/2121] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:51 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:51.242041 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886f88d-6771-4e0e-abc9-73629bb5ae73 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:51.276541 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2afa9df1-1e20-4d3a-bef7-0d0742fff384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c3070f1bae44c2acc180f88c6f1343'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:51.277344 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2afa9df1-1e20-4d3a-bef7-0d0742fff384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c3070f1bae44c2acc180f88c6f1343'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:51.286014 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:51.289534 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2afa9df1-1e20-4d3a-bef7-0d0742fff384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c3070f1bae44c2acc180f88c6f1343'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:51.306761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2afa9df1-1e20-4d3a-bef7-0d0742fff384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c3070f1bae44c2acc180f88c6f1343'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:51.313850 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2afa9df1-1e20-4d3a-bef7-0d0742fff384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c3070f1bae44c2acc180f88c6f1343'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:51.351660 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1072/2122] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:51 2022] DELETE /identity/v3/users/e2c3070f1bae44c2acc180f88c6f1343 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:51.357085 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa9df1-1e20-4d3a-bef7-0d0742fff384 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:51.359372 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2afa9df1-1e20-4d3a-bef7-0d0742fff384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:51.417987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886f88d-6771-4e0e-abc9-73629bb5ae73 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:51.461234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa9df1-1e20-4d3a-bef7-0d0742fff384 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:51.467394 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7179691-495b-4352-8fd5-f1465c8e0cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:51.468581 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7179691-495b-4352-8fd5-f1465c8e0cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.468581 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7179691-495b-4352-8fd5-f1465c8e0cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.468800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7179691-495b-4352-8fd5-f1465c8e0cd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.469336 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7179691-495b-4352-8fd5-f1465c8e0cd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:51.475714 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7179691-495b-4352-8fd5-f1465c8e0cd3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:51.522551 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8e351-1591-4eff-bab1-c90187d2384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:51.523277 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8e351-1591-4eff-bab1-c90187d2384e admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.523598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8e351-1591-4eff-bab1-c90187d2384e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.523832 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8e351-1591-4eff-bab1-c90187d2384e admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.524777 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8e351-1591-4eff-bab1-c90187d2384e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:51.526810 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8e351-1591-4eff-bab1-c90187d2384e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:51.542780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1051/2123] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:51.542780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7bfb6-9ac5-4ee2-8556-b403187cd351 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.542780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7bfb6-9ac5-4ee2-8556-b403187cd351 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.542780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7bfb6-9ac5-4ee2-8556-b403187cd351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.545778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1073/2124] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:51 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:51.546988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7179691-495b-4352-8fd5-f1465c8e0cd3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:51.548952 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d7179691-495b-4352-8fd5-f1465c8e0cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:51.565931 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-06d7bfb6-9ac5-4ee2-8556-b403187cd351 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:51.567197 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-06d7bfb6-9ac5-4ee2-8556-b403187cd351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:51.567658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7179691-495b-4352-8fd5-f1465c8e0cd3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:51.577159 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34eef71-6ebe-4c2c-9697-bb1f83e9969d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:51.578560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34eef71-6ebe-4c2c-9697-bb1f83e9969d admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.579056 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34eef71-6ebe-4c2c-9697-bb1f83e9969d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.579547 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34eef71-6ebe-4c2c-9697-bb1f83e9969d admin admin] PATH_INFO: `/v3/projects/63e83d012e1643358b11637c0279658f/users/276e34228e454afba1a20007fb6776e1/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.582950 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1052/2125] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:51.583400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34eef71-6ebe-4c2c-9697-bb1f83e9969d admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e83d012e1643358b11637c0279658f, user_id=276e34228e454afba1a20007fb6776e1, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:51.584183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7bfb6-9ac5-4ee2-8556-b403187cd351 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:51.597018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34eef71-6ebe-4c2c-9697-bb1f83e9969d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:51.598035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7bfb6-9ac5-4ee2-8556-b403187cd351 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:51.604070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eb613-d19e-4aac-beae-7dd2310dcbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:51.605108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eb613-d19e-4aac-beae-7dd2310dcbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.605619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eb613-d19e-4aac-beae-7dd2310dcbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.606142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eb613-d19e-4aac-beae-7dd2310dcbe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.607150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17eb613-d19e-4aac-beae-7dd2310dcbe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:51.609022 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17eb613-d19e-4aac-beae-7dd2310dcbe7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:51.626551 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1053/2127] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:51.628427 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1074/2127] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:51 2022] PUT /identity/v3/projects/63e83d012e1643358b11637c0279658f/users/276e34228e454afba1a20007fb6776e1/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:51.628840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eb613-d19e-4aac-beae-7dd2310dcbe7 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:51.636718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34eef71-6ebe-4c2c-9697-bb1f83e9969d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:51.642581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a17eb613-d19e-4aac-beae-7dd2310dcbe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:51.675354 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:51.770056 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34eef71-6ebe-4c2c-9697-bb1f83e9969d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:51.779678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a816a84-5bc3-46f4-8690-01fb20bad255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:51.780493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a816a84-5bc3-46f4-8690-01fb20bad255 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.780780 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a816a84-5bc3-46f4-8690-01fb20bad255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.781051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a816a84-5bc3-46f4-8690-01fb20bad255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.782389 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a816a84-5bc3-46f4-8690-01fb20bad255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:51.784798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a816a84-5bc3-46f4-8690-01fb20bad255 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:51.805518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1075/2128] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:51.807927 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a816a84-5bc3-46f4-8690-01fb20bad255 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:51.810436 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eb613-d19e-4aac-beae-7dd2310dcbe7 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:51.822600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a816a84-5bc3-46f4-8690-01fb20bad255 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:51.828658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775788c1-9337-4c1d-9329-eda7722ca565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:51.829766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775788c1-9337-4c1d-9329-eda7722ca565 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.830110 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775788c1-9337-4c1d-9329-eda7722ca565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.830365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775788c1-9337-4c1d-9329-eda7722ca565 admin admin] PATH_INFO: `/v3/projects/a6810917d9db4493998cd956465252e4/users/924fb874190d42bdb0838f70d7327d7c/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.867718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775788c1-9337-4c1d-9329-eda7722ca565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6810917d9db4493998cd956465252e4, user_id=924fb874190d42bdb0838f70d7327d7c, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:51.877592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775788c1-9337-4c1d-9329-eda7722ca565 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:51.914255 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1076/2129] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:51 2022] PUT /identity/v3/projects/a6810917d9db4493998cd956465252e4/users/924fb874190d42bdb0838f70d7327d7c/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:51.944586 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9622dd7-c0de-47c4-b1dd-f7108727b547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:51.945331 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9622dd7-c0de-47c4-b1dd-f7108727b547 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.945559 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df11a8a-2573-4e59-8779-7da2f5a14ea6 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:51.945681 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9622dd7-c0de-47c4-b1dd-f7108727b547 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.945972 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9622dd7-c0de-47c4-b1dd-f7108727b547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.949743 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df11a8a-2573-4e59-8779-7da2f5a14ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:51.950150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df11a8a-2573-4e59-8779-7da2f5a14ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:51.970752 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9622dd7-c0de-47c4-b1dd-f7108727b547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:51.972570 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9622dd7-c0de-47c4-b1dd-f7108727b547 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:51.989281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:52.017976 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5df11a8a-2573-4e59-8779-7da2f5a14ea6 None None] MFA Rules not processed for user `924fb874190d42bdb0838f70d7327d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:52.018675 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1054/2130] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:52.019493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5df11a8a-2573-4e59-8779-7da2f5a14ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:52.158639 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1077/2131] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:52.170970 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9622dd7-c0de-47c4-b1dd-f7108727b547 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:52.172782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c9622dd7-c0de-47c4-b1dd-f7108727b547 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:52.331900 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9622dd7-c0de-47c4-b1dd-f7108727b547 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:52.432571 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717669a-4837-448d-9991-4a82f96b6855 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:52.433571 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717669a-4837-448d-9991-4a82f96b6855 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:52.434161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717669a-4837-448d-9991-4a82f96b6855 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:52.434520 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717669a-4837-448d-9991-4a82f96b6855 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:52.448375 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717669a-4837-448d-9991-4a82f96b6855 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:52.457537 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717669a-4837-448d-9991-4a82f96b6855 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:52.471490 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1055/2132] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:52.905264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df11a8a-2573-4e59-8779-7da2f5a14ea6 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:52.907799 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5df11a8a-2573-4e59-8779-7da2f5a14ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:53.120964 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df11a8a-2573-4e59-8779-7da2f5a14ea6 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:53.132336 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18330ca-db5e-4566-813f-0510e584ff92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:53.134423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18330ca-db5e-4566-813f-0510e584ff92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:53.135057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18330ca-db5e-4566-813f-0510e584ff92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:53.136493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18330ca-db5e-4566-813f-0510e584ff92 admin admin] PATH_INFO: `/v3/projects/b101865043524c0898ead451e6de777e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:53.138654 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18330ca-db5e-4566-813f-0510e584ff92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b101865043524c0898ead451e6de777e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:53.140885 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18330ca-db5e-4566-813f-0510e584ff92 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:53.155037 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:53.256306 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f18330ca-db5e-4566-813f-0510e584ff92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b101865043524c0898ead451e6de777e', 'request_id': 'req-f18330ca-db5e-4566-813f-0510e584ff92'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:53.274191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f18330ca-db5e-4566-813f-0510e584ff92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b101865043524c0898ead451e6de777e', 'request_id': 'req-f18330ca-db5e-4566-813f-0510e584ff92'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:53.288455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f18330ca-db5e-4566-813f-0510e584ff92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b101865043524c0898ead451e6de777e', 'request_id': 'req-f18330ca-db5e-4566-813f-0510e584ff92'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:53.322653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f18330ca-db5e-4566-813f-0510e584ff92 admin admin] The token cache is being invalidate because project b101865043524c0898ead451e6de777e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:53.324436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f18330ca-db5e-4566-813f-0510e584ff92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:53.325590 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f18330ca-db5e-4566-813f-0510e584ff92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:53.334941 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1078/2133] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:52 2022] DELETE /identity/v3/projects/b101865043524c0898ead451e6de777e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:53.335888 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717669a-4837-448d-9991-4a82f96b6855 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:53.352404 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717669a-4837-448d-9991-4a82f96b6855 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:53.448525 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7c135-e748-46be-9229-cb5503d938f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:53.449733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7c135-e748-46be-9229-cb5503d938f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:53.450199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7c135-e748-46be-9229-cb5503d938f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:53.450472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7c135-e748-46be-9229-cb5503d938f2 admin admin] PATH_INFO: `/v3/users/0b41ee5e57b140bba1db740899816f8f` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:53.453028 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7c135-e748-46be-9229-cb5503d938f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b41ee5e57b140bba1db740899816f8f)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:53.454704 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7c135-e748-46be-9229-cb5503d938f2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:53.542766 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-17d7c135-e748-46be-9229-cb5503d938f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b41ee5e57b140bba1db740899816f8f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:53.543542 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-17d7c135-e748-46be-9229-cb5503d938f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b41ee5e57b140bba1db740899816f8f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:53.554318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-17d7c135-e748-46be-9229-cb5503d938f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b41ee5e57b140bba1db740899816f8f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:53.557903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:53.608983 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-17d7c135-e748-46be-9229-cb5503d938f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b41ee5e57b140bba1db740899816f8f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:53.609930 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-17d7c135-e748-46be-9229-cb5503d938f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b41ee5e57b140bba1db740899816f8f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:53.639086 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1056/2134] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:53 2022] DELETE /identity/v3/users/0b41ee5e57b140bba1db740899816f8f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:54.136517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b91a38-2268-427c-898d-da2b193af448 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:54.137440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b91a38-2268-427c-898d-da2b193af448 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:54.137687 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b91a38-2268-427c-898d-da2b193af448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:54.161572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b6b91a38-2268-427c-898d-da2b193af448 None None] MFA Rules not processed for user `7de00142413f4f57b4782279bc826f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:54.163242 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b6b91a38-2268-427c-898d-da2b193af448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:54.290596 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1079/2135] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:54.526587 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7c135-e748-46be-9229-cb5503d938f2 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:54.533631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-17d7c135-e748-46be-9229-cb5503d938f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:54.773303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7c135-e748-46be-9229-cb5503d938f2 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:54.786936 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015046d-5768-40c3-add6-5155dc644109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:54.788535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015046d-5768-40c3-add6-5155dc644109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:54.788963 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015046d-5768-40c3-add6-5155dc644109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:54.790305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015046d-5768-40c3-add6-5155dc644109 admin admin] PATH_INFO: `/v3/projects/bae664b462364dfdbf6d6ec3e13dab25` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:54.796533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015046d-5768-40c3-add6-5155dc644109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bae664b462364dfdbf6d6ec3e13dab25)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:54.801510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015046d-5768-40c3-add6-5155dc644109 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:54.899013 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1015046d-5768-40c3-add6-5155dc644109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bae664b462364dfdbf6d6ec3e13dab25', 'request_id': 'req-1015046d-5768-40c3-add6-5155dc644109'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:54.910105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1015046d-5768-40c3-add6-5155dc644109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bae664b462364dfdbf6d6ec3e13dab25', 'request_id': 'req-1015046d-5768-40c3-add6-5155dc644109'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:54.936423 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1015046d-5768-40c3-add6-5155dc644109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bae664b462364dfdbf6d6ec3e13dab25', 'request_id': 'req-1015046d-5768-40c3-add6-5155dc644109'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:54.953566 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1015046d-5768-40c3-add6-5155dc644109 admin admin] The token cache is being invalidate because project bae664b462364dfdbf6d6ec3e13dab25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:54.956513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1015046d-5768-40c3-add6-5155dc644109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:54.956513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1015046d-5768-40c3-add6-5155dc644109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:54.957004 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1057/2136] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:54 2022] DELETE /identity/v3/projects/bae664b462364dfdbf6d6ec3e13dab25 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:54.962328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da9a39-6099-4a11-b0d8-15545be8be56 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:54.963164 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da9a39-6099-4a11-b0d8-15545be8be56 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:54.963645 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da9a39-6099-4a11-b0d8-15545be8be56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.005082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-85da9a39-6099-4a11-b0d8-15545be8be56 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:55.006465 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-85da9a39-6099-4a11-b0d8-15545be8be56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:55.193154 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1080/2137] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:55.208242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d92d36-55bc-4e3c-88d1-2af7148ed9af None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:55.208586 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d92d36-55bc-4e3c-88d1-2af7148ed9af None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:55.208873 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d92d36-55bc-4e3c-88d1-2af7148ed9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.248971 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a7d92d36-55bc-4e3c-88d1-2af7148ed9af None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:55.251522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a7d92d36-55bc-4e3c-88d1-2af7148ed9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:55.306109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1058/2138] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:55.309816 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da9a39-6099-4a11-b0d8-15545be8be56 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:55.323456 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da9a39-6099-4a11-b0d8-15545be8be56 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:55.343151 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dee93-b9a1-4cb5-a0ab-e1ca06ec96c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:55.346283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dee93-b9a1-4cb5-a0ab-e1ca06ec96c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:55.346891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dee93-b9a1-4cb5-a0ab-e1ca06ec96c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:55.347514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dee93-b9a1-4cb5-a0ab-e1ca06ec96c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.351825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dee93-b9a1-4cb5-a0ab-e1ca06ec96c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:55.354054 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dee93-b9a1-4cb5-a0ab-e1ca06ec96c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:55.362510 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dee93-b9a1-4cb5-a0ab-e1ca06ec96c5 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:55.392188 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1081/2139] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:55.403382 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d92d36-55bc-4e3c-88d1-2af7148ed9af None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:55.416966 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d92d36-55bc-4e3c-88d1-2af7148ed9af None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:55.424923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1727d6e-5864-44d3-9c0c-8d05c913c995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:55.425661 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1727d6e-5864-44d3-9c0c-8d05c913c995 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:55.426177 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1727d6e-5864-44d3-9c0c-8d05c913c995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:55.426525 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1727d6e-5864-44d3-9c0c-8d05c913c995 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.427503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1727d6e-5864-44d3-9c0c-8d05c913c995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:55.431307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1727d6e-5864-44d3-9c0c-8d05c913c995 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:55.478159 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1059/2140] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:55 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:55.478868 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dee93-b9a1-4cb5-a0ab-e1ca06ec96c5 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:55.499399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dee93-b9a1-4cb5-a0ab-e1ca06ec96c5 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:55.547139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:55.631459 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff57a0-83f5-4fff-81f6-e066b9d66b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:55.634817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff57a0-83f5-4fff-81f6-e066b9d66b54 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:55.635388 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff57a0-83f5-4fff-81f6-e066b9d66b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:55.636058 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff57a0-83f5-4fff-81f6-e066b9d66b54 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.637272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff57a0-83f5-4fff-81f6-e066b9d66b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:55.642056 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff57a0-83f5-4fff-81f6-e066b9d66b54 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:55.691713 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1082/2141] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:55 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:55.695973 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1727d6e-5864-44d3-9c0c-8d05c913c995 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:55.710318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1727d6e-5864-44d3-9c0c-8d05c913c995 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:55.715485 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd01d6f-6c99-4079-8931-68825071d23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:55.716192 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd01d6f-6c99-4079-8931-68825071d23f admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:55.716470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd01d6f-6c99-4079-8931-68825071d23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:55.716743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd01d6f-6c99-4079-8931-68825071d23f admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.717495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd01d6f-6c99-4079-8931-68825071d23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:55.719222 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd01d6f-6c99-4079-8931-68825071d23f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:55.740548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1060/2142] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:55.746516 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff57a0-83f5-4fff-81f6-e066b9d66b54 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:55.763080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff57a0-83f5-4fff-81f6-e066b9d66b54 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:55.770234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6af4f-6c8c-46da-9b71-61522b9d647a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:55.771127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6af4f-6c8c-46da-9b71-61522b9d647a admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:55.771618 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6af4f-6c8c-46da-9b71-61522b9d647a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:55.772041 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6af4f-6c8c-46da-9b71-61522b9d647a admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.772951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6af4f-6c8c-46da-9b71-61522b9d647a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:55.774954 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6af4f-6c8c-46da-9b71-61522b9d647a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:55.791785 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1083/2143] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:55.795736 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd01d6f-6c99-4079-8931-68825071d23f admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:55.810554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd01d6f-6c99-4079-8931-68825071d23f admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:55.825413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05635e5d-8571-45e8-b492-51b0f5a45f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:55.826491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05635e5d-8571-45e8-b492-51b0f5a45f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:55.827519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05635e5d-8571-45e8-b492-51b0f5a45f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:55.827519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05635e5d-8571-45e8-b492-51b0f5a45f11 admin admin] PATH_INFO: `/v3/projects/0270a2b45164482383f4a420985962ea/users/6637d9af4dba4c05adf05fb3742d8105/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.866634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05635e5d-8571-45e8-b492-51b0f5a45f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0270a2b45164482383f4a420985962ea, user_id=6637d9af4dba4c05adf05fb3742d8105, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:55.869477 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05635e5d-8571-45e8-b492-51b0f5a45f11 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:55.899466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1061/2144] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:55 2022] PUT /identity/v3/projects/0270a2b45164482383f4a420985962ea/users/6637d9af4dba4c05adf05fb3742d8105/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:55.914907 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746607d-c57d-4c6b-af15-e4a956063996 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:55.915248 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746607d-c57d-4c6b-af15-e4a956063996 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:55.915656 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746607d-c57d-4c6b-af15-e4a956063996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:55.984455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9746607d-c57d-4c6b-af15-e4a956063996 None None] MFA Rules not processed for user `6637d9af4dba4c05adf05fb3742d8105`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:55.985776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9746607d-c57d-4c6b-af15-e4a956063996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:56.111180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1084/2145] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:56.120131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05635e5d-8571-45e8-b492-51b0f5a45f11 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:56.126091 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:56.266670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05635e5d-8571-45e8-b492-51b0f5a45f11 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:56.278148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a4556-09b8-49bc-be8a-42cc19c0110a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:56.280199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a4556-09b8-49bc-be8a-42cc19c0110a admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:56.280488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a4556-09b8-49bc-be8a-42cc19c0110a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:56.281233 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a4556-09b8-49bc-be8a-42cc19c0110a admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:56.282543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a4556-09b8-49bc-be8a-42cc19c0110a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:56.284130 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a4556-09b8-49bc-be8a-42cc19c0110a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:56.332645 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1062/2146] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:56 2022] POST /identity/v3/projects => generated 381 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:56.337322 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746607d-c57d-4c6b-af15-e4a956063996 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:56.356793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746607d-c57d-4c6b-af15-e4a956063996 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:56.470720 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ba9a2-16e2-457e-af02-a605a576b154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:56.471513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ba9a2-16e2-457e-af02-a605a576b154 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:56.471860 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ba9a2-16e2-457e-af02-a605a576b154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:56.472204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ba9a2-16e2-457e-af02-a605a576b154 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:56.473099 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ba9a2-16e2-457e-af02-a605a576b154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:56.475477 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ba9a2-16e2-457e-af02-a605a576b154 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:56.530698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1085/2147] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:02:56 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:56.534831 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a4556-09b8-49bc-be8a-42cc19c0110a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:56.547929 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a4556-09b8-49bc-be8a-42cc19c0110a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:56.555713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726524e6-dcc3-494b-b3f0-a6924c7241c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:56.556875 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726524e6-dcc3-494b-b3f0-a6924c7241c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:56.557136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726524e6-dcc3-494b-b3f0-a6924c7241c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:56.557376 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726524e6-dcc3-494b-b3f0-a6924c7241c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:56.558275 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726524e6-dcc3-494b-b3f0-a6924c7241c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:56.560032 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726524e6-dcc3-494b-b3f0-a6924c7241c8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:56.594725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ba9a2-16e2-457e-af02-a605a576b154 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:56.594860 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1063/2148] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:56.616931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ba9a2-16e2-457e-af02-a605a576b154 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:56.632609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691aabc-b0bf-4897-b2b3-345bfa0ed6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:56.633641 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691aabc-b0bf-4897-b2b3-345bfa0ed6bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:56.633962 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691aabc-b0bf-4897-b2b3-345bfa0ed6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:56.634599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691aabc-b0bf-4897-b2b3-345bfa0ed6bf admin admin] PATH_INFO: `/v3/projects/69ea755f45064f6a96bd3c1038291f3f/users/1a99b01a15de44a086d9b8239e8f7615/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:56.667400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691aabc-b0bf-4897-b2b3-345bfa0ed6bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ea755f45064f6a96bd3c1038291f3f, user_id=1a99b01a15de44a086d9b8239e8f7615, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:56.670371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691aabc-b0bf-4897-b2b3-345bfa0ed6bf admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:56.683060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:56.691358 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1086/2149] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:56 2022] PUT /identity/v3/projects/69ea755f45064f6a96bd3c1038291f3f/users/1a99b01a15de44a086d9b8239e8f7615/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:56.696029 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726524e6-dcc3-494b-b3f0-a6924c7241c8 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:56.709289 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726524e6-dcc3-494b-b3f0-a6924c7241c8 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:56.813204 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a97242-479e-43d8-8944-15e7065e32a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:56.814125 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a97242-479e-43d8-8944-15e7065e32a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:56.814401 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a97242-479e-43d8-8944-15e7065e32a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:56.814670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a97242-479e-43d8-8944-15e7065e32a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:56.815403 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a97242-479e-43d8-8944-15e7065e32a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:56.817033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a97242-479e-43d8-8944-15e7065e32a6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:56.832429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1064/2150] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:02:56.838303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691aabc-b0bf-4897-b2b3-345bfa0ed6bf admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:56.853612 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691aabc-b0bf-4897-b2b3-345bfa0ed6bf admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:56.860816 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a22f-dd48-4fe3-b385-f2d485edc84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:56.862087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a22f-dd48-4fe3-b385-f2d485edc84c admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:56.862365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a22f-dd48-4fe3-b385-f2d485edc84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:56.862635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a22f-dd48-4fe3-b385-f2d485edc84c admin admin] PATH_INFO: `/v3/projects/69ea755f45064f6a96bd3c1038291f3f/users/1a99b01a15de44a086d9b8239e8f7615/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:56.865641 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5a22f-dd48-4fe3-b385-f2d485edc84c admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ea755f45064f6a96bd3c1038291f3f, user_id=1a99b01a15de44a086d9b8239e8f7615, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:56.869143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5a22f-dd48-4fe3-b385-f2d485edc84c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:56.884044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1087/2151] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:02:56 2022] PUT /identity/v3/projects/69ea755f45064f6a96bd3c1038291f3f/users/1a99b01a15de44a086d9b8239e8f7615/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:56.894313 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15866ebd-b37f-4213-9528-d1a9f6c72c99 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:56.894601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15866ebd-b37f-4213-9528-d1a9f6c72c99 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:56.894885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15866ebd-b37f-4213-9528-d1a9f6c72c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:56.927180 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-15866ebd-b37f-4213-9528-d1a9f6c72c99 None None] MFA Rules not processed for user `1a99b01a15de44a086d9b8239e8f7615`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:56.928771 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-15866ebd-b37f-4213-9528-d1a9f6c72c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:57.023750 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:57.029149 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1065/2152] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:57.042155 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a22f-dd48-4fe3-b385-f2d485edc84c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:57.043983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-89a5a22f-dd48-4fe3-b385-f2d485edc84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:57.114378 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a22f-dd48-4fe3-b385-f2d485edc84c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:57.118283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273803d5-8f5b-43b1-81e3-de50671955f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:57.118963 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273803d5-8f5b-43b1-81e3-de50671955f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:57.119238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273803d5-8f5b-43b1-81e3-de50671955f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:57.119515 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273803d5-8f5b-43b1-81e3-de50671955f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:57.131388 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273803d5-8f5b-43b1-81e3-de50671955f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:57.133060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273803d5-8f5b-43b1-81e3-de50671955f2 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:57.148194 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1088/2153] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:02:57.636313 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15866ebd-b37f-4213-9528-d1a9f6c72c99 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:57.649549 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15866ebd-b37f-4213-9528-d1a9f6c72c99 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:57.675670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13773f-4742-4f54-ae15-f58371779d66 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a99b01a15de44a086d9b8239e8f7615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ea755f45064f6a96bd3c1038291f3f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:57.676430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13773f-4742-4f54-ae15-f58371779d66 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:57.676798 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13773f-4742-4f54-ae15-f58371779d66 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:57.676970 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13773f-4742-4f54-ae15-f58371779d66 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:57.677724 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13773f-4742-4f54-ae15-f58371779d66 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:57.678079 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13773f-4742-4f54-ae15-f58371779d66 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:57.679710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13773f-4742-4f54-ae15-f58371779d66 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:57.726049 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273803d5-8f5b-43b1-81e3-de50671955f2 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:57.730086 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1066/2154] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:02:57.742596 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273803d5-8f5b-43b1-81e3-de50671955f2 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:57.750059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc1948-af11-4567-b7d5-00e7a3ecfb7d tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a99b01a15de44a086d9b8239e8f7615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ea755f45064f6a96bd3c1038291f3f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:57.751576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc1948-af11-4567-b7d5-00e7a3ecfb7d tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:57.752126 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc1948-af11-4567-b7d5-00e7a3ecfb7d tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:57.752597 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc1948-af11-4567-b7d5-00e7a3ecfb7d tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:57.753685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc1948-af11-4567-b7d5-00e7a3ecfb7d tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:57.762133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc1948-af11-4567-b7d5-00e7a3ecfb7d tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:57.828070 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1089/2155] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:02:57 2022] POST /identity/v3/projects => generated 354 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:02:57.829138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13773f-4742-4f54-ae15-f58371779d66 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:57.840538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13773f-4742-4f54-ae15-f58371779d66 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:57.999539 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dc3de-1e2a-49cc-9d4a-baea3823afc2 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a99b01a15de44a086d9b8239e8f7615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ea755f45064f6a96bd3c1038291f3f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:58.003311 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dc3de-1e2a-49cc-9d4a-baea3823afc2 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:58.005852 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dc3de-1e2a-49cc-9d4a-baea3823afc2 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:58.006309 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dc3de-1e2a-49cc-9d4a-baea3823afc2 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:58.007252 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572dc3de-1e2a-49cc-9d4a-baea3823afc2 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:02:58.009268 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572dc3de-1e2a-49cc-9d4a-baea3823afc2 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:58.011156 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572dc3de-1e2a-49cc-9d4a-baea3823afc2 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:58.055194 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1067/2156] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:02:58.331837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc1948-af11-4567-b7d5-00e7a3ecfb7d tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:58.355893 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc1948-af11-4567-b7d5-00e7a3ecfb7d tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:58.371572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037810c-95e1-4605-bad6-6e8a00a50257 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a99b01a15de44a086d9b8239e8f7615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69ea755f45064f6a96bd3c1038291f3f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:58.373748 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037810c-95e1-4605-bad6-6e8a00a50257 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:58.376558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037810c-95e1-4605-bad6-6e8a00a50257 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:58.376990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037810c-95e1-4605-bad6-6e8a00a50257 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] PATH_INFO: `/v3/projects/a4decc70c05b48daa3225730b19cc831` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:58.384719 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037810c-95e1-4605-bad6-6e8a00a50257 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a4decc70c05b48daa3225730b19cc831)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:58.389861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037810c-95e1-4605-bad6-6e8a00a50257 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:58.587043 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b037810c-95e1-4605-bad6-6e8a00a50257 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4decc70c05b48daa3225730b19cc831', 'request_id': 'req-b037810c-95e1-4605-bad6-6e8a00a50257'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:58.626418 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b037810c-95e1-4605-bad6-6e8a00a50257 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4decc70c05b48daa3225730b19cc831', 'request_id': 'req-b037810c-95e1-4605-bad6-6e8a00a50257'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:58.657146 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b037810c-95e1-4605-bad6-6e8a00a50257 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4decc70c05b48daa3225730b19cc831', 'request_id': 'req-b037810c-95e1-4605-bad6-6e8a00a50257'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:58.689306 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b037810c-95e1-4605-bad6-6e8a00a50257 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] The token cache is being invalidate because project a4decc70c05b48daa3225730b19cc831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:02:58.689596 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b037810c-95e1-4605-bad6-6e8a00a50257 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:58.693143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b037810c-95e1-4605-bad6-6e8a00a50257 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:58.701184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1090/2157] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:02:58 2022] DELETE /identity/v3/projects/a4decc70c05b48daa3225730b19cc831 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:59.203746 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dc3de-1e2a-49cc-9d4a-baea3823afc2 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:59.205847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-572dc3de-1e2a-49cc-9d4a-baea3823afc2 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:59.323323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dc3de-1e2a-49cc-9d4a-baea3823afc2 tempest-VolumeQuotaClassesTest-2035493728 tempest-VolumeQuotaClassesTest-2035493728-project-admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:59.436257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc583c2-031c-4c3d-95cf-b399fda8497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:59.437234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc583c2-031c-4c3d-95cf-b399fda8497e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:59.437510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc583c2-031c-4c3d-95cf-b399fda8497e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:59.437779 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc583c2-031c-4c3d-95cf-b399fda8497e admin admin] PATH_INFO: `/v3/users/6637d9af4dba4c05adf05fb3742d8105` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:59.442147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc583c2-031c-4c3d-95cf-b399fda8497e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6637d9af4dba4c05adf05fb3742d8105)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:59.444174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc583c2-031c-4c3d-95cf-b399fda8497e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:59.490352 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:59.514866 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1cc583c2-031c-4c3d-95cf-b399fda8497e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6637d9af4dba4c05adf05fb3742d8105'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:59.515550 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1cc583c2-031c-4c3d-95cf-b399fda8497e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6637d9af4dba4c05adf05fb3742d8105'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:59.531484 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1cc583c2-031c-4c3d-95cf-b399fda8497e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6637d9af4dba4c05adf05fb3742d8105'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:59.549695 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1cc583c2-031c-4c3d-95cf-b399fda8497e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6637d9af4dba4c05adf05fb3742d8105'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:59.550663 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1cc583c2-031c-4c3d-95cf-b399fda8497e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6637d9af4dba4c05adf05fb3742d8105'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:02:59.575036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1068/2158] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:02:59 2022] DELETE /identity/v3/users/6637d9af4dba4c05adf05fb3742d8105 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:02:59.577021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4155df-e5a4-4c64-8cb3-03f8b2891670 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:59.577515 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4155df-e5a4-4c64-8cb3-03f8b2891670 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:59.577635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4155df-e5a4-4c64-8cb3-03f8b2891670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:59.602184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ac4155df-e5a4-4c64-8cb3-03f8b2891670 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:02:59.603768 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ac4155df-e5a4-4c64-8cb3-03f8b2891670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:59.682047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:02:59.719162 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1091/2159] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:02:59.732172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc583c2-031c-4c3d-95cf-b399fda8497e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:02:59.735075 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1cc583c2-031c-4c3d-95cf-b399fda8497e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:02:59.865100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc583c2-031c-4c3d-95cf-b399fda8497e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:02:59.877716 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862782a0-b534-4fc8-8a18-323effa5b28a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:02:59.877716 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862782a0-b534-4fc8-8a18-323effa5b28a service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:02:59.877716 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862782a0-b534-4fc8-8a18-323effa5b28a service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:02:59.877716 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862782a0-b534-4fc8-8a18-323effa5b28a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:02:59.898272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862782a0-b534-4fc8-8a18-323effa5b28a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:02:59.902111 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862782a0-b534-4fc8-8a18-323effa5b28a service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:02:59.945893 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1069/2160] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:03:00.167712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c14f75-f74d-455b-a06d-fb50d360ba84 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:00.168003 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c14f75-f74d-455b-a06d-fb50d360ba84 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:00.168319 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c14f75-f74d-455b-a06d-fb50d360ba84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:00.214977 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c3c14f75-f74d-455b-a06d-fb50d360ba84 None None] MFA Rules not processed for user `276e34228e454afba1a20007fb6776e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:00.216739 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c3c14f75-f74d-455b-a06d-fb50d360ba84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:00.331123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1092/2161] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:00.348631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862782a0-b534-4fc8-8a18-323effa5b28a service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:00.350570 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-862782a0-b534-4fc8-8a18-323effa5b28a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:00.422892 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862782a0-b534-4fc8-8a18-323effa5b28a service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:00.437140 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a109c0-a193-482b-8684-c085e2a3a466 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1b010003c44dc19643558167424d13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:00.438213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a109c0-a193-482b-8684-c085e2a3a466 service glance] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:00.438340 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a109c0-a193-482b-8684-c085e2a3a466 service glance] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:00.438622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a109c0-a193-482b-8684-c085e2a3a466 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:00.441400 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c8a109c0-a193-482b-8684-c085e2a3a466 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:00.510028 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c14f75-f74d-455b-a06d-fb50d360ba84 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:00.511638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c3c14f75-f74d-455b-a06d-fb50d360ba84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:00.528685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c14f75-f74d-455b-a06d-fb50d360ba84 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:00.541876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a43d8-00d8-4383-8cc1-e8303ee821f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:00.543255 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a43d8-00d8-4383-8cc1-e8303ee821f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:00.543786 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a43d8-00d8-4383-8cc1-e8303ee821f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:00.544261 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a43d8-00d8-4383-8cc1-e8303ee821f7 admin admin] PATH_INFO: `/v3/projects/0270a2b45164482383f4a420985962ea` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:00.546045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a43d8-00d8-4383-8cc1-e8303ee821f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0270a2b45164482383f4a420985962ea)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:00.549541 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a43d8-00d8-4383-8cc1-e8303ee821f7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:00.558948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a109c0-a193-482b-8684-c085e2a3a466 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:00.568727 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a109c0-a193-482b-8684-c085e2a3a466 service glance] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:00.583539 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1070/2162] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:03:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:03:00.619383 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0a6a43d8-00d8-4383-8cc1-e8303ee821f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0270a2b45164482383f4a420985962ea', 'request_id': 'req-0a6a43d8-00d8-4383-8cc1-e8303ee821f7'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:00.635253 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0a6a43d8-00d8-4383-8cc1-e8303ee821f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0270a2b45164482383f4a420985962ea', 'request_id': 'req-0a6a43d8-00d8-4383-8cc1-e8303ee821f7'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:00.655761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0a6a43d8-00d8-4383-8cc1-e8303ee821f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0270a2b45164482383f4a420985962ea', 'request_id': 'req-0a6a43d8-00d8-4383-8cc1-e8303ee821f7'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:00.676562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0a6a43d8-00d8-4383-8cc1-e8303ee821f7 admin admin] The token cache is being invalidate because project 0270a2b45164482383f4a420985962ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:03:00.676867 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0a6a43d8-00d8-4383-8cc1-e8303ee821f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:00.677570 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0a6a43d8-00d8-4383-8cc1-e8303ee821f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:00.679415 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1093/2163] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:03:00 2022] DELETE /identity/v3/projects/0270a2b45164482383f4a420985962ea => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:00.683487 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a109c0-a193-482b-8684-c085e2a3a466 service glance] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:00.691503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:00.698368 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a109c0-a193-482b-8684-c085e2a3a466 service glance] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:00.744085 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae695fd-0324-4a9f-a929-e48a407a8e70 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:00.744411 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae695fd-0324-4a9f-a929-e48a407a8e70 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:00.744624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae695fd-0324-4a9f-a929-e48a407a8e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:00.779428 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9ae695fd-0324-4a9f-a929-e48a407a8e70 None None] MFA Rules not processed for user `23aa142375c54b94ad276d1a4b9031e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:00.780718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9ae695fd-0324-4a9f-a929-e48a407a8e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:00.781207 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f34705-2d62-4440-b3d6-f6880f393e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:00.782416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f34705-2d62-4440-b3d6-f6880f393e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:00.782706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f34705-2d62-4440-b3d6-f6880f393e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:00.782979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f34705-2d62-4440-b3d6-f6880f393e2e admin admin] PATH_INFO: `/v3/users/1a99b01a15de44a086d9b8239e8f7615` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:00.784331 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f34705-2d62-4440-b3d6-f6880f393e2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a99b01a15de44a086d9b8239e8f7615)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:00.787273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f34705-2d62-4440-b3d6-f6880f393e2e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:00.852592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1094/2164] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 2 19:03:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:03:00.854421 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-18f34705-2d62-4440-b3d6-f6880f393e2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a99b01a15de44a086d9b8239e8f7615'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:00.855140 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-18f34705-2d62-4440-b3d6-f6880f393e2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a99b01a15de44a086d9b8239e8f7615'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:00.864254 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-18f34705-2d62-4440-b3d6-f6880f393e2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a99b01a15de44a086d9b8239e8f7615'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:00.878335 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-18f34705-2d62-4440-b3d6-f6880f393e2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a99b01a15de44a086d9b8239e8f7615'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:00.879147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-18f34705-2d62-4440-b3d6-f6880f393e2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a99b01a15de44a086d9b8239e8f7615'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:00.897341 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1071/2165] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:03:00 2022] DELETE /identity/v3/users/1a99b01a15de44a086d9b8239e8f7615 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:00.903393 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae695fd-0324-4a9f-a929-e48a407a8e70 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:00.904949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9ae695fd-0324-4a9f-a929-e48a407a8e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:00.912086 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:00.988447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae695fd-0324-4a9f-a929-e48a407a8e70 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:01.057424 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd04865-8f4b-42a1-87ae-a452faa5bb3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4faac48f82244bebf039aab92898617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:01.058738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd04865-8f4b-42a1-87ae-a452faa5bb3c service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:01.059007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd04865-8f4b-42a1-87ae-a452faa5bb3c service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:01.059288 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd04865-8f4b-42a1-87ae-a452faa5bb3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:01.064333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-cfd04865-8f4b-42a1-87ae-a452faa5bb3c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:01.138460 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd04865-8f4b-42a1-87ae-a452faa5bb3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:01.140200 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd04865-8f4b-42a1-87ae-a452faa5bb3c service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:01.153277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1095/2166] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 2 19:03:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:03:01.265915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f34705-2d62-4440-b3d6-f6880f393e2e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:01.267519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-18f34705-2d62-4440-b3d6-f6880f393e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:01.420110 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f34705-2d62-4440-b3d6-f6880f393e2e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:01.426575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897fec5-6a95-4f20-84ea-2b2002614dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:01.429575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897fec5-6a95-4f20-84ea-2b2002614dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:01.429575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897fec5-6a95-4f20-84ea-2b2002614dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:01.429575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897fec5-6a95-4f20-84ea-2b2002614dd2 admin admin] PATH_INFO: `/v3/projects/69ea755f45064f6a96bd3c1038291f3f` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:01.432166 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897fec5-6a95-4f20-84ea-2b2002614dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69ea755f45064f6a96bd3c1038291f3f)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:01.434362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897fec5-6a95-4f20-84ea-2b2002614dd2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:01.479140 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:01.546348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3897fec5-6a95-4f20-84ea-2b2002614dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69ea755f45064f6a96bd3c1038291f3f', 'request_id': 'req-3897fec5-6a95-4f20-84ea-2b2002614dd2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:01.556952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3897fec5-6a95-4f20-84ea-2b2002614dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69ea755f45064f6a96bd3c1038291f3f', 'request_id': 'req-3897fec5-6a95-4f20-84ea-2b2002614dd2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:01.578142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3897fec5-6a95-4f20-84ea-2b2002614dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69ea755f45064f6a96bd3c1038291f3f', 'request_id': 'req-3897fec5-6a95-4f20-84ea-2b2002614dd2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:01.606780 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3897fec5-6a95-4f20-84ea-2b2002614dd2 admin admin] The token cache is being invalidate because project 69ea755f45064f6a96bd3c1038291f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:03:01.607180 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3897fec5-6a95-4f20-84ea-2b2002614dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:01.607868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3897fec5-6a95-4f20-84ea-2b2002614dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:01.612954 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1072/2167] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:03:01 2022] DELETE /identity/v3/projects/69ea755f45064f6a96bd3c1038291f3f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:01.614570 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3403ea-bf84-453a-88fb-734cebd4cbb5 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:01.614864 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3403ea-bf84-453a-88fb-734cebd4cbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:01.615145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3403ea-bf84-453a-88fb-734cebd4cbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:01.651102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4d3403ea-bf84-453a-88fb-734cebd4cbb5 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:01.653277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4d3403ea-bf84-453a-88fb-734cebd4cbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:01.845869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:01.905059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1096/2168] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:03:01.916362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ef25a-51b9-4f33-a01f-bd7f20dd68e8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:01.916869 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ef25a-51b9-4f33-a01f-bd7f20dd68e8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:01.917434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ef25a-51b9-4f33-a01f-bd7f20dd68e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:01.948200 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-585ef25a-51b9-4f33-a01f-bd7f20dd68e8 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:01.949466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-585ef25a-51b9-4f33-a01f-bd7f20dd68e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:01.968534 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1073/2169] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:01.975979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3403ea-bf84-453a-88fb-734cebd4cbb5 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:01.993759 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3403ea-bf84-453a-88fb-734cebd4cbb5 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:02.015187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a26635-9fb7-4be1-a577-a8fbba1abf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:02.018553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a26635-9fb7-4be1-a577-a8fbba1abf83 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:02.018844 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a26635-9fb7-4be1-a577-a8fbba1abf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:02.019127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a26635-9fb7-4be1-a577-a8fbba1abf83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:02.019882 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a26635-9fb7-4be1-a577-a8fbba1abf83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:02.020197 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a26635-9fb7-4be1-a577-a8fbba1abf83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:02.021878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a26635-9fb7-4be1-a577-a8fbba1abf83 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:02.074559 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1097/2170] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:02.079489 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ef25a-51b9-4f33-a01f-bd7f20dd68e8 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:02.092171 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ef25a-51b9-4f33-a01f-bd7f20dd68e8 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:02.097415 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d95401-c121-4aa2-a997-d199e57ab4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:02.098151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d95401-c121-4aa2-a997-d199e57ab4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:02.098511 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d95401-c121-4aa2-a997-d199e57ab4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:02.098724 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d95401-c121-4aa2-a997-d199e57ab4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:02.099445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d95401-c121-4aa2-a997-d199e57ab4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:02.102533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d95401-c121-4aa2-a997-d199e57ab4d4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:02.168279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a26635-9fb7-4be1-a577-a8fbba1abf83 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:02.169388 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1074/2171] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:03:02 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:02.179971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a26635-9fb7-4be1-a577-a8fbba1abf83 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:02.295263 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ac5c0-45ee-4218-9f78-b191c42ebc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:02.296188 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ac5c0-45ee-4218-9f78-b191c42ebc01 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:02.296503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ac5c0-45ee-4218-9f78-b191c42ebc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:02.297439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ac5c0-45ee-4218-9f78-b191c42ebc01 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:02.298191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ac5c0-45ee-4218-9f78-b191c42ebc01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:02.301504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ac5c0-45ee-4218-9f78-b191c42ebc01 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:02.352786 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1098/2172] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:03:02 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:02.354393 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d95401-c121-4aa2-a997-d199e57ab4d4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:02.375497 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d95401-c121-4aa2-a997-d199e57ab4d4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:02.386474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61239dbd-88ac-4bee-83be-598159399520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:02.387311 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61239dbd-88ac-4bee-83be-598159399520 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:02.387707 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61239dbd-88ac-4bee-83be-598159399520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:02.387990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61239dbd-88ac-4bee-83be-598159399520 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:02.389366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61239dbd-88ac-4bee-83be-598159399520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:02.391360 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61239dbd-88ac-4bee-83be-598159399520 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:02.408435 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1075/2173] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:02.413148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ac5c0-45ee-4218-9f78-b191c42ebc01 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:02.432455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ac5c0-45ee-4218-9f78-b191c42ebc01 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:02.443005 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60949b-5f9b-4729-bafd-31c67c1e0f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:02.444157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60949b-5f9b-4729-bafd-31c67c1e0f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:02.446798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60949b-5f9b-4729-bafd-31c67c1e0f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:02.446798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60949b-5f9b-4729-bafd-31c67c1e0f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:02.446798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60949b-5f9b-4729-bafd-31c67c1e0f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:02.450142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60949b-5f9b-4729-bafd-31c67c1e0f4e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:02.494375 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61239dbd-88ac-4bee-83be-598159399520 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:02.495043 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1099/2174] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:02.516985 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61239dbd-88ac-4bee-83be-598159399520 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:02.560766 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95165995-35af-49c1-93c5-3c1b0bd28314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:02.566779 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95165995-35af-49c1-93c5-3c1b0bd28314 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:02.569828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95165995-35af-49c1-93c5-3c1b0bd28314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:02.569828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95165995-35af-49c1-93c5-3c1b0bd28314 admin admin] PATH_INFO: `/v3/projects/5c179ff8041746329673191ef455d16c/users/8f3069a6d1394cabb0637febc9b17bf9/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:02.608969 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95165995-35af-49c1-93c5-3c1b0bd28314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c179ff8041746329673191ef455d16c, user_id=8f3069a6d1394cabb0637febc9b17bf9, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:02.614211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95165995-35af-49c1-93c5-3c1b0bd28314 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:02.654912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1076/2175] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:03:02 2022] PUT /identity/v3/projects/5c179ff8041746329673191ef455d16c/users/8f3069a6d1394cabb0637febc9b17bf9/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:03:02.660689 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b84711-d99b-46ff-91c2-bea35924797e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:02.661300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b84711-d99b-46ff-91c2-bea35924797e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:02.661300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b84711-d99b-46ff-91c2-bea35924797e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:02.735885 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-67b84711-d99b-46ff-91c2-bea35924797e None None] MFA Rules not processed for user `8f3069a6d1394cabb0637febc9b17bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:02.739081 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-67b84711-d99b-46ff-91c2-bea35924797e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:02.940679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1100/2176] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:02.944880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95165995-35af-49c1-93c5-3c1b0bd28314 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:03.112837 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95165995-35af-49c1-93c5-3c1b0bd28314 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:03.124434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5547f2-c1d6-4aec-90c2-1710afb51357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:03.125504 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5547f2-c1d6-4aec-90c2-1710afb51357 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:03.126036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5547f2-c1d6-4aec-90c2-1710afb51357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:03.126476 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5547f2-c1d6-4aec-90c2-1710afb51357 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:03.131276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5547f2-c1d6-4aec-90c2-1710afb51357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:03.136050 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5547f2-c1d6-4aec-90c2-1710afb51357 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:03.214646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b84711-d99b-46ff-91c2-bea35924797e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:03.219582 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1077/2177] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:03:02 2022] POST /identity/v3/projects => generated 385 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:03:03.238594 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b84711-d99b-46ff-91c2-bea35924797e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:03.308987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:03.341923 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d9730-e1c7-490e-82d5-9cab9ed89e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:03.342856 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d9730-e1c7-490e-82d5-9cab9ed89e18 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:03.343710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d9730-e1c7-490e-82d5-9cab9ed89e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:03.346082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d9730-e1c7-490e-82d5-9cab9ed89e18 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:03.347960 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d9730-e1c7-490e-82d5-9cab9ed89e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:03.351637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d9730-e1c7-490e-82d5-9cab9ed89e18 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:03.414859 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1101/2178] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:03:03 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:03.419083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5547f2-c1d6-4aec-90c2-1710afb51357 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:03.435877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5547f2-c1d6-4aec-90c2-1710afb51357 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:03.447245 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c207e-d7e7-491b-9c04-d8469a92eb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:03.449428 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c207e-d7e7-491b-9c04-d8469a92eb33 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:03.450162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c207e-d7e7-491b-9c04-d8469a92eb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:03.450651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c207e-d7e7-491b-9c04-d8469a92eb33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:03.452288 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c207e-d7e7-491b-9c04-d8469a92eb33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:03.455236 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c207e-d7e7-491b-9c04-d8469a92eb33 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:03.480936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d9730-e1c7-490e-82d5-9cab9ed89e18 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:03.500008 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1078/2179] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:03.504982 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d9730-e1c7-490e-82d5-9cab9ed89e18 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:03.510770 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d040f-8c86-4a63-a768-cf511fd1da39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:03.511723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d040f-8c86-4a63-a768-cf511fd1da39 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:03.512670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d040f-8c86-4a63-a768-cf511fd1da39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:03.513100 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d040f-8c86-4a63-a768-cf511fd1da39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:03.515146 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d040f-8c86-4a63-a768-cf511fd1da39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:03.517557 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d040f-8c86-4a63-a768-cf511fd1da39 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:03.584510 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1102/2180] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:03.586156 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c207e-d7e7-491b-9c04-d8469a92eb33 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:03.610441 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c207e-d7e7-491b-9c04-d8469a92eb33 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:03.620614 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41447c1-76d2-47d2-8f32-4456c2956c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:03.622035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41447c1-76d2-47d2-8f32-4456c2956c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:03.622325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41447c1-76d2-47d2-8f32-4456c2956c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:03.622620 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41447c1-76d2-47d2-8f32-4456c2956c89 admin admin] PATH_INFO: `/v3/projects/0e8a34437e014c9db35086ab57a827ff/users/57dab02b70fe478b901929f9162682d4/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:03.647396 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41447c1-76d2-47d2-8f32-4456c2956c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8a34437e014c9db35086ab57a827ff, user_id=57dab02b70fe478b901929f9162682d4, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:03.650550 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41447c1-76d2-47d2-8f32-4456c2956c89 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:03.672734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:03.696491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1079/2181] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:03:03 2022] PUT /identity/v3/projects/0e8a34437e014c9db35086ab57a827ff/users/57dab02b70fe478b901929f9162682d4/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:03.698513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c0089-bc9c-448b-8be9-f49cd871407c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:03.699379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c0089-bc9c-448b-8be9-f49cd871407c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:03.699824 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c0089-bc9c-448b-8be9-f49cd871407c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:03.759905 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-8e1c0089-bc9c-448b-8be9-f49cd871407c None None] MFA Rules not processed for user `57dab02b70fe478b901929f9162682d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:03.761496 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8e1c0089-bc9c-448b-8be9-f49cd871407c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:03.911522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1103/2182] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:03:03.913871 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41447c1-76d2-47d2-8f32-4456c2956c89 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:04.095608 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41447c1-76d2-47d2-8f32-4456c2956c89 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:04.110661 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad86d2b-e708-4b8f-9548-b5d8c3aa8c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:04.116085 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad86d2b-e708-4b8f-9548-b5d8c3aa8c57 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:04.117018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad86d2b-e708-4b8f-9548-b5d8c3aa8c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:04.117541 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad86d2b-e708-4b8f-9548-b5d8c3aa8c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:04.118788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad86d2b-e708-4b8f-9548-b5d8c3aa8c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:04.121057 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad86d2b-e708-4b8f-9548-b5d8c3aa8c57 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:04.208774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1080/2183] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:03:03 2022] POST /identity/v3/projects => generated 387 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:04.213723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c0089-bc9c-448b-8be9-f49cd871407c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:04.229547 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c0089-bc9c-448b-8be9-f49cd871407c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:04.396776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fa000-c0ac-4127-8dfe-64db2fcc1085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:04.398598 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fa000-c0ac-4127-8dfe-64db2fcc1085 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:04.398598 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fa000-c0ac-4127-8dfe-64db2fcc1085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:04.404826 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fa000-c0ac-4127-8dfe-64db2fcc1085 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:04.405631 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fa000-c0ac-4127-8dfe-64db2fcc1085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:04.407864 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fa000-c0ac-4127-8dfe-64db2fcc1085 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:04.459866 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1104/2184] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:03:04 2022] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:04.461863 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad86d2b-e708-4b8f-9548-b5d8c3aa8c57 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:04.477225 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad86d2b-e708-4b8f-9548-b5d8c3aa8c57 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:04.482738 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0583da-d485-4279-9c6a-1dca1d6cb8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:04.483459 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0583da-d485-4279-9c6a-1dca1d6cb8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:04.483691 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0583da-d485-4279-9c6a-1dca1d6cb8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:04.484013 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0583da-d485-4279-9c6a-1dca1d6cb8d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:04.484735 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0583da-d485-4279-9c6a-1dca1d6cb8d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:04.486587 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0583da-d485-4279-9c6a-1dca1d6cb8d6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:04.512372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1081/2185] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:04.516771 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fa000-c0ac-4127-8dfe-64db2fcc1085 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:04.536470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fa000-c0ac-4127-8dfe-64db2fcc1085 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:04.549521 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f87d6e-0c25-45ff-8525-50aee8b6914c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:04.550800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f87d6e-0c25-45ff-8525-50aee8b6914c admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:04.553989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f87d6e-0c25-45ff-8525-50aee8b6914c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:04.554445 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f87d6e-0c25-45ff-8525-50aee8b6914c admin admin] PATH_INFO: `/v3/projects/4f1ee64f19fe4e07b61c76da404c8fbb/users/b18685a379b942d3b6328bfe9cb674d0/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:04.600125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f87d6e-0c25-45ff-8525-50aee8b6914c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1ee64f19fe4e07b61c76da404c8fbb, user_id=b18685a379b942d3b6328bfe9cb674d0, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:04.609673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f87d6e-0c25-45ff-8525-50aee8b6914c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:04.667698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1105/2186] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:03:04 2022] PUT /identity/v3/projects/4f1ee64f19fe4e07b61c76da404c8fbb/users/b18685a379b942d3b6328bfe9cb674d0/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:04.672917 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0583da-d485-4279-9c6a-1dca1d6cb8d6 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:04.687248 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0583da-d485-4279-9c6a-1dca1d6cb8d6 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:04.839956 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2657cf1-f6ce-4b4c-bdf3-afd58f264245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:04.842617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2657cf1-f6ce-4b4c-bdf3-afd58f264245 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:04.842930 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2657cf1-f6ce-4b4c-bdf3-afd58f264245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:04.843222 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2657cf1-f6ce-4b4c-bdf3-afd58f264245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:04.844843 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2657cf1-f6ce-4b4c-bdf3-afd58f264245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:04.849064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2657cf1-f6ce-4b4c-bdf3-afd58f264245 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:04.895157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1082/2187] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:04.895433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f87d6e-0c25-45ff-8525-50aee8b6914c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:04.907940 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f87d6e-0c25-45ff-8525-50aee8b6914c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:04.939346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74321a3-025f-451d-84a2-a227e0aca046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:04.940596 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74321a3-025f-451d-84a2-a227e0aca046 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:04.940866 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74321a3-025f-451d-84a2-a227e0aca046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:04.941127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74321a3-025f-451d-84a2-a227e0aca046 admin admin] PATH_INFO: `/v3/projects/4f1ee64f19fe4e07b61c76da404c8fbb/users/b18685a379b942d3b6328bfe9cb674d0/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:04.951404 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74321a3-025f-451d-84a2-a227e0aca046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1ee64f19fe4e07b61c76da404c8fbb, user_id=b18685a379b942d3b6328bfe9cb674d0, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:04.957330 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74321a3-025f-451d-84a2-a227e0aca046 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:04.994527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1106/2188] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:03:04 2022] PUT /identity/v3/projects/4f1ee64f19fe4e07b61c76da404c8fbb/users/b18685a379b942d3b6328bfe9cb674d0/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:03:05.000079 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167ae0a-e1d4-4176-a273-b6ddf542656a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:05.000366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167ae0a-e1d4-4176-a273-b6ddf542656a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:05.000647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167ae0a-e1d4-4176-a273-b6ddf542656a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:05.078378 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8167ae0a-e1d4-4176-a273-b6ddf542656a None None] MFA Rules not processed for user `b18685a379b942d3b6328bfe9cb674d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:05.079633 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8167ae0a-e1d4-4176-a273-b6ddf542656a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:05.278278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:05.309755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1083/2189] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:05.323050 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74321a3-025f-451d-84a2-a227e0aca046 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:05.331698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f74321a3-025f-451d-84a2-a227e0aca046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:05.354049 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:05.468563 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74321a3-025f-451d-84a2-a227e0aca046 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:05.482501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e0f12-7f04-44a6-808f-97ed26ae8497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:05.483257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e0f12-7f04-44a6-808f-97ed26ae8497 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:05.483809 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e0f12-7f04-44a6-808f-97ed26ae8497 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:05.484258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e0f12-7f04-44a6-808f-97ed26ae8497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:05.513345 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e0f12-7f04-44a6-808f-97ed26ae8497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:05.515423 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e0f12-7f04-44a6-808f-97ed26ae8497 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:05.551971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1107/2190] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:03:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:03:06.719728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167ae0a-e1d4-4176-a273-b6ddf542656a None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:06.735282 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167ae0a-e1d4-4176-a273-b6ddf542656a None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:06.739292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a28983-4ca7-4aca-a5b9-8f0dd9bcf0ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:06.740128 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a28983-4ca7-4aca-a5b9-8f0dd9bcf0ac service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:06.740529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a28983-4ca7-4aca-a5b9-8f0dd9bcf0ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:06.740903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a28983-4ca7-4aca-a5b9-8f0dd9bcf0ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:06.875642 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a28983-4ca7-4aca-a5b9-8f0dd9bcf0ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:06.877297 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a28983-4ca7-4aca-a5b9-8f0dd9bcf0ac service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:06.897451 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1084/2191] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:03:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:03:12.691570 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e0f12-7f04-44a6-808f-97ed26ae8497 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:12.706091 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e0f12-7f04-44a6-808f-97ed26ae8497 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:12.723022 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29abd9-3156-46cd-bd5c-58fd867ea39c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:12.724582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29abd9-3156-46cd-bd5c-58fd867ea39c service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:12.725277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29abd9-3156-46cd-bd5c-58fd867ea39c service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:12.725734 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29abd9-3156-46cd-bd5c-58fd867ea39c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:12.811845 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29abd9-3156-46cd-bd5c-58fd867ea39c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:12.813662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29abd9-3156-46cd-bd5c-58fd867ea39c service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:12.834013 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1108/2192] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:03:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:03:14.077317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a28983-4ca7-4aca-a5b9-8f0dd9bcf0ac service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:14.079769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-73a28983-4ca7-4aca-a5b9-8f0dd9bcf0ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:14.303704 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a28983-4ca7-4aca-a5b9-8f0dd9bcf0ac service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:14.310100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a0850-a019-49c3-8dc8-766d1081d106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:14.311467 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a0850-a019-49c3-8dc8-766d1081d106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:14.311965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a0850-a019-49c3-8dc8-766d1081d106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:14.312446 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a0850-a019-49c3-8dc8-766d1081d106 admin admin] PATH_INFO: `/v3/users/924fb874190d42bdb0838f70d7327d7c` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:14.314090 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a0850-a019-49c3-8dc8-766d1081d106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=924fb874190d42bdb0838f70d7327d7c)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:14.317224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a0850-a019-49c3-8dc8-766d1081d106 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:14.440601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-db7a0850-a019-49c3-8dc8-766d1081d106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924fb874190d42bdb0838f70d7327d7c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:14.441704 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-db7a0850-a019-49c3-8dc8-766d1081d106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924fb874190d42bdb0838f70d7327d7c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:14.460044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-db7a0850-a019-49c3-8dc8-766d1081d106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924fb874190d42bdb0838f70d7327d7c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:14.481725 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-db7a0850-a019-49c3-8dc8-766d1081d106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924fb874190d42bdb0838f70d7327d7c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:14.482628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-db7a0850-a019-49c3-8dc8-766d1081d106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924fb874190d42bdb0838f70d7327d7c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:14.519080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1085/2193] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:03:14 2022] DELETE /identity/v3/users/924fb874190d42bdb0838f70d7327d7c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:14.523261 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac46b94-f60b-4630-9ede-3532cfcdfbab None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:14.524496 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac46b94-f60b-4630-9ede-3532cfcdfbab None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:14.524987 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac46b94-f60b-4630-9ede-3532cfcdfbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:14.573030 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6ac46b94-f60b-4630-9ede-3532cfcdfbab None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:14.579525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6ac46b94-f60b-4630-9ede-3532cfcdfbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:14.744716 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1109/2194] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:14.753495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a0850-a019-49c3-8dc8-766d1081d106 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:14.755130 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-db7a0850-a019-49c3-8dc8-766d1081d106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:14.774805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:14.898708 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a0850-a019-49c3-8dc8-766d1081d106 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:14.904729 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67445495-f7d6-47e7-a8cf-6ace45c87d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:14.906651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67445495-f7d6-47e7-a8cf-6ace45c87d54 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:14.907285 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67445495-f7d6-47e7-a8cf-6ace45c87d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:14.908067 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67445495-f7d6-47e7-a8cf-6ace45c87d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:14.931499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67445495-f7d6-47e7-a8cf-6ace45c87d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:14.934267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67445495-f7d6-47e7-a8cf-6ace45c87d54 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:14.968770 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1086/2195] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:03:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:03:15.262292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c5dab-740f-4d56-9968-0ceee90cc5f5 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:15.262589 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c5dab-740f-4d56-9968-0ceee90cc5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:15.263400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c5dab-740f-4d56-9968-0ceee90cc5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:15.286377 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-505c5dab-740f-4d56-9968-0ceee90cc5f5 None None] MFA Rules not processed for user `9791fd04ff4045578041a3c7f613f495`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:15.288606 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-505c5dab-740f-4d56-9968-0ceee90cc5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:15.337678 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67445495-f7d6-47e7-a8cf-6ace45c87d54 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:15.340916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-67445495-f7d6-47e7-a8cf-6ace45c87d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:15.343879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:15.369103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67445495-f7d6-47e7-a8cf-6ace45c87d54 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:15.369561 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1110/2196] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:15.376793 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d6cf7-863a-4fcf-aa70-79444c02142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:15.377676 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d6cf7-863a-4fcf-aa70-79444c02142d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:15.377991 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d6cf7-863a-4fcf-aa70-79444c02142d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:15.378263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d6cf7-863a-4fcf-aa70-79444c02142d admin admin] PATH_INFO: `/v3/projects/a6810917d9db4493998cd956465252e4` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:15.379460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d6cf7-863a-4fcf-aa70-79444c02142d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6810917d9db4493998cd956465252e4)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:15.381861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d6cf7-863a-4fcf-aa70-79444c02142d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:15.441534 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-aa2d6cf7-863a-4fcf-aa70-79444c02142d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6810917d9db4493998cd956465252e4', 'request_id': 'req-aa2d6cf7-863a-4fcf-aa70-79444c02142d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:15.451118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-aa2d6cf7-863a-4fcf-aa70-79444c02142d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6810917d9db4493998cd956465252e4', 'request_id': 'req-aa2d6cf7-863a-4fcf-aa70-79444c02142d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:15.464102 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-aa2d6cf7-863a-4fcf-aa70-79444c02142d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6810917d9db4493998cd956465252e4', 'request_id': 'req-aa2d6cf7-863a-4fcf-aa70-79444c02142d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:15.481156 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-aa2d6cf7-863a-4fcf-aa70-79444c02142d admin admin] The token cache is being invalidate because project a6810917d9db4493998cd956465252e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:03:15.481693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-aa2d6cf7-863a-4fcf-aa70-79444c02142d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:15.482434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-aa2d6cf7-863a-4fcf-aa70-79444c02142d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:15.486104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1087/2197] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:03:15 2022] DELETE /identity/v3/projects/a6810917d9db4493998cd956465252e4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:15.489506 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfb676-57d5-4853-9420-f03f202cf3e9 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:15.489888 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfb676-57d5-4853-9420-f03f202cf3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:15.490482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfb676-57d5-4853-9420-f03f202cf3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:15.511290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c9bfb676-57d5-4853-9420-f03f202cf3e9 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:15.512606 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c9bfb676-57d5-4853-9420-f03f202cf3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:15.589711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1111/2198] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:15.597698 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564d099-d74a-4ae2-a562-b7c47b794a34 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:15.598091 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564d099-d74a-4ae2-a562-b7c47b794a34 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:15.598309 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564d099-d74a-4ae2-a562-b7c47b794a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:15.619503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-5564d099-d74a-4ae2-a562-b7c47b794a34 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:15.620744 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5564d099-d74a-4ae2-a562-b7c47b794a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:15.629461 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1088/2199] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:03:15.633941 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfb676-57d5-4853-9420-f03f202cf3e9 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:15.652278 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfb676-57d5-4853-9420-f03f202cf3e9 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:15.659939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda31d2b-0034-432c-b360-01d292db5421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:15.660710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda31d2b-0034-432c-b360-01d292db5421 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:15.661066 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda31d2b-0034-432c-b360-01d292db5421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:15.661557 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda31d2b-0034-432c-b360-01d292db5421 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:15.662572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda31d2b-0034-432c-b360-01d292db5421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:15.663056 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda31d2b-0034-432c-b360-01d292db5421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:15.666205 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda31d2b-0034-432c-b360-01d292db5421 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:15.692746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1112/2200] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:15.698911 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564d099-d74a-4ae2-a562-b7c47b794a34 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:15.710781 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda31d2b-0034-432c-b360-01d292db5421 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:15.713684 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-bda31d2b-0034-432c-b360-01d292db5421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:15.725928 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564d099-d74a-4ae2-a562-b7c47b794a34 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:15.728653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda31d2b-0034-432c-b360-01d292db5421 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:15.732335 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7bbfb-f5fd-4964-bcc0-4b08cdea36a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:15.733022 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7bbfb-f5fd-4964-bcc0-4b08cdea36a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:15.733305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7bbfb-f5fd-4964-bcc0-4b08cdea36a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:15.733633 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7bbfb-f5fd-4964-bcc0-4b08cdea36a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:15.734333 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7bbfb-f5fd-4964-bcc0-4b08cdea36a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:15.734466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bba76-9470-4477-abea-721ca6f4f988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:15.735333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bba76-9470-4477-abea-721ca6f4f988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:15.735754 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bba76-9470-4477-abea-721ca6f4f988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:15.736187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bba76-9470-4477-abea-721ca6f4f988 admin admin] PATH_INFO: `/v3/users/8f3069a6d1394cabb0637febc9b17bf9` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:15.736520 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7bbfb-f5fd-4964-bcc0-4b08cdea36a5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:15.740019 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6bba76-9470-4477-abea-721ca6f4f988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f3069a6d1394cabb0637febc9b17bf9)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:15.741035 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6bba76-9470-4477-abea-721ca6f4f988 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:15.791590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1089/2201] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:03:15 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:15.796097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7bbfb-f5fd-4964-bcc0-4b08cdea36a5 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:15.836260 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8c6bba76-9470-4477-abea-721ca6f4f988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f3069a6d1394cabb0637febc9b17bf9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:15.837495 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8c6bba76-9470-4477-abea-721ca6f4f988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f3069a6d1394cabb0637febc9b17bf9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:15.850962 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8c6bba76-9470-4477-abea-721ca6f4f988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f3069a6d1394cabb0637febc9b17bf9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:15.877195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8c6bba76-9470-4477-abea-721ca6f4f988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f3069a6d1394cabb0637febc9b17bf9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:15.880798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8c6bba76-9470-4477-abea-721ca6f4f988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f3069a6d1394cabb0637febc9b17bf9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:15.915829 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7bbfb-f5fd-4964-bcc0-4b08cdea36a5 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:15.923472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248a625-0547-4c29-9104-7280e7e3f3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:15.924770 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248a625-0547-4c29-9104-7280e7e3f3be admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:15.925283 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248a625-0547-4c29-9104-7280e7e3f3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:15.925645 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248a625-0547-4c29-9104-7280e7e3f3be admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:15.928250 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248a625-0547-4c29-9104-7280e7e3f3be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:15.931052 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248a625-0547-4c29-9104-7280e7e3f3be admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:15.934210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1113/2202] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:03:15 2022] DELETE /identity/v3/users/8f3069a6d1394cabb0637febc9b17bf9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:03:15.937733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f81b2-04e3-4781-96a2-9123741388f4 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:15.938048 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f81b2-04e3-4781-96a2-9123741388f4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:15.939372 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f81b2-04e3-4781-96a2-9123741388f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:15.956441 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:15.972339 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1090/2203] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:03:15 2022] POST /identity/v3/users => generated 284 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:15.973865 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248a625-0547-4c29-9104-7280e7e3f3be admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:15.976503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7248a625-0547-4c29-9104-7280e7e3f3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:15.983529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9d2f81b2-04e3-4781-96a2-9123741388f4 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:15.986719 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9d2f81b2-04e3-4781-96a2-9123741388f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:15.991628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248a625-0547-4c29-9104-7280e7e3f3be admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:16.050904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:16.069958 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafba75b-1068-49ef-baaf-a3f695d61236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:16.071163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafba75b-1068-49ef-baaf-a3f695d61236 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:16.071555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafba75b-1068-49ef-baaf-a3f695d61236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:16.071839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafba75b-1068-49ef-baaf-a3f695d61236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:16.075032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1114/2204] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:16.075184 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafba75b-1068-49ef-baaf-a3f695d61236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:16.075184 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafba75b-1068-49ef-baaf-a3f695d61236 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:16.083287 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f81b2-04e3-4781-96a2-9123741388f4 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:16.085179 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9d2f81b2-04e3-4781-96a2-9123741388f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:16.091319 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1091/2205] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:03:16.092279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafba75b-1068-49ef-baaf-a3f695d61236 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:16.105355 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafba75b-1068-49ef-baaf-a3f695d61236 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:16.110512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0472f-5941-4e4e-8f4e-d56792bc26ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:16.111188 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0472f-5941-4e4e-8f4e-d56792bc26ac admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:16.117036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0472f-5941-4e4e-8f4e-d56792bc26ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:16.117036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0472f-5941-4e4e-8f4e-d56792bc26ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:16.117036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0472f-5941-4e4e-8f4e-d56792bc26ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:16.117036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0472f-5941-4e4e-8f4e-d56792bc26ac admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:16.126317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1092/2206] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:16.131124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0472f-5941-4e4e-8f4e-d56792bc26ac admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:16.141710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0472f-5941-4e4e-8f4e-d56792bc26ac admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:16.149142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f873f66-a130-43c7-8ffb-c0332cf44d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:16.150951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f873f66-a130-43c7-8ffb-c0332cf44d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:16.151308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f873f66-a130-43c7-8ffb-c0332cf44d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:16.151663 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f873f66-a130-43c7-8ffb-c0332cf44d49 admin admin] PATH_INFO: `/v3/projects/1ecafb2efea74f9ab0095176a48a91ac/users/a230ba9c6ba14c21a5363b49ed46e7c6/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:16.168532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f81b2-04e3-4781-96a2-9123741388f4 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:16.172936 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f873f66-a130-43c7-8ffb-c0332cf44d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ecafb2efea74f9ab0095176a48a91ac, user_id=a230ba9c6ba14c21a5363b49ed46e7c6, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:16.173992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af18c0e-9caa-43a2-9624-b8648dd83739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:16.174802 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af18c0e-9caa-43a2-9624-b8648dd83739 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:16.175222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af18c0e-9caa-43a2-9624-b8648dd83739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:16.175623 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af18c0e-9caa-43a2-9624-b8648dd83739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:16.176149 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f873f66-a130-43c7-8ffb-c0332cf44d49 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:16.188641 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af18c0e-9caa-43a2-9624-b8648dd83739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:16.190261 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af18c0e-9caa-43a2-9624-b8648dd83739 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:16.204393 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1115/2208] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:03:16.217974 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad217777-e0c1-47c5-b21d-c1c9eb5ba7d1 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:16.218295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad217777-e0c1-47c5-b21d-c1c9eb5ba7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:16.218545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad217777-e0c1-47c5-b21d-c1c9eb5ba7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:16.222021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1093/2208] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:03:16 2022] PUT /identity/v3/projects/1ecafb2efea74f9ab0095176a48a91ac/users/a230ba9c6ba14c21a5363b49ed46e7c6/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:16.263065 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ad217777-e0c1-47c5-b21d-c1c9eb5ba7d1 None None] MFA Rules not processed for user `a230ba9c6ba14c21a5363b49ed46e7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:16.265370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ad217777-e0c1-47c5-b21d-c1c9eb5ba7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:16.377594 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1116/2209] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:16.391857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f873f66-a130-43c7-8ffb-c0332cf44d49 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:16.399941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6f873f66-a130-43c7-8ffb-c0332cf44d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:16.541276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f873f66-a130-43c7-8ffb-c0332cf44d49 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:16.548030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adb739-18d8-47d8-92ef-78ccc5baed85 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1b010003c44dc19643558167424d13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:16.549179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adb739-18d8-47d8-92ef-78ccc5baed85 service glance] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:16.549468 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adb739-18d8-47d8-92ef-78ccc5baed85 service glance] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:16.549747 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adb739-18d8-47d8-92ef-78ccc5baed85 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:16.566017 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4adb739-18d8-47d8-92ef-78ccc5baed85 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:16.568351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4adb739-18d8-47d8-92ef-78ccc5baed85 service glance] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:16.584480 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1094/2210] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:03:16 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:03:17.004616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad217777-e0c1-47c5-b21d-c1c9eb5ba7d1 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:17.006528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ad217777-e0c1-47c5-b21d-c1c9eb5ba7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:17.141083 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad217777-e0c1-47c5-b21d-c1c9eb5ba7d1 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:17.147418 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe3cda-5484-4629-8811-be3c3747cabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:17.150203 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe3cda-5484-4629-8811-be3c3747cabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:17.150698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe3cda-5484-4629-8811-be3c3747cabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:17.151136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe3cda-5484-4629-8811-be3c3747cabe admin admin] PATH_INFO: `/v3/projects/5c179ff8041746329673191ef455d16c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:17.152828 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe3cda-5484-4629-8811-be3c3747cabe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c179ff8041746329673191ef455d16c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:17.156615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe3cda-5484-4629-8811-be3c3747cabe admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:17.197070 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:17.219174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7bbe3cda-5484-4629-8811-be3c3747cabe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c179ff8041746329673191ef455d16c', 'request_id': 'req-7bbe3cda-5484-4629-8811-be3c3747cabe'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:17.235617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7bbe3cda-5484-4629-8811-be3c3747cabe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c179ff8041746329673191ef455d16c', 'request_id': 'req-7bbe3cda-5484-4629-8811-be3c3747cabe'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:17.243375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7bbe3cda-5484-4629-8811-be3c3747cabe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c179ff8041746329673191ef455d16c', 'request_id': 'req-7bbe3cda-5484-4629-8811-be3c3747cabe'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:17.263795 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7bbe3cda-5484-4629-8811-be3c3747cabe admin admin] The token cache is being invalidate because project 5c179ff8041746329673191ef455d16c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:03:17.264154 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7bbe3cda-5484-4629-8811-be3c3747cabe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:17.265134 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7bbe3cda-5484-4629-8811-be3c3747cabe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:17.267800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1117/2211] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:03:17 2022] DELETE /identity/v3/projects/5c179ff8041746329673191ef455d16c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:17.271939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adb739-18d8-47d8-92ef-78ccc5baed85 service glance] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:17.287069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adb739-18d8-47d8-92ef-78ccc5baed85 service glance] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:17.377044 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b940200-4efe-4756-892c-ab06ba3d34d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:17.378078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b940200-4efe-4756-892c-ab06ba3d34d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:17.378424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b940200-4efe-4756-892c-ab06ba3d34d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:17.378762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b940200-4efe-4756-892c-ab06ba3d34d5 admin admin] PATH_INFO: `/v3/users/57dab02b70fe478b901929f9162682d4` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:17.380168 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b940200-4efe-4756-892c-ab06ba3d34d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57dab02b70fe478b901929f9162682d4)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:17.382371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b940200-4efe-4756-892c-ab06ba3d34d5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:17.387018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:17.442647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0b940200-4efe-4756-892c-ab06ba3d34d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57dab02b70fe478b901929f9162682d4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:17.444045 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0b940200-4efe-4756-892c-ab06ba3d34d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57dab02b70fe478b901929f9162682d4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:17.454386 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0b940200-4efe-4756-892c-ab06ba3d34d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57dab02b70fe478b901929f9162682d4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:17.467658 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0b940200-4efe-4756-892c-ab06ba3d34d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57dab02b70fe478b901929f9162682d4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:17.468407 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0b940200-4efe-4756-892c-ab06ba3d34d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57dab02b70fe478b901929f9162682d4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:17.489925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1095/2212] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:03:17 2022] DELETE /identity/v3/users/57dab02b70fe478b901929f9162682d4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:17.835348 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe3cda-5484-4629-8811-be3c3747cabe admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:17.837086 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7bbe3cda-5484-4629-8811-be3c3747cabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:17.858142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe3cda-5484-4629-8811-be3c3747cabe admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:17.922322 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e84cd-5082-4836-94f7-1c831eaf2a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:17.923216 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e84cd-5082-4836-94f7-1c831eaf2a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:17.923491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e84cd-5082-4836-94f7-1c831eaf2a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:17.923766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e84cd-5082-4836-94f7-1c831eaf2a69 admin admin] PATH_INFO: `/v3/projects/0e8a34437e014c9db35086ab57a827ff` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:17.929499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e84cd-5082-4836-94f7-1c831eaf2a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8a34437e014c9db35086ab57a827ff)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:17.932066 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e84cd-5082-4836-94f7-1c831eaf2a69 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:17.993361 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2b3e84cd-5082-4836-94f7-1c831eaf2a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8a34437e014c9db35086ab57a827ff', 'request_id': 'req-2b3e84cd-5082-4836-94f7-1c831eaf2a69'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:18.009607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2b3e84cd-5082-4836-94f7-1c831eaf2a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8a34437e014c9db35086ab57a827ff', 'request_id': 'req-2b3e84cd-5082-4836-94f7-1c831eaf2a69'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:18.019350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2b3e84cd-5082-4836-94f7-1c831eaf2a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8a34437e014c9db35086ab57a827ff', 'request_id': 'req-2b3e84cd-5082-4836-94f7-1c831eaf2a69'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:18.032187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2b3e84cd-5082-4836-94f7-1c831eaf2a69 admin admin] The token cache is being invalidate because project 0e8a34437e014c9db35086ab57a827ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:03:18.032669 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2b3e84cd-5082-4836-94f7-1c831eaf2a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:18.033414 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2b3e84cd-5082-4836-94f7-1c831eaf2a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:18.038213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1118/2213] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:03:17 2022] DELETE /identity/v3/projects/0e8a34437e014c9db35086ab57a827ff => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:18.039515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b940200-4efe-4756-892c-ab06ba3d34d5 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:18.045515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0b940200-4efe-4756-892c-ab06ba3d34d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:18.059629 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b940200-4efe-4756-892c-ab06ba3d34d5 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:18.150993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89089e0-65c2-4669-bdd6-0c87ec8b3d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:18.153603 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89089e0-65c2-4669-bdd6-0c87ec8b3d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:18.153951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89089e0-65c2-4669-bdd6-0c87ec8b3d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:18.154221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89089e0-65c2-4669-bdd6-0c87ec8b3d9b admin admin] PATH_INFO: `/v3/users/b18685a379b942d3b6328bfe9cb674d0` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:18.157023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89089e0-65c2-4669-bdd6-0c87ec8b3d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18685a379b942d3b6328bfe9cb674d0)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:18.159097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89089e0-65c2-4669-bdd6-0c87ec8b3d9b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:18.233225 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d89089e0-65c2-4669-bdd6-0c87ec8b3d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18685a379b942d3b6328bfe9cb674d0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:18.233896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d89089e0-65c2-4669-bdd6-0c87ec8b3d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18685a379b942d3b6328bfe9cb674d0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:18.241160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d89089e0-65c2-4669-bdd6-0c87ec8b3d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18685a379b942d3b6328bfe9cb674d0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:18.260682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d89089e0-65c2-4669-bdd6-0c87ec8b3d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18685a379b942d3b6328bfe9cb674d0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:18.260682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d89089e0-65c2-4669-bdd6-0c87ec8b3d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18685a379b942d3b6328bfe9cb674d0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:18.274845 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:18.279689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1096/2214] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:03:18 2022] DELETE /identity/v3/users/b18685a379b942d3b6328bfe9cb674d0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:18.801012 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e84cd-5082-4836-94f7-1c831eaf2a69 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:18.808000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2b3e84cd-5082-4836-94f7-1c831eaf2a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:18.834203 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e84cd-5082-4836-94f7-1c831eaf2a69 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:18.919569 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:18.948706 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7ea97-74fb-4f69-a6c3-5773014ce255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:18.949845 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7ea97-74fb-4f69-a6c3-5773014ce255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:18.950203 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7ea97-74fb-4f69-a6c3-5773014ce255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:18.950772 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7ea97-74fb-4f69-a6c3-5773014ce255 admin admin] PATH_INFO: `/v3/projects/4f1ee64f19fe4e07b61c76da404c8fbb` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:18.952283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7ea97-74fb-4f69-a6c3-5773014ce255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1ee64f19fe4e07b61c76da404c8fbb)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:18.955186 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7ea97-74fb-4f69-a6c3-5773014ce255 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:18.975476 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bdb38-a548-4da1-96c9-f9ce6b3facf2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:18.976448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bdb38-a548-4da1-96c9-f9ce6b3facf2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:18.976932 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bdb38-a548-4da1-96c9-f9ce6b3facf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:19.007975 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2a0bdb38-a548-4da1-96c9-f9ce6b3facf2 None None] MFA Rules not processed for user `23aa142375c54b94ad276d1a4b9031e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:19.009833 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2a0bdb38-a548-4da1-96c9-f9ce6b3facf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:19.032538 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0fd7ea97-74fb-4f69-a6c3-5773014ce255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1ee64f19fe4e07b61c76da404c8fbb', 'request_id': 'req-0fd7ea97-74fb-4f69-a6c3-5773014ce255'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:19.051136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0fd7ea97-74fb-4f69-a6c3-5773014ce255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1ee64f19fe4e07b61c76da404c8fbb', 'request_id': 'req-0fd7ea97-74fb-4f69-a6c3-5773014ce255'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:19.061088 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0fd7ea97-74fb-4f69-a6c3-5773014ce255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1ee64f19fe4e07b61c76da404c8fbb', 'request_id': 'req-0fd7ea97-74fb-4f69-a6c3-5773014ce255'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:19.076144 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0fd7ea97-74fb-4f69-a6c3-5773014ce255 admin admin] The token cache is being invalidate because project 4f1ee64f19fe4e07b61c76da404c8fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:03:19.077298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0fd7ea97-74fb-4f69-a6c3-5773014ce255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:19.079418 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0fd7ea97-74fb-4f69-a6c3-5773014ce255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:19.082165 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1119/2215] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:03:18 2022] DELETE /identity/v3/projects/4f1ee64f19fe4e07b61c76da404c8fbb => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:19.090691 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91946a8b-600e-43c3-9de3-ccc5105bee76 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:19.091167 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91946a8b-600e-43c3-9de3-ccc5105bee76 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:19.091736 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91946a8b-600e-43c3-9de3-ccc5105bee76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:19.109205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1097/2216] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 2 19:03:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:19.124033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bdb38-a548-4da1-96c9-f9ce6b3facf2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:19.126309 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2a0bdb38-a548-4da1-96c9-f9ce6b3facf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:19.127603 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-91946a8b-600e-43c3-9de3-ccc5105bee76 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:19.128757 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-91946a8b-600e-43c3-9de3-ccc5105bee76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:19.230885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bdb38-a548-4da1-96c9-f9ce6b3facf2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:19.236105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1120/2217] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:03:19.244799 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce269f3-0269-4d8d-94aa-2883d98b90eb None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:19.245634 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce269f3-0269-4d8d-94aa-2883d98b90eb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:19.248264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce269f3-0269-4d8d-94aa-2883d98b90eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:19.278357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4ce269f3-0269-4d8d-94aa-2883d98b90eb None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:19.280019 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4ce269f3-0269-4d8d-94aa-2883d98b90eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:19.294906 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1121/2218] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:03:19.299148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce269f3-0269-4d8d-94aa-2883d98b90eb None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:19.309244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce269f3-0269-4d8d-94aa-2883d98b90eb None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:19.314166 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b25c9-33f6-4f67-982d-055a68b2d2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:19.314366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec1805-70b4-4029-94ab-a403256597cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4faac48f82244bebf039aab92898617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:19.314986 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b25c9-33f6-4f67-982d-055a68b2d2ea admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:19.315107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec1805-70b4-4029-94ab-a403256597cc service swift] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:19.315289 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec1805-70b4-4029-94ab-a403256597cc service swift] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:19.315395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b25c9-33f6-4f67-982d-055a68b2d2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:19.315561 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec1805-70b4-4029-94ab-a403256597cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:19.315833 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b25c9-33f6-4f67-982d-055a68b2d2ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:19.316623 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b25c9-33f6-4f67-982d-055a68b2d2ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:19.316992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b25c9-33f6-4f67-982d-055a68b2d2ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:19.318854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b25c9-33f6-4f67-982d-055a68b2d2ea admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:19.336498 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1122/2219] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:19.343094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b25c9-33f6-4f67-982d-055a68b2d2ea admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:19.359478 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b25c9-33f6-4f67-982d-055a68b2d2ea admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:19.376101 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65bf7a-6ce5-4446-94b9-f8369e36e51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:19.376792 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65bf7a-6ce5-4446-94b9-f8369e36e51c admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:19.377073 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65bf7a-6ce5-4446-94b9-f8369e36e51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:19.377347 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65bf7a-6ce5-4446-94b9-f8369e36e51c admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:19.378296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65bf7a-6ce5-4446-94b9-f8369e36e51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:19.382071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65bf7a-6ce5-4446-94b9-f8369e36e51c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:19.399513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:19.434404 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1123/2220] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:03:19 2022] POST /identity/v3/projects => generated 361 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:19.435273 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65bf7a-6ce5-4446-94b9-f8369e36e51c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:19.441016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec1805-70b4-4029-94ab-a403256597cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:19.445387 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec1805-70b4-4029-94ab-a403256597cc service swift] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:19.463086 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1098/2221] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 2 19:03:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 19:03:19.502968 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:19.556791 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65bf7a-6ce5-4446-94b9-f8369e36e51c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:19.562091 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f26d4-511f-4f72-92dd-283c83a16ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:19.562712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f26d4-511f-4f72-92dd-283c83a16ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:19.562992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f26d4-511f-4f72-92dd-283c83a16ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:19.563267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f26d4-511f-4f72-92dd-283c83a16ef4 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:19.564204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f26d4-511f-4f72-92dd-283c83a16ef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:19.567611 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f26d4-511f-4f72-92dd-283c83a16ef4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:19.615522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1124/2222] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:03:19 2022] POST /identity/v3/users => generated 281 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:19.616880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec1805-70b4-4029-94ab-a403256597cc service swift] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:19.653599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec1805-70b4-4029-94ab-a403256597cc service swift] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:19.685298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a9df8-4160-4052-862f-70512a5cdd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:19.687202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a9df8-4160-4052-862f-70512a5cdd20 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:19.687490 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a9df8-4160-4052-862f-70512a5cdd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:19.687930 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a9df8-4160-4052-862f-70512a5cdd20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:19.689133 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a9df8-4160-4052-862f-70512a5cdd20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:19.691663 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a9df8-4160-4052-862f-70512a5cdd20 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:19.708147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1099/2223] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:19.713175 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f26d4-511f-4f72-92dd-283c83a16ef4 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:19.745672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f26d4-511f-4f72-92dd-283c83a16ef4 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:19.752942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec41d2f-5399-4319-a7a9-a2c825a08c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:19.754063 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec41d2f-5399-4319-a7a9-a2c825a08c56 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:19.754523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec41d2f-5399-4319-a7a9-a2c825a08c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:19.754855 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec41d2f-5399-4319-a7a9-a2c825a08c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:19.756206 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec41d2f-5399-4319-a7a9-a2c825a08c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:19.760353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec41d2f-5399-4319-a7a9-a2c825a08c56 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:19.809349 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1125/2224] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:19.816105 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a9df8-4160-4052-862f-70512a5cdd20 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:19.837781 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a9df8-4160-4052-862f-70512a5cdd20 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:19.851570 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1076b8-0f3a-45ff-a600-a63324022978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:19.853220 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1076b8-0f3a-45ff-a600-a63324022978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:19.856283 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1076b8-0f3a-45ff-a600-a63324022978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:19.857089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1076b8-0f3a-45ff-a600-a63324022978 admin admin] PATH_INFO: `/v3/projects/6a8134b141194ecc9198d0e8272a8f0a/users/c7734c61db704ecb8a718e84412184bf/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:19.904601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1076b8-0f3a-45ff-a600-a63324022978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8134b141194ecc9198d0e8272a8f0a, user_id=c7734c61db704ecb8a718e84412184bf, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:19.909947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1076b8-0f3a-45ff-a600-a63324022978 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:19.960873 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1100/2225] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:03:19 2022] PUT /identity/v3/projects/6a8134b141194ecc9198d0e8272a8f0a/users/c7734c61db704ecb8a718e84412184bf/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:19.965701 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007eca7-5416-4b9c-962b-f18976956de0 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:19.969965 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007eca7-5416-4b9c-962b-f18976956de0 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:19.970516 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007eca7-5416-4b9c-962b-f18976956de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:20.029343 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5007eca7-5416-4b9c-962b-f18976956de0 None None] MFA Rules not processed for user `c7734c61db704ecb8a718e84412184bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:20.044841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5007eca7-5416-4b9c-962b-f18976956de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:20.225700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1126/2226] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:20.251387 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1076b8-0f3a-45ff-a600-a63324022978 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:20.254561 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4e1076b8-0f3a-45ff-a600-a63324022978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:20.477059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1076b8-0f3a-45ff-a600-a63324022978 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:20.487322 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb900ad5-5042-4602-ab57-6c6f0e915b42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:20.488170 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb900ad5-5042-4602-ab57-6c6f0e915b42 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:20.488509 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb900ad5-5042-4602-ab57-6c6f0e915b42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:20.488882 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb900ad5-5042-4602-ab57-6c6f0e915b42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:20.511046 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb900ad5-5042-4602-ab57-6c6f0e915b42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:20.518092 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb900ad5-5042-4602-ab57-6c6f0e915b42 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:20.558632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1101/2227] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:03:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:03:20.564671 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007eca7-5416-4b9c-962b-f18976956de0 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:20.768150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007eca7-5416-4b9c-962b-f18976956de0 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:20.785037 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e957fc-d316-4248-a32d-9195aac9f6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:20.786371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e957fc-d316-4248-a32d-9195aac9f6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:20.786875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e957fc-d316-4248-a32d-9195aac9f6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:20.787357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e957fc-d316-4248-a32d-9195aac9f6c4 admin admin] PATH_INFO: `/v3/users/c7734c61db704ecb8a718e84412184bf` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:20.789336 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e957fc-d316-4248-a32d-9195aac9f6c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7734c61db704ecb8a718e84412184bf)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:20.792271 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e957fc-d316-4248-a32d-9195aac9f6c4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:20.900607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:20.909751 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f5e957fc-d316-4248-a32d-9195aac9f6c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7734c61db704ecb8a718e84412184bf'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:20.911575 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f5e957fc-d316-4248-a32d-9195aac9f6c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7734c61db704ecb8a718e84412184bf'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:20.940018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f5e957fc-d316-4248-a32d-9195aac9f6c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7734c61db704ecb8a718e84412184bf'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:20.964519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f5e957fc-d316-4248-a32d-9195aac9f6c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7734c61db704ecb8a718e84412184bf'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:20.965134 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f5e957fc-d316-4248-a32d-9195aac9f6c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7734c61db704ecb8a718e84412184bf'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:21.004869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1127/2228] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:03:20 2022] DELETE /identity/v3/users/c7734c61db704ecb8a718e84412184bf => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:21.009442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c53a6-9ed0-4128-b083-878292749fca None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:21.009686 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c53a6-9ed0-4128-b083-878292749fca None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:21.010013 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c53a6-9ed0-4128-b083-878292749fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:21.054212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d44c53a6-9ed0-4128-b083-878292749fca None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:21.055573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d44c53a6-9ed0-4128-b083-878292749fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:21.249105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e957fc-d316-4248-a32d-9195aac9f6c4 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:21.251631 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f5e957fc-d316-4248-a32d-9195aac9f6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:21.254283 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1102/2229] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:21.409126 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e957fc-d316-4248-a32d-9195aac9f6c4 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:21.425825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70491a0c-53c9-4491-9f29-d75cacaab403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:21.425825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70491a0c-53c9-4491-9f29-d75cacaab403 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:21.425825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70491a0c-53c9-4491-9f29-d75cacaab403 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:21.425825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70491a0c-53c9-4491-9f29-d75cacaab403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:21.441530 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70491a0c-53c9-4491-9f29-d75cacaab403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:21.443113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70491a0c-53c9-4491-9f29-d75cacaab403 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:21.469971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1128/2230] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:03:22.018305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c53a6-9ed0-4128-b083-878292749fca None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:22.020168 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d44c53a6-9ed0-4128-b083-878292749fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:22.035076 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c53a6-9ed0-4128-b083-878292749fca None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:22.050488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9564746-ab39-4b11-bf3a-6719fa4a7859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:22.050488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9564746-ab39-4b11-bf3a-6719fa4a7859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:22.050488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9564746-ab39-4b11-bf3a-6719fa4a7859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:22.050488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9564746-ab39-4b11-bf3a-6719fa4a7859 admin admin] PATH_INFO: `/v3/projects/6a8134b141194ecc9198d0e8272a8f0a` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:22.051172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9564746-ab39-4b11-bf3a-6719fa4a7859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a8134b141194ecc9198d0e8272a8f0a)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:22.065060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9564746-ab39-4b11-bf3a-6719fa4a7859 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:22.176242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b9564746-ab39-4b11-bf3a-6719fa4a7859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a8134b141194ecc9198d0e8272a8f0a', 'request_id': 'req-b9564746-ab39-4b11-bf3a-6719fa4a7859'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:22.178359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:22.190137 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b9564746-ab39-4b11-bf3a-6719fa4a7859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a8134b141194ecc9198d0e8272a8f0a', 'request_id': 'req-b9564746-ab39-4b11-bf3a-6719fa4a7859'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:22.229335 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b9564746-ab39-4b11-bf3a-6719fa4a7859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a8134b141194ecc9198d0e8272a8f0a', 'request_id': 'req-b9564746-ab39-4b11-bf3a-6719fa4a7859'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:22.257103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b9564746-ab39-4b11-bf3a-6719fa4a7859 admin admin] The token cache is being invalidate because project 6a8134b141194ecc9198d0e8272a8f0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:03:22.257883 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b9564746-ab39-4b11-bf3a-6719fa4a7859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:22.258211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b9564746-ab39-4b11-bf3a-6719fa4a7859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:22.264223 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1103/2231] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:03:22 2022] DELETE /identity/v3/projects/6a8134b141194ecc9198d0e8272a8f0a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:22.265465 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719399f5-ba6a-4e58-89a7-5bd8b55ed5bf None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:22.266001 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719399f5-ba6a-4e58-89a7-5bd8b55ed5bf None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:22.266096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719399f5-ba6a-4e58-89a7-5bd8b55ed5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:22.307019 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-719399f5-ba6a-4e58-89a7-5bd8b55ed5bf None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:22.308446 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-719399f5-ba6a-4e58-89a7-5bd8b55ed5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:22.381762 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1129/2232] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:03:22.391079 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32472610-804d-4d0f-b06f-0782ee554684 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:22.391374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32472610-804d-4d0f-b06f-0782ee554684 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:22.391660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32472610-804d-4d0f-b06f-0782ee554684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:22.418515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-32472610-804d-4d0f-b06f-0782ee554684 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:22.419787 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-32472610-804d-4d0f-b06f-0782ee554684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:22.432253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1104/2233] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:22.433129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719399f5-ba6a-4e58-89a7-5bd8b55ed5bf None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:22.443855 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719399f5-ba6a-4e58-89a7-5bd8b55ed5bf None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:22.449770 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994ebbc-aa06-42af-b295-50ef0829c290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:22.450354 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994ebbc-aa06-42af-b295-50ef0829c290 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:22.450632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994ebbc-aa06-42af-b295-50ef0829c290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:22.450901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994ebbc-aa06-42af-b295-50ef0829c290 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:22.452006 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994ebbc-aa06-42af-b295-50ef0829c290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:22.452313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994ebbc-aa06-42af-b295-50ef0829c290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:22.453944 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994ebbc-aa06-42af-b295-50ef0829c290 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:22.483927 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1130/2234] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:22.488282 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32472610-804d-4d0f-b06f-0782ee554684 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:22.506164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32472610-804d-4d0f-b06f-0782ee554684 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:22.512564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff33ddd-1d65-4ee9-9d91-2c4528215b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:22.513610 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff33ddd-1d65-4ee9-9d91-2c4528215b74 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:22.514150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff33ddd-1d65-4ee9-9d91-2c4528215b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:22.514598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff33ddd-1d65-4ee9-9d91-2c4528215b74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:22.516513 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff33ddd-1d65-4ee9-9d91-2c4528215b74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:22.519801 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff33ddd-1d65-4ee9-9d91-2c4528215b74 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:22.558938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1105/2235] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:03:22 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:22.563441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994ebbc-aa06-42af-b295-50ef0829c290 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:22.579804 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994ebbc-aa06-42af-b295-50ef0829c290 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:22.650593 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:22.668494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a88f4-7832-4a02-9ec8-614122afd280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:22.670197 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a88f4-7832-4a02-9ec8-614122afd280 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:22.670647 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a88f4-7832-4a02-9ec8-614122afd280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:22.671010 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a88f4-7832-4a02-9ec8-614122afd280 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:22.671862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a88f4-7832-4a02-9ec8-614122afd280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:22.675209 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a88f4-7832-4a02-9ec8-614122afd280 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:22.716041 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1131/2236] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:03:22 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:22.720223 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff33ddd-1d65-4ee9-9d91-2c4528215b74 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:22.735580 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff33ddd-1d65-4ee9-9d91-2c4528215b74 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:22.741563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012131a2-0f95-4c20-8128-230ff6876e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:22.742692 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012131a2-0f95-4c20-8128-230ff6876e46 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:22.743124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012131a2-0f95-4c20-8128-230ff6876e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:22.743530 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012131a2-0f95-4c20-8128-230ff6876e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:22.744601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012131a2-0f95-4c20-8128-230ff6876e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:22.747128 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012131a2-0f95-4c20-8128-230ff6876e46 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:22.776969 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1106/2237] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:03:22.780886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a88f4-7832-4a02-9ec8-614122afd280 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:22.795364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a88f4-7832-4a02-9ec8-614122afd280 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:22.801909 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f176f-19b9-4f91-af83-b754d1d01644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:22.802501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f176f-19b9-4f91-af83-b754d1d01644 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:22.802788 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f176f-19b9-4f91-af83-b754d1d01644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:22.803085 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f176f-19b9-4f91-af83-b754d1d01644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:22.803882 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f176f-19b9-4f91-af83-b754d1d01644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:22.805822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f176f-19b9-4f91-af83-b754d1d01644 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:22.825287 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1132/2238] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:22.827287 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012131a2-0f95-4c20-8128-230ff6876e46 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:22.846458 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012131a2-0f95-4c20-8128-230ff6876e46 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:22.857218 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acb1fb-37d0-4c78-8aa5-2efa4e304cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:22.858808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acb1fb-37d0-4c78-8aa5-2efa4e304cab admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:22.860219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acb1fb-37d0-4c78-8aa5-2efa4e304cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:22.860933 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acb1fb-37d0-4c78-8aa5-2efa4e304cab admin admin] PATH_INFO: `/v3/projects/b42db445afec40578207d457a3cdf216/users/12b929e4cb6e40fe902745d9e5238490/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:22.927363 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0acb1fb-37d0-4c78-8aa5-2efa4e304cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b42db445afec40578207d457a3cdf216, user_id=12b929e4cb6e40fe902745d9e5238490, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:22.933567 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0acb1fb-37d0-4c78-8aa5-2efa4e304cab admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:22.961842 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1107/2239] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:03:22 2022] PUT /identity/v3/projects/b42db445afec40578207d457a3cdf216/users/12b929e4cb6e40fe902745d9e5238490/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:22.973476 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0d628-e554-44a7-abbd-b60b49f4dd5a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:22.974418 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0d628-e554-44a7-abbd-b60b49f4dd5a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:22.974418 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0d628-e554-44a7-abbd-b60b49f4dd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:23.042254 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-eae0d628-e554-44a7-abbd-b60b49f4dd5a None None] MFA Rules not processed for user `12b929e4cb6e40fe902745d9e5238490`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:23.042254 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-eae0d628-e554-44a7-abbd-b60b49f4dd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:23.164115 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1133/2240] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:23.164426 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acb1fb-37d0-4c78-8aa5-2efa4e304cab admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:23.280804 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acb1fb-37d0-4c78-8aa5-2efa4e304cab admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:23.293231 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c334af0-4181-4fef-aa54-1227678054a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:23.293983 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c334af0-4181-4fef-aa54-1227678054a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:23.294269 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c334af0-4181-4fef-aa54-1227678054a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:23.294543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c334af0-4181-4fef-aa54-1227678054a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:23.295269 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c334af0-4181-4fef-aa54-1227678054a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:23.297237 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c334af0-4181-4fef-aa54-1227678054a7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:23.333855 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1108/2241] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:03:23 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:23.340449 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0d628-e554-44a7-abbd-b60b49f4dd5a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:23.357085 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0d628-e554-44a7-abbd-b60b49f4dd5a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:23.450753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4fcd8-2e06-4e54-9410-12a26a593dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:23.452100 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4fcd8-2e06-4e54-9410-12a26a593dbb admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:23.452724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4fcd8-2e06-4e54-9410-12a26a593dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:23.453159 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4fcd8-2e06-4e54-9410-12a26a593dbb admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:23.454053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4fcd8-2e06-4e54-9410-12a26a593dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:23.456397 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4fcd8-2e06-4e54-9410-12a26a593dbb admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:23.485278 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1134/2242] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:03:23 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:23.489758 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c334af0-4181-4fef-aa54-1227678054a7 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:23.502258 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c334af0-4181-4fef-aa54-1227678054a7 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:23.510962 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946a201-c2e7-4b8e-828e-7ace3b755056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:23.511938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946a201-c2e7-4b8e-828e-7ace3b755056 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:23.512299 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946a201-c2e7-4b8e-828e-7ace3b755056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:23.512654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946a201-c2e7-4b8e-828e-7ace3b755056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:23.513525 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946a201-c2e7-4b8e-828e-7ace3b755056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:23.515250 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946a201-c2e7-4b8e-828e-7ace3b755056 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:23.530501 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1109/2243] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:23.532393 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4fcd8-2e06-4e54-9410-12a26a593dbb admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:23.544637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4fcd8-2e06-4e54-9410-12a26a593dbb admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:23.549636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3264c8-927c-48ab-9f11-9d7647958c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:23.550366 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3264c8-927c-48ab-9f11-9d7647958c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:23.550654 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3264c8-927c-48ab-9f11-9d7647958c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:23.550955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3264c8-927c-48ab-9f11-9d7647958c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:23.551703 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3264c8-927c-48ab-9f11-9d7647958c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:23.553447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3264c8-927c-48ab-9f11-9d7647958c32 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:23.566234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1135/2244] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:23.570425 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946a201-c2e7-4b8e-828e-7ace3b755056 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:23.586534 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946a201-c2e7-4b8e-828e-7ace3b755056 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:23.595835 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ceac42-5338-4d64-88bc-530530ffa790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:23.597468 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ceac42-5338-4d64-88bc-530530ffa790 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:23.597963 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ceac42-5338-4d64-88bc-530530ffa790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:23.598453 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ceac42-5338-4d64-88bc-530530ffa790 admin admin] PATH_INFO: `/v3/projects/adbd2bde4b4a4ff89374d2787e385456/users/362216f420ce4d84a33b8c7152c62b38/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:23.628663 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ceac42-5338-4d64-88bc-530530ffa790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adbd2bde4b4a4ff89374d2787e385456, user_id=362216f420ce4d84a33b8c7152c62b38, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:23.634064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ceac42-5338-4d64-88bc-530530ffa790 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:23.658939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1110/2245] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:03:23 2022] PUT /identity/v3/projects/adbd2bde4b4a4ff89374d2787e385456/users/362216f420ce4d84a33b8c7152c62b38/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:23.669846 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63724b-d400-42e1-bbb7-1683e5a20fe5 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:23.670162 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63724b-d400-42e1-bbb7-1683e5a20fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:23.670458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63724b-d400-42e1-bbb7-1683e5a20fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:23.736098 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-dd63724b-d400-42e1-bbb7-1683e5a20fe5 None None] MFA Rules not processed for user `362216f420ce4d84a33b8c7152c62b38`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:23.737340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-dd63724b-d400-42e1-bbb7-1683e5a20fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:23.766115 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:23.839421 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1136/2246] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:23.843935 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ceac42-5338-4d64-88bc-530530ffa790 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:23.897810 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:23.967612 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ceac42-5338-4d64-88bc-530530ffa790 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:23.972961 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911401a-b52b-4716-9785-cd97415ff626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:23.973669 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911401a-b52b-4716-9785-cd97415ff626 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:23.974633 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911401a-b52b-4716-9785-cd97415ff626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:23.974633 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911401a-b52b-4716-9785-cd97415ff626 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:23.975091 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911401a-b52b-4716-9785-cd97415ff626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:23.977075 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911401a-b52b-4716-9785-cd97415ff626 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:24.015321 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1111/2247] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:03:23 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:24.019891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63724b-d400-42e1-bbb7-1683e5a20fe5 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:24.038573 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63724b-d400-42e1-bbb7-1683e5a20fe5 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:24.155125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1805c-392e-437c-bb1b-e17dba55bac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:24.156564 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1805c-392e-437c-bb1b-e17dba55bac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:24.157022 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1805c-392e-437c-bb1b-e17dba55bac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:24.157368 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1805c-392e-437c-bb1b-e17dba55bac1 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:24.158232 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1805c-392e-437c-bb1b-e17dba55bac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:24.161062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1805c-392e-437c-bb1b-e17dba55bac1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:24.231549 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1137/2248] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:03:24 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:24.235509 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911401a-b52b-4716-9785-cd97415ff626 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:24.259945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911401a-b52b-4716-9785-cd97415ff626 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:24.272952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025d8b4-4df3-4edc-b4d6-f3911e76b7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:24.273877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025d8b4-4df3-4edc-b4d6-f3911e76b7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:24.274264 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025d8b4-4df3-4edc-b4d6-f3911e76b7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:24.274642 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025d8b4-4df3-4edc-b4d6-f3911e76b7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:24.275523 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025d8b4-4df3-4edc-b4d6-f3911e76b7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:24.277340 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025d8b4-4df3-4edc-b4d6-f3911e76b7f9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:24.314019 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1112/2249] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:03:24.318435 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1805c-392e-437c-bb1b-e17dba55bac1 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:24.339248 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1805c-392e-437c-bb1b-e17dba55bac1 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:24.345544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ee87a-cdb6-4349-b52f-61fed4565129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:24.346627 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ee87a-cdb6-4349-b52f-61fed4565129 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:24.347011 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ee87a-cdb6-4349-b52f-61fed4565129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:24.347341 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ee87a-cdb6-4349-b52f-61fed4565129 admin admin] PATH_INFO: `/v3/projects/44f96cc7dcb944c5b69333e7bcbabf86/users/46faa8e8b7be4525abb861394b849a80/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:24.395085 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ee87a-cdb6-4349-b52f-61fed4565129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f96cc7dcb944c5b69333e7bcbabf86, user_id=46faa8e8b7be4525abb861394b849a80, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:24.397821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ee87a-cdb6-4349-b52f-61fed4565129 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:24.429666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1138/2250] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:03:24 2022] PUT /identity/v3/projects/44f96cc7dcb944c5b69333e7bcbabf86/users/46faa8e8b7be4525abb861394b849a80/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:24.431234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025d8b4-4df3-4edc-b4d6-f3911e76b7f9 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:24.448699 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025d8b4-4df3-4edc-b4d6-f3911e76b7f9 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:24.577720 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1705dd-71f5-45d9-9690-3ff14fa9fb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:24.578857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1705dd-71f5-45d9-9690-3ff14fa9fb6f admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:24.579402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1705dd-71f5-45d9-9690-3ff14fa9fb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:24.579953 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1705dd-71f5-45d9-9690-3ff14fa9fb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:24.581036 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1705dd-71f5-45d9-9690-3ff14fa9fb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:24.582847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1705dd-71f5-45d9-9690-3ff14fa9fb6f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:24.599060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1113/2251] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:24.603864 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ee87a-cdb6-4349-b52f-61fed4565129 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:24.619030 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ee87a-cdb6-4349-b52f-61fed4565129 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:24.625783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039590e5-4876-447d-94c3-240f03c44e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:24.626740 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039590e5-4876-447d-94c3-240f03c44e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:24.627015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039590e5-4876-447d-94c3-240f03c44e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:24.627285 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039590e5-4876-447d-94c3-240f03c44e23 admin admin] PATH_INFO: `/v3/projects/44f96cc7dcb944c5b69333e7bcbabf86/users/46faa8e8b7be4525abb861394b849a80/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:24.629322 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039590e5-4876-447d-94c3-240f03c44e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f96cc7dcb944c5b69333e7bcbabf86, user_id=46faa8e8b7be4525abb861394b849a80, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:24.632209 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039590e5-4876-447d-94c3-240f03c44e23 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:24.662659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1139/2252] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:03:24 2022] PUT /identity/v3/projects/44f96cc7dcb944c5b69333e7bcbabf86/users/46faa8e8b7be4525abb861394b849a80/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:24.736264 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335e01c-58ae-49f8-abde-708060b757d1 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:24.736555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335e01c-58ae-49f8-abde-708060b757d1 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:24.736870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335e01c-58ae-49f8-abde-708060b757d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:24.794060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-1335e01c-58ae-49f8-abde-708060b757d1 None None] MFA Rules not processed for user `46faa8e8b7be4525abb861394b849a80`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:24.796392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1335e01c-58ae-49f8-abde-708060b757d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:24.903199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:24.932631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1114/2253] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:24.944503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039590e5-4876-447d-94c3-240f03c44e23 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:24.946649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-039590e5-4876-447d-94c3-240f03c44e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:25.109162 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039590e5-4876-447d-94c3-240f03c44e23 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:25.113754 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605fe47-4f1d-47db-9df5-b5bfd0e16915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:25.114794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605fe47-4f1d-47db-9df5-b5bfd0e16915 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:25.114794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605fe47-4f1d-47db-9df5-b5bfd0e16915 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:25.114996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605fe47-4f1d-47db-9df5-b5bfd0e16915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:25.137344 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:25.191000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605fe47-4f1d-47db-9df5-b5bfd0e16915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:25.192729 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605fe47-4f1d-47db-9df5-b5bfd0e16915 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:25.204635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1140/2254] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:03:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:03:27.091692 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335e01c-58ae-49f8-abde-708060b757d1 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:27.094337 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1335e01c-58ae-49f8-abde-708060b757d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:27.128120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335e01c-58ae-49f8-abde-708060b757d1 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:27.133616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c041876-d32c-466b-84ab-704c5af3c5ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:27.133616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c041876-d32c-466b-84ab-704c5af3c5ad service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:27.133616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c041876-d32c-466b-84ab-704c5af3c5ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:27.133616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c041876-d32c-466b-84ab-704c5af3c5ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:27.286337 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c041876-d32c-466b-84ab-704c5af3c5ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:27.287891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c041876-d32c-466b-84ab-704c5af3c5ad service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:27.298392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1115/2255] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:03:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:03:28.178858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605fe47-4f1d-47db-9df5-b5bfd0e16915 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:28.195491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605fe47-4f1d-47db-9df5-b5bfd0e16915 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:28.202140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44c299-00c8-4ff4-8be8-e04943246cb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:28.203272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44c299-00c8-4ff4-8be8-e04943246cb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:28.203790 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44c299-00c8-4ff4-8be8-e04943246cb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:28.204273 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44c299-00c8-4ff4-8be8-e04943246cb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:28.220563 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44c299-00c8-4ff4-8be8-e04943246cb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:28.223277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44c299-00c8-4ff4-8be8-e04943246cb7 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:28.243491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1141/2256] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:03:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:03:32.231422 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c041876-d32c-466b-84ab-704c5af3c5ad service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:32.331638 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c041876-d32c-466b-84ab-704c5af3c5ad service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:32.336684 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcbed9-5b75-47a2-938a-db7a3dd8e263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:32.337582 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcbed9-5b75-47a2-938a-db7a3dd8e263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:32.337898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcbed9-5b75-47a2-938a-db7a3dd8e263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:32.338460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcbed9-5b75-47a2-938a-db7a3dd8e263 admin admin] PATH_INFO: `/v3/users/12b929e4cb6e40fe902745d9e5238490` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:32.340182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcbed9-5b75-47a2-938a-db7a3dd8e263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b929e4cb6e40fe902745d9e5238490)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:32.342393 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcbed9-5b75-47a2-938a-db7a3dd8e263 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:32.415225 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-21fcbed9-5b75-47a2-938a-db7a3dd8e263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b929e4cb6e40fe902745d9e5238490'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:32.415963 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-21fcbed9-5b75-47a2-938a-db7a3dd8e263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b929e4cb6e40fe902745d9e5238490'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:32.424953 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-21fcbed9-5b75-47a2-938a-db7a3dd8e263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b929e4cb6e40fe902745d9e5238490'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:32.442851 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-21fcbed9-5b75-47a2-938a-db7a3dd8e263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b929e4cb6e40fe902745d9e5238490'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:32.443538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:32.444206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-21fcbed9-5b75-47a2-938a-db7a3dd8e263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b929e4cb6e40fe902745d9e5238490'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:32.465307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1116/2257] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:03:32 2022] DELETE /identity/v3/users/12b929e4cb6e40fe902745d9e5238490 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:32.467248 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad37ca0-b78b-46a3-9ccd-8d0128752649 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:32.467772 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad37ca0-b78b-46a3-9ccd-8d0128752649 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:32.467772 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad37ca0-b78b-46a3-9ccd-8d0128752649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:32.514237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-8ad37ca0-b78b-46a3-9ccd-8d0128752649 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:32.515646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8ad37ca0-b78b-46a3-9ccd-8d0128752649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:32.596399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1142/2258] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:32.606442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcbed9-5b75-47a2-938a-db7a3dd8e263 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:32.607909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-21fcbed9-5b75-47a2-938a-db7a3dd8e263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:32.725254 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcbed9-5b75-47a2-938a-db7a3dd8e263 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:32.729920 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a4feb-3af4-4059-a53c-91b7bf813381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:32.730764 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a4feb-3af4-4059-a53c-91b7bf813381 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:32.731273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a4feb-3af4-4059-a53c-91b7bf813381 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:32.731577 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a4feb-3af4-4059-a53c-91b7bf813381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:32.744702 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a4feb-3af4-4059-a53c-91b7bf813381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:32.746726 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a4feb-3af4-4059-a53c-91b7bf813381 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:32.757632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1117/2259] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:03:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:03:33.193150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad37ca0-b78b-46a3-9ccd-8d0128752649 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:33.194829 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8ad37ca0-b78b-46a3-9ccd-8d0128752649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:33.213166 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad37ca0-b78b-46a3-9ccd-8d0128752649 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:33.239432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8906fd7-a6bf-47e0-a297-fff6311f5ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:33.240546 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8906fd7-a6bf-47e0-a297-fff6311f5ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:33.240930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8906fd7-a6bf-47e0-a297-fff6311f5ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:33.241150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8906fd7-a6bf-47e0-a297-fff6311f5ac9 admin admin] PATH_INFO: `/v3/projects/b42db445afec40578207d457a3cdf216` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:33.243235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8906fd7-a6bf-47e0-a297-fff6311f5ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b42db445afec40578207d457a3cdf216)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:33.247529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8906fd7-a6bf-47e0-a297-fff6311f5ac9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:33.358967 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b8906fd7-a6bf-47e0-a297-fff6311f5ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b42db445afec40578207d457a3cdf216', 'request_id': 'req-b8906fd7-a6bf-47e0-a297-fff6311f5ac9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:33.373228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b8906fd7-a6bf-47e0-a297-fff6311f5ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b42db445afec40578207d457a3cdf216', 'request_id': 'req-b8906fd7-a6bf-47e0-a297-fff6311f5ac9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:33.383340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b8906fd7-a6bf-47e0-a297-fff6311f5ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b42db445afec40578207d457a3cdf216', 'request_id': 'req-b8906fd7-a6bf-47e0-a297-fff6311f5ac9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:33.396976 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b8906fd7-a6bf-47e0-a297-fff6311f5ac9 admin admin] The token cache is being invalidate because project b42db445afec40578207d457a3cdf216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:03:33.397255 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b8906fd7-a6bf-47e0-a297-fff6311f5ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:33.397986 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b8906fd7-a6bf-47e0-a297-fff6311f5ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:33.404021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1143/2260] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:03:33 2022] DELETE /identity/v3/projects/b42db445afec40578207d457a3cdf216 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:33.404274 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a4feb-3af4-4059-a53c-91b7bf813381 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:33.415080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a4feb-3af4-4059-a53c-91b7bf813381 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:33.520398 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58774949-2c64-4716-bc77-88352d836e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:33.521788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58774949-2c64-4716-bc77-88352d836e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:33.522913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58774949-2c64-4716-bc77-88352d836e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:33.523387 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58774949-2c64-4716-bc77-88352d836e9d admin admin] PATH_INFO: `/v3/users/362216f420ce4d84a33b8c7152c62b38` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:33.525341 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58774949-2c64-4716-bc77-88352d836e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=362216f420ce4d84a33b8c7152c62b38)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:33.528168 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58774949-2c64-4716-bc77-88352d836e9d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:33.589743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-58774949-2c64-4716-bc77-88352d836e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '362216f420ce4d84a33b8c7152c62b38'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:33.590527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-58774949-2c64-4716-bc77-88352d836e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '362216f420ce4d84a33b8c7152c62b38'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:33.600173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-58774949-2c64-4716-bc77-88352d836e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '362216f420ce4d84a33b8c7152c62b38'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:33.615385 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-58774949-2c64-4716-bc77-88352d836e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '362216f420ce4d84a33b8c7152c62b38'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:33.616146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-58774949-2c64-4716-bc77-88352d836e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '362216f420ce4d84a33b8c7152c62b38'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:33.618152 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:INSERT=1,keystone:DELETE=10 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:33.655781 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1118/2261] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:03:33 2022] DELETE /identity/v3/users/362216f420ce4d84a33b8c7152c62b38 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:34.488467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8906fd7-a6bf-47e0-a297-fff6311f5ac9 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:34.489969 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b8906fd7-a6bf-47e0-a297-fff6311f5ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:34.506042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8906fd7-a6bf-47e0-a297-fff6311f5ac9 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:34.512827 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:34.620314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a29038-c2ca-4f0c-b7e8-762ae548e828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:34.621256 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a29038-c2ca-4f0c-b7e8-762ae548e828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:34.621537 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a29038-c2ca-4f0c-b7e8-762ae548e828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:34.621834 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a29038-c2ca-4f0c-b7e8-762ae548e828 admin admin] PATH_INFO: `/v3/projects/adbd2bde4b4a4ff89374d2787e385456` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:34.623238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a29038-c2ca-4f0c-b7e8-762ae548e828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adbd2bde4b4a4ff89374d2787e385456)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:34.625267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a29038-c2ca-4f0c-b7e8-762ae548e828 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:34.698083 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-63a29038-c2ca-4f0c-b7e8-762ae548e828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adbd2bde4b4a4ff89374d2787e385456', 'request_id': 'req-63a29038-c2ca-4f0c-b7e8-762ae548e828'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:34.708099 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-63a29038-c2ca-4f0c-b7e8-762ae548e828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adbd2bde4b4a4ff89374d2787e385456', 'request_id': 'req-63a29038-c2ca-4f0c-b7e8-762ae548e828'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:34.715478 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-63a29038-c2ca-4f0c-b7e8-762ae548e828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adbd2bde4b4a4ff89374d2787e385456', 'request_id': 'req-63a29038-c2ca-4f0c-b7e8-762ae548e828'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:34.727000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-63a29038-c2ca-4f0c-b7e8-762ae548e828 admin admin] The token cache is being invalidate because project adbd2bde4b4a4ff89374d2787e385456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:03:34.727291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-63a29038-c2ca-4f0c-b7e8-762ae548e828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:34.727956 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-63a29038-c2ca-4f0c-b7e8-762ae548e828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:34.729553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1144/2262] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:03:34 2022] DELETE /identity/v3/projects/adbd2bde4b4a4ff89374d2787e385456 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:34.733769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58774949-2c64-4716-bc77-88352d836e9d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:34.735270 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-58774949-2c64-4716-bc77-88352d836e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:34.751002 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58774949-2c64-4716-bc77-88352d836e9d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:34.813961 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9d99c-d51b-4ad3-807e-2eb1fc4fc486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:34.814866 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9d99c-d51b-4ad3-807e-2eb1fc4fc486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:34.815147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9d99c-d51b-4ad3-807e-2eb1fc4fc486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:34.815425 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9d99c-d51b-4ad3-807e-2eb1fc4fc486 admin admin] PATH_INFO: `/v3/users/46faa8e8b7be4525abb861394b849a80` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:34.816661 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9d99c-d51b-4ad3-807e-2eb1fc4fc486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46faa8e8b7be4525abb861394b849a80)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:34.818685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9d99c-d51b-4ad3-807e-2eb1fc4fc486 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:34.871514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2ea9d99c-d51b-4ad3-807e-2eb1fc4fc486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46faa8e8b7be4525abb861394b849a80'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:34.872093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2ea9d99c-d51b-4ad3-807e-2eb1fc4fc486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46faa8e8b7be4525abb861394b849a80'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:34.879499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2ea9d99c-d51b-4ad3-807e-2eb1fc4fc486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46faa8e8b7be4525abb861394b849a80'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:34.893299 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2ea9d99c-d51b-4ad3-807e-2eb1fc4fc486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46faa8e8b7be4525abb861394b849a80'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:34.894084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2ea9d99c-d51b-4ad3-807e-2eb1fc4fc486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46faa8e8b7be4525abb861394b849a80'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:34.909876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1119/2263] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:03:34 2022] DELETE /identity/v3/users/46faa8e8b7be4525abb861394b849a80 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:35.576533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a29038-c2ca-4f0c-b7e8-762ae548e828 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:35.579722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-63a29038-c2ca-4f0c-b7e8-762ae548e828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:35.595895 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a29038-c2ca-4f0c-b7e8-762ae548e828 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:35.672462 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306e7d2-758e-41fa-ab24-81ae89eb979a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:35.673371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306e7d2-758e-41fa-ab24-81ae89eb979a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:35.673657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306e7d2-758e-41fa-ab24-81ae89eb979a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:35.673969 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306e7d2-758e-41fa-ab24-81ae89eb979a admin admin] PATH_INFO: `/v3/projects/44f96cc7dcb944c5b69333e7bcbabf86` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:35.675192 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306e7d2-758e-41fa-ab24-81ae89eb979a admin admin] RBAC: Authorizing `identity:delete_project(project_id=44f96cc7dcb944c5b69333e7bcbabf86)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:35.677346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306e7d2-758e-41fa-ab24-81ae89eb979a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:35.726904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:35.735788 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f306e7d2-758e-41fa-ab24-81ae89eb979a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44f96cc7dcb944c5b69333e7bcbabf86', 'request_id': 'req-f306e7d2-758e-41fa-ab24-81ae89eb979a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:35.744832 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f306e7d2-758e-41fa-ab24-81ae89eb979a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44f96cc7dcb944c5b69333e7bcbabf86', 'request_id': 'req-f306e7d2-758e-41fa-ab24-81ae89eb979a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:35.753849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f306e7d2-758e-41fa-ab24-81ae89eb979a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44f96cc7dcb944c5b69333e7bcbabf86', 'request_id': 'req-f306e7d2-758e-41fa-ab24-81ae89eb979a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:35.765995 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f306e7d2-758e-41fa-ab24-81ae89eb979a admin admin] The token cache is being invalidate because project 44f96cc7dcb944c5b69333e7bcbabf86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:03:35.766414 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f306e7d2-758e-41fa-ab24-81ae89eb979a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:35.767080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f306e7d2-758e-41fa-ab24-81ae89eb979a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:35.768921 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1145/2264] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:03:35 2022] DELETE /identity/v3/projects/44f96cc7dcb944c5b69333e7bcbabf86 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:35.775373 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17df67f-27e6-45df-a7c8-a725f388f479 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:35.776185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17df67f-27e6-45df-a7c8-a725f388f479 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:35.776630 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17df67f-27e6-45df-a7c8-a725f388f479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:35.824535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-c17df67f-27e6-45df-a7c8-a725f388f479 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:35.825826 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c17df67f-27e6-45df-a7c8-a725f388f479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:35.883694 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:35.896666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1120/2265] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:03:35.904960 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830aee5-844d-44de-ba9a-7f918b986bad None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:35.905241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830aee5-844d-44de-ba9a-7f918b986bad None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:35.905512 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830aee5-844d-44de-ba9a-7f918b986bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:35.924793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c830aee5-844d-44de-ba9a-7f918b986bad None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:35.926061 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c830aee5-844d-44de-ba9a-7f918b986bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:35.934103 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1146/2266] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:35.938748 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17df67f-27e6-45df-a7c8-a725f388f479 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:35.950339 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17df67f-27e6-45df-a7c8-a725f388f479 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:35.955491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa8430-13d3-453a-8551-2280e20a989e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:35.956184 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa8430-13d3-453a-8551-2280e20a989e admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:35.956508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa8430-13d3-453a-8551-2280e20a989e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:35.956781 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa8430-13d3-453a-8551-2280e20a989e admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:35.957514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa8430-13d3-453a-8551-2280e20a989e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:35.957823 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa8430-13d3-453a-8551-2280e20a989e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:35.959463 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa8430-13d3-453a-8551-2280e20a989e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:35.975542 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1121/2267] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:03:35.977200 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830aee5-844d-44de-ba9a-7f918b986bad None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:35.986969 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830aee5-844d-44de-ba9a-7f918b986bad None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:35.992417 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19779de5-7798-4d27-8c2b-6af92074046c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:35.993130 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19779de5-7798-4d27-8c2b-6af92074046c admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:35.993392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19779de5-7798-4d27-8c2b-6af92074046c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:35.993665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19779de5-7798-4d27-8c2b-6af92074046c admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:35.994406 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19779de5-7798-4d27-8c2b-6af92074046c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:35.996329 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19779de5-7798-4d27-8c2b-6af92074046c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:36.026312 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1147/2268] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:03:35 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:36.030817 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa8430-13d3-453a-8551-2280e20a989e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:36.041822 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa8430-13d3-453a-8551-2280e20a989e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:36.106303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb970cf3-7595-492b-bf84-94ba803556df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:36.107000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970cf3-7595-492b-bf84-94ba803556df admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:36.107287 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970cf3-7595-492b-bf84-94ba803556df admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:36.107563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970cf3-7595-492b-bf84-94ba803556df admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:36.108272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb970cf3-7595-492b-bf84-94ba803556df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:36.110300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb970cf3-7595-492b-bf84-94ba803556df admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:36.136952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1122/2269] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:03:36 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:03:36.138635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19779de5-7798-4d27-8c2b-6af92074046c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:36.159959 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19779de5-7798-4d27-8c2b-6af92074046c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:36.166532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b7d22-316b-4c19-b8eb-760858e68210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:36.167223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b7d22-316b-4c19-b8eb-760858e68210 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:36.167482 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b7d22-316b-4c19-b8eb-760858e68210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:36.167814 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b7d22-316b-4c19-b8eb-760858e68210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:36.168520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b7d22-316b-4c19-b8eb-760858e68210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:36.170163 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b7d22-316b-4c19-b8eb-760858e68210 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:36.185382 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1148/2270] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:36.190098 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb970cf3-7595-492b-bf84-94ba803556df admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:36.204836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb970cf3-7595-492b-bf84-94ba803556df admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:36.209917 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8c485-111e-4f14-9951-01bd3602604d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:36.210816 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8c485-111e-4f14-9951-01bd3602604d admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:36.211142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8c485-111e-4f14-9951-01bd3602604d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:36.211424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8c485-111e-4f14-9951-01bd3602604d admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:36.212410 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8c485-111e-4f14-9951-01bd3602604d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:36.214084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8c485-111e-4f14-9951-01bd3602604d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:36.226721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1123/2271] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:36.230927 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b7d22-316b-4c19-b8eb-760858e68210 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:36.241487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b7d22-316b-4c19-b8eb-760858e68210 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:36.247928 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825a82f-fabb-4822-9857-2b0a5c85d3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:36.248957 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825a82f-fabb-4822-9857-2b0a5c85d3da admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:36.249328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825a82f-fabb-4822-9857-2b0a5c85d3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:36.249658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825a82f-fabb-4822-9857-2b0a5c85d3da admin admin] PATH_INFO: `/v3/projects/6ad466a7fdbb4ef18dddf54fb200971d/users/5c5875c5cba841a28560a475bb18d595/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:36.266557 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825a82f-fabb-4822-9857-2b0a5c85d3da admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad466a7fdbb4ef18dddf54fb200971d, user_id=5c5875c5cba841a28560a475bb18d595, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:36.269364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825a82f-fabb-4822-9857-2b0a5c85d3da admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:36.285329 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1149/2272] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:03:36 2022] PUT /identity/v3/projects/6ad466a7fdbb4ef18dddf54fb200971d/users/5c5875c5cba841a28560a475bb18d595/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:36.290641 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd117d73-4ea7-44ce-8fe3-ee7258a8664b None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:36.291005 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd117d73-4ea7-44ce-8fe3-ee7258a8664b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:36.291329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd117d73-4ea7-44ce-8fe3-ee7258a8664b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:36.292919 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5222f-8d60-4d02-bdd0-3267408ef2d1 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:36.293227 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5222f-8d60-4d02-bdd0-3267408ef2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:36.293503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5222f-8d60-4d02-bdd0-3267408ef2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:36.310334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-fd117d73-4ea7-44ce-8fe3-ee7258a8664b None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:36.311207 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5dd5222f-8d60-4d02-bdd0-3267408ef2d1 None None] MFA Rules not processed for user `4a660a47927140d6b4d0543de5e281a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:36.311680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-fd117d73-4ea7-44ce-8fe3-ee7258a8664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:36.312400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5dd5222f-8d60-4d02-bdd0-3267408ef2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:36.374451 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1150/2273] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:36.385064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1124/2274] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:36.391736 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5222f-8d60-4d02-bdd0-3267408ef2d1 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:36.393118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5dd5222f-8d60-4d02-bdd0-3267408ef2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:36.456234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5222f-8d60-4d02-bdd0-3267408ef2d1 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:36.459879 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c68310-6f6b-499e-9aec-65338b6579a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:36.460529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c68310-6f6b-499e-9aec-65338b6579a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:36.460808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c68310-6f6b-499e-9aec-65338b6579a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:36.461166 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c68310-6f6b-499e-9aec-65338b6579a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:36.473590 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c68310-6f6b-499e-9aec-65338b6579a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:36.475126 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c68310-6f6b-499e-9aec-65338b6579a3 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:36.485237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1151/2275] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:03:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:03:37.260055 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681944c-bb95-4d67-9508-6ee65c84c1de None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:37.260587 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681944c-bb95-4d67-9508-6ee65c84c1de None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:37.260835 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681944c-bb95-4d67-9508-6ee65c84c1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:37.295432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8681944c-bb95-4d67-9508-6ee65c84c1de None None] MFA Rules not processed for user `5c5875c5cba841a28560a475bb18d595`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:37.297275 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8681944c-bb95-4d67-9508-6ee65c84c1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:37.389871 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:37.418030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1125/2276] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:37.429335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c68310-6f6b-499e-9aec-65338b6579a3 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:37.431722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-11c68310-6f6b-499e-9aec-65338b6579a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:37.447707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:37.503720 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c68310-6f6b-499e-9aec-65338b6579a3 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:37.507279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4bbf9-53b4-4ecd-a543-997d5a55616c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:37.508078 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4bbf9-53b4-4ecd-a543-997d5a55616c service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:37.508552 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4bbf9-53b4-4ecd-a543-997d5a55616c service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:37.508974 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4bbf9-53b4-4ecd-a543-997d5a55616c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:37.519570 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4bbf9-53b4-4ecd-a543-997d5a55616c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:37.520201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4bbf9-53b4-4ecd-a543-997d5a55616c service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:37.530798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1152/2277] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:03:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:03:39.795911 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbafae0-463b-4a2d-a085-615f4954d23a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:39.796809 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbafae0-463b-4a2d-a085-615f4954d23a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:39.797994 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbafae0-463b-4a2d-a085-615f4954d23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:39.846652 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ecbafae0-463b-4a2d-a085-615f4954d23a None None] MFA Rules not processed for user `23aa142375c54b94ad276d1a4b9031e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:39.849008 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ecbafae0-463b-4a2d-a085-615f4954d23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:39.988984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1126/2278] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 2 19:03:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:40.010286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4bbf9-53b4-4ecd-a543-997d5a55616c service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:40.012226 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c1e4bbf9-53b4-4ecd-a543-997d5a55616c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:40.113358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8388b-0b8c-4e35-af9d-138e557df87d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:40.113974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8388b-0b8c-4e35-af9d-138e557df87d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:40.114276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8388b-0b8c-4e35-af9d-138e557df87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:40.130850 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4bbf9-53b4-4ecd-a543-997d5a55616c service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:40.138525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcae688-b6e1-41f3-8ecb-13be98dbe854 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4faac48f82244bebf039aab92898617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:40.140051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcae688-b6e1-41f3-8ecb-13be98dbe854 service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:40.140622 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcae688-b6e1-41f3-8ecb-13be98dbe854 service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:40.141273 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcae688-b6e1-41f3-8ecb-13be98dbe854 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:40.153651 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-08a8388b-0b8c-4e35-af9d-138e557df87d None None] MFA Rules not processed for user `5c5875c5cba841a28560a475bb18d595`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:40.156503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcae688-b6e1-41f3-8ecb-13be98dbe854 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:40.158779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcae688-b6e1-41f3-8ecb-13be98dbe854 service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:40.159766 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-08a8388b-0b8c-4e35-af9d-138e557df87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:40.172640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1153/2279] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 2 19:03:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:03:40.174435 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1127/2280] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:44.956015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce4656-10bd-4237-a162-7807d9ab924c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:44.957509 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce4656-10bd-4237-a162-7807d9ab924c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:44.958248 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce4656-10bd-4237-a162-7807d9ab924c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:45.001583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-66ce4656-10bd-4237-a162-7807d9ab924c None None] MFA Rules not processed for user `23aa142375c54b94ad276d1a4b9031e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:45.004860 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-66ce4656-10bd-4237-a162-7807d9ab924c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:45.024461 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1154/2281] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 2 19:03:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:45.044631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8388b-0b8c-4e35-af9d-138e557df87d None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:45.142581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8388b-0b8c-4e35-af9d-138e557df87d None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:45.187251 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f64d0-fa66-49aa-8f63-c7de9c6501f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4faac48f82244bebf039aab92898617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:45.190404 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f64d0-fa66-49aa-8f63-c7de9c6501f2 service swift] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:45.191864 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f64d0-fa66-49aa-8f63-c7de9c6501f2 service swift] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:45.194246 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f64d0-fa66-49aa-8f63-c7de9c6501f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:45.237741 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f64d0-fa66-49aa-8f63-c7de9c6501f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:45.245991 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f64d0-fa66-49aa-8f63-c7de9c6501f2 service swift] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:45.299318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1128/2282] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 2 19:03:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:03:54.994251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=56 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:55.267279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=42 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:55.397176 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce4656-10bd-4237-a162-7807d9ab924c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:55.399497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-66ce4656-10bd-4237-a162-7807d9ab924c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:55.423816 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce4656-10bd-4237-a162-7807d9ab924c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:55.431386 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9060ee-1b8d-4162-9068-98982f09c1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:55.432976 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9060ee-1b8d-4162-9068-98982f09c1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:55.433532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9060ee-1b8d-4162-9068-98982f09c1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:55.434147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9060ee-1b8d-4162-9068-98982f09c1b9 admin admin] PATH_INFO: `/v3/users/a230ba9c6ba14c21a5363b49ed46e7c6` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:55.436077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9060ee-1b8d-4162-9068-98982f09c1b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a230ba9c6ba14c21a5363b49ed46e7c6)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:55.438946 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9060ee-1b8d-4162-9068-98982f09c1b9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:55.588251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fe9060ee-1b8d-4162-9068-98982f09c1b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a230ba9c6ba14c21a5363b49ed46e7c6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:55.589296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fe9060ee-1b8d-4162-9068-98982f09c1b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a230ba9c6ba14c21a5363b49ed46e7c6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:55.617450 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fe9060ee-1b8d-4162-9068-98982f09c1b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a230ba9c6ba14c21a5363b49ed46e7c6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:55.652430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fe9060ee-1b8d-4162-9068-98982f09c1b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a230ba9c6ba14c21a5363b49ed46e7c6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:55.653156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fe9060ee-1b8d-4162-9068-98982f09c1b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a230ba9c6ba14c21a5363b49ed46e7c6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:55.717690 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1155/2283] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:03:55 2022] DELETE /identity/v3/users/a230ba9c6ba14c21a5363b49ed46e7c6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:55.721258 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95302e44-c32c-46e4-8702-cc8c631098dc None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:55.721529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95302e44-c32c-46e4-8702-cc8c631098dc None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:55.722132 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95302e44-c32c-46e4-8702-cc8c631098dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:55.767953 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-95302e44-c32c-46e4-8702-cc8c631098dc None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:55.769575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-95302e44-c32c-46e4-8702-cc8c631098dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:56.050989 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1129/2284] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:56.074697 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9060ee-1b8d-4162-9068-98982f09c1b9 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:56.077698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fe9060ee-1b8d-4162-9068-98982f09c1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:56.255048 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9060ee-1b8d-4162-9068-98982f09c1b9 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:56.278867 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d5077-c033-41b7-a43f-3daa99491f8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:56.280090 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d5077-c033-41b7-a43f-3daa99491f8a service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:56.280549 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d5077-c033-41b7-a43f-3daa99491f8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:56.280990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d5077-c033-41b7-a43f-3daa99491f8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:56.334624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d5077-c033-41b7-a43f-3daa99491f8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:56.344544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d5077-c033-41b7-a43f-3daa99491f8a service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:56.374435 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1156/2285] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:03:56.999311 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95302e44-c32c-46e4-8702-cc8c631098dc None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:57.002186 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-95302e44-c32c-46e4-8702-cc8c631098dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:57.019385 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95302e44-c32c-46e4-8702-cc8c631098dc None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:57.027621 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514a760-5642-49c0-b5e3-0124073de9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:57.028606 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514a760-5642-49c0-b5e3-0124073de9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:57.028891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514a760-5642-49c0-b5e3-0124073de9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:57.029162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514a760-5642-49c0-b5e3-0124073de9a3 admin admin] PATH_INFO: `/v3/projects/1ecafb2efea74f9ab0095176a48a91ac` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:57.030642 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514a760-5642-49c0-b5e3-0124073de9a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ecafb2efea74f9ab0095176a48a91ac)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:57.034208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514a760-5642-49c0-b5e3-0124073de9a3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:57.115027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f514a760-5642-49c0-b5e3-0124073de9a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ecafb2efea74f9ab0095176a48a91ac', 'request_id': 'req-f514a760-5642-49c0-b5e3-0124073de9a3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:57.123762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f514a760-5642-49c0-b5e3-0124073de9a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ecafb2efea74f9ab0095176a48a91ac', 'request_id': 'req-f514a760-5642-49c0-b5e3-0124073de9a3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:57.138294 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f514a760-5642-49c0-b5e3-0124073de9a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ecafb2efea74f9ab0095176a48a91ac', 'request_id': 'req-f514a760-5642-49c0-b5e3-0124073de9a3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:57.154074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f514a760-5642-49c0-b5e3-0124073de9a3 admin admin] The token cache is being invalidate because project 1ecafb2efea74f9ab0095176a48a91ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:03:57.154580 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f514a760-5642-49c0-b5e3-0124073de9a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:57.165589 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f514a760-5642-49c0-b5e3-0124073de9a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:03:57.175984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1130/2286] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:03:56 2022] DELETE /identity/v3/projects/1ecafb2efea74f9ab0095176a48a91ac => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:03:57.181779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff90d28-ec5a-4818-aa64-6048d46e260a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:57.182799 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff90d28-ec5a-4818-aa64-6048d46e260a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:57.183271 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff90d28-ec5a-4818-aa64-6048d46e260a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:57.239581 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-fff90d28-ec5a-4818-aa64-6048d46e260a None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:57.241223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fff90d28-ec5a-4818-aa64-6048d46e260a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:57.353229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1157/2287] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:03:57.362466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003c3b3-9e11-4617-8a68-57c25df95971 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:57.362828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003c3b3-9e11-4617-8a68-57c25df95971 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:57.363197 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003c3b3-9e11-4617-8a68-57c25df95971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:57.392625 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-1003c3b3-9e11-4617-8a68-57c25df95971 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:57.394347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1003c3b3-9e11-4617-8a68-57c25df95971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:57.407617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1131/2288] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:57.408554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff90d28-ec5a-4818-aa64-6048d46e260a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:57.426975 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff90d28-ec5a-4818-aa64-6048d46e260a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:57.436089 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7df51-7990-416b-927b-7f39d9cdf2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:57.437089 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7df51-7990-416b-927b-7f39d9cdf2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:57.437386 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7df51-7990-416b-927b-7f39d9cdf2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:57.437658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7df51-7990-416b-927b-7f39d9cdf2d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:57.438464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7df51-7990-416b-927b-7f39d9cdf2d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:03:57.438779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7df51-7990-416b-927b-7f39d9cdf2d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:57.440342 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7df51-7990-416b-927b-7f39d9cdf2d7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:57.442409 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:57.463522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1158/2289] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:03:57.467822 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003c3b3-9e11-4617-8a68-57c25df95971 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:57.484589 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003c3b3-9e11-4617-8a68-57c25df95971 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:57.491830 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df1635-9a49-447d-b965-45b792d17ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:57.492826 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df1635-9a49-447d-b965-45b792d17ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:57.493607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df1635-9a49-447d-b965-45b792d17ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:57.493944 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df1635-9a49-447d-b965-45b792d17ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:57.495145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df1635-9a49-447d-b965-45b792d17ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:57.497990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df1635-9a49-447d-b965-45b792d17ed5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:57.548847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1132/2290] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:03:57 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:03:57.549098 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7df51-7990-416b-927b-7f39d9cdf2d7 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:57.561665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7df51-7990-416b-927b-7f39d9cdf2d7 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:57.647025 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf536cb-a436-43fc-a1bd-3253c4dcd248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:57.647819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf536cb-a436-43fc-a1bd-3253c4dcd248 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:57.648209 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf536cb-a436-43fc-a1bd-3253c4dcd248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:57.648505 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf536cb-a436-43fc-a1bd-3253c4dcd248 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:57.649233 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf536cb-a436-43fc-a1bd-3253c4dcd248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:57.651257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf536cb-a436-43fc-a1bd-3253c4dcd248 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:57.684381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1159/2291] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:03:57 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:03:57.689455 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df1635-9a49-447d-b965-45b792d17ed5 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:57.702876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df1635-9a49-447d-b965-45b792d17ed5 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:57.708495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf062100-b264-43a6-8d05-17937adc98b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:57.709664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf062100-b264-43a6-8d05-17937adc98b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:57.710221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf062100-b264-43a6-8d05-17937adc98b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:57.710781 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf062100-b264-43a6-8d05-17937adc98b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:57.711554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf062100-b264-43a6-8d05-17937adc98b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:57.713686 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf062100-b264-43a6-8d05-17937adc98b5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:57.736588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1133/2292] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:03:57.736844 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf536cb-a436-43fc-a1bd-3253c4dcd248 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:57.749540 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf536cb-a436-43fc-a1bd-3253c4dcd248 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:57.754694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d8639-3e20-45ea-9099-c43abf588672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:57.755564 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d8639-3e20-45ea-9099-c43abf588672 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:57.755922 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d8639-3e20-45ea-9099-c43abf588672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:57.756268 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d8639-3e20-45ea-9099-c43abf588672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:57.757264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d8639-3e20-45ea-9099-c43abf588672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:57.759058 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d8639-3e20-45ea-9099-c43abf588672 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:57.775611 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf062100-b264-43a6-8d05-17937adc98b5 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:57.781061 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1160/2293] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:03:57.787959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf062100-b264-43a6-8d05-17937adc98b5 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:57.799948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e58b3-658f-4862-bc59-5d98f1088c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:57.800984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e58b3-658f-4862-bc59-5d98f1088c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:57.801338 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e58b3-658f-4862-bc59-5d98f1088c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:57.801682 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e58b3-658f-4862-bc59-5d98f1088c21 admin admin] PATH_INFO: `/v3/projects/f5335c358f804685a86aa5ec3f8efa1e/users/cd5d2cd258044e62982a0261c1138d45/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:57.848964 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e58b3-658f-4862-bc59-5d98f1088c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5335c358f804685a86aa5ec3f8efa1e, user_id=cd5d2cd258044e62982a0261c1138d45, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:57.852623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e58b3-658f-4862-bc59-5d98f1088c21 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:57.898000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1134/2294] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:03:57 2022] PUT /identity/v3/projects/f5335c358f804685a86aa5ec3f8efa1e/users/cd5d2cd258044e62982a0261c1138d45/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:03:57.901753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae475f-7477-449d-bffd-2fcd71529098 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:57.902149 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae475f-7477-449d-bffd-2fcd71529098 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:57.902500 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae475f-7477-449d-bffd-2fcd71529098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:57.935657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-73ae475f-7477-449d-bffd-2fcd71529098 None None] MFA Rules not processed for user `cd5d2cd258044e62982a0261c1138d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:03:57.936939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-73ae475f-7477-449d-bffd-2fcd71529098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:58.069938 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1161/2295] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:03:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:03:58.082748 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e58b3-658f-4862-bc59-5d98f1088c21 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:03:58.085372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e91e58b3-658f-4862-bc59-5d98f1088c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:03:58.131465 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:03:58.221471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e58b3-658f-4862-bc59-5d98f1088c21 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:03:58.226687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098901f-90db-4820-9eba-f1ca0e896c7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:03:58.228141 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098901f-90db-4820-9eba-f1ca0e896c7d service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:03:58.228905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098901f-90db-4820-9eba-f1ca0e896c7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:03:58.229430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098901f-90db-4820-9eba-f1ca0e896c7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:03:58.261063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098901f-90db-4820-9eba-f1ca0e896c7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:03:58.262645 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098901f-90db-4820-9eba-f1ca0e896c7d service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:03:58.276152 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1135/2296] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:03:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:04:01.163162 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae475f-7477-449d-bffd-2fcd71529098 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:01.283931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae475f-7477-449d-bffd-2fcd71529098 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:01.299420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe4a88-5945-477b-8622-b4217f8a2772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:01.303072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe4a88-5945-477b-8622-b4217f8a2772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:01.304662 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe4a88-5945-477b-8622-b4217f8a2772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:01.305247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe4a88-5945-477b-8622-b4217f8a2772 admin admin] PATH_INFO: `/v3/users/cd5d2cd258044e62982a0261c1138d45` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:01.308396 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe4a88-5945-477b-8622-b4217f8a2772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd5d2cd258044e62982a0261c1138d45)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:01.312871 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe4a88-5945-477b-8622-b4217f8a2772 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:01.317596 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:01.427706 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-bcfe4a88-5945-477b-8622-b4217f8a2772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd5d2cd258044e62982a0261c1138d45'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:01.429606 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-bcfe4a88-5945-477b-8622-b4217f8a2772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd5d2cd258044e62982a0261c1138d45'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:01.450431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-bcfe4a88-5945-477b-8622-b4217f8a2772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd5d2cd258044e62982a0261c1138d45'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:01.479660 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-bcfe4a88-5945-477b-8622-b4217f8a2772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd5d2cd258044e62982a0261c1138d45'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:01.481418 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-bcfe4a88-5945-477b-8622-b4217f8a2772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd5d2cd258044e62982a0261c1138d45'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:01.560915 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1162/2297] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:04:01 2022] DELETE /identity/v3/users/cd5d2cd258044e62982a0261c1138d45 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:04:01.566411 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740c64-d6c9-41f2-8b31-0cb6f54eed87 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:01.568466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740c64-d6c9-41f2-8b31-0cb6f54eed87 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:01.569529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740c64-d6c9-41f2-8b31-0cb6f54eed87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:01.614898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d7740c64-d6c9-41f2-8b31-0cb6f54eed87 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:01.623109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d7740c64-d6c9-41f2-8b31-0cb6f54eed87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:01.803433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1136/2298] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:04:01.885329 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe4a88-5945-477b-8622-b4217f8a2772 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:01.887933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-bcfe4a88-5945-477b-8622-b4217f8a2772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:02.043280 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe4a88-5945-477b-8622-b4217f8a2772 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:02.053343 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6604d15-eeb5-4baf-b92b-074dd041dbd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:02.054589 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6604d15-eeb5-4baf-b92b-074dd041dbd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:02.054983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6604d15-eeb5-4baf-b92b-074dd041dbd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:02.055363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6604d15-eeb5-4baf-b92b-074dd041dbd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:02.075980 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6604d15-eeb5-4baf-b92b-074dd041dbd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:02.077644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6604d15-eeb5-4baf-b92b-074dd041dbd4 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:02.100155 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1163/2299] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:04:02.644401 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740c64-d6c9-41f2-8b31-0cb6f54eed87 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:02.646760 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d7740c64-d6c9-41f2-8b31-0cb6f54eed87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:02.681537 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740c64-d6c9-41f2-8b31-0cb6f54eed87 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:02.692184 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332e3d0-610c-4d66-a0a0-7fa754867fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:02.694115 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332e3d0-610c-4d66-a0a0-7fa754867fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:02.694661 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332e3d0-610c-4d66-a0a0-7fa754867fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:02.696637 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332e3d0-610c-4d66-a0a0-7fa754867fb8 admin admin] PATH_INFO: `/v3/projects/f5335c358f804685a86aa5ec3f8efa1e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:02.699670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332e3d0-610c-4d66-a0a0-7fa754867fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5335c358f804685a86aa5ec3f8efa1e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:02.704752 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332e3d0-610c-4d66-a0a0-7fa754867fb8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:02.859694 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8332e3d0-610c-4d66-a0a0-7fa754867fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5335c358f804685a86aa5ec3f8efa1e', 'request_id': 'req-8332e3d0-610c-4d66-a0a0-7fa754867fb8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:02.889589 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8332e3d0-610c-4d66-a0a0-7fa754867fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5335c358f804685a86aa5ec3f8efa1e', 'request_id': 'req-8332e3d0-610c-4d66-a0a0-7fa754867fb8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:02.909762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8332e3d0-610c-4d66-a0a0-7fa754867fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5335c358f804685a86aa5ec3f8efa1e', 'request_id': 'req-8332e3d0-610c-4d66-a0a0-7fa754867fb8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:02.928906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8332e3d0-610c-4d66-a0a0-7fa754867fb8 admin admin] The token cache is being invalidate because project f5335c358f804685a86aa5ec3f8efa1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:04:02.931269 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8332e3d0-610c-4d66-a0a0-7fa754867fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:02.931269 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8332e3d0-610c-4d66-a0a0-7fa754867fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:02.940362 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08398165-074f-4f0f-90b6-d07cccce6e6c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:02.940914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08398165-074f-4f0f-90b6-d07cccce6e6c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:02.940914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08398165-074f-4f0f-90b6-d07cccce6e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:02.942585 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1137/2300] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:04:02 2022] DELETE /identity/v3/projects/f5335c358f804685a86aa5ec3f8efa1e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:04:02.968618 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-08398165-074f-4f0f-90b6-d07cccce6e6c None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:02.970669 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-08398165-074f-4f0f-90b6-d07cccce6e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:03.089866 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1164/2301] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:04:03.100715 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eed6af-470a-481e-9edf-035b008cbe55 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:03.101004 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eed6af-470a-481e-9edf-035b008cbe55 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:03.101397 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eed6af-470a-481e-9edf-035b008cbe55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:03.142533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-46eed6af-470a-481e-9edf-035b008cbe55 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:03.142533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-46eed6af-470a-481e-9edf-035b008cbe55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:03.151292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1138/2302] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:04:03.156614 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08398165-074f-4f0f-90b6-d07cccce6e6c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:03.176889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08398165-074f-4f0f-90b6-d07cccce6e6c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:03.183307 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b6df3-207a-4efe-9b63-b92fc0fb2ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:03.184585 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6df3-207a-4efe-9b63-b92fc0fb2ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:03.184929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6df3-207a-4efe-9b63-b92fc0fb2ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:03.185276 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6df3-207a-4efe-9b63-b92fc0fb2ca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:03.186137 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b6df3-207a-4efe-9b63-b92fc0fb2ca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:04:03.186503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b6df3-207a-4efe-9b63-b92fc0fb2ca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:03.188216 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b6df3-207a-4efe-9b63-b92fc0fb2ca3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:03.208728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1165/2303] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:03.214024 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eed6af-470a-481e-9edf-035b008cbe55 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:03.227141 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eed6af-470a-481e-9edf-035b008cbe55 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:03.232857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d8115-ec16-496d-b41e-fc7dbc5d390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:03.234063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d8115-ec16-496d-b41e-fc7dbc5d390d admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:03.234465 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d8115-ec16-496d-b41e-fc7dbc5d390d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:03.234833 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d8115-ec16-496d-b41e-fc7dbc5d390d admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:03.235652 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d8115-ec16-496d-b41e-fc7dbc5d390d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:03.237875 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d8115-ec16-496d-b41e-fc7dbc5d390d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:03.262410 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:03.272420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1139/2304] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:04:03 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:04:03.277725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b6df3-207a-4efe-9b63-b92fc0fb2ca3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:03.290448 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b6df3-207a-4efe-9b63-b92fc0fb2ca3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:03.321015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:03.570519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4e857-1edc-41da-810d-845128b075dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:03.571296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4e857-1edc-41da-810d-845128b075dc admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:03.571520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4e857-1edc-41da-810d-845128b075dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:03.571793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4e857-1edc-41da-810d-845128b075dc admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:03.572513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4e857-1edc-41da-810d-845128b075dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:03.577502 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4e857-1edc-41da-810d-845128b075dc admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:03.656037 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1166/2305] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:04:03 2022] POST /identity/v3/users => generated 288 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:04:03.660087 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d8115-ec16-496d-b41e-fc7dbc5d390d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:03.676481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d8115-ec16-496d-b41e-fc7dbc5d390d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:03.683232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9be176-3308-43bd-971c-3e2224e71a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:03.683939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9be176-3308-43bd-971c-3e2224e71a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:03.684224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9be176-3308-43bd-971c-3e2224e71a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:03.684500 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9be176-3308-43bd-971c-3e2224e71a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:03.685268 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9be176-3308-43bd-971c-3e2224e71a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:03.687154 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9be176-3308-43bd-971c-3e2224e71a3f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:03.700902 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1140/2306] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:04:03.704404 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4e857-1edc-41da-810d-845128b075dc admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:03.719786 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4e857-1edc-41da-810d-845128b075dc admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:03.728404 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc50ef4-c5ff-47e3-89fe-1e1557b217bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:03.729570 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc50ef4-c5ff-47e3-89fe-1e1557b217bd admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:03.730001 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc50ef4-c5ff-47e3-89fe-1e1557b217bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:03.730282 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc50ef4-c5ff-47e3-89fe-1e1557b217bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:03.731026 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc50ef4-c5ff-47e3-89fe-1e1557b217bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:03.732923 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc50ef4-c5ff-47e3-89fe-1e1557b217bd admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:03.748341 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1167/2307] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:04:03.749693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9be176-3308-43bd-971c-3e2224e71a3f admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:03.765323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9be176-3308-43bd-971c-3e2224e71a3f admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:03.771951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283075a-5a83-43f3-9330-c70c3eac02da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:03.772947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283075a-5a83-43f3-9330-c70c3eac02da admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:03.773784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283075a-5a83-43f3-9330-c70c3eac02da admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:03.774173 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283075a-5a83-43f3-9330-c70c3eac02da admin admin] PATH_INFO: `/v3/projects/01f30f060e2444f9a2238c4c447c7dbd/users/f54c975b432a4678a5624ad5c9f54b74/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:03.814655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283075a-5a83-43f3-9330-c70c3eac02da admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f30f060e2444f9a2238c4c447c7dbd, user_id=f54c975b432a4678a5624ad5c9f54b74, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:03.821080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283075a-5a83-43f3-9330-c70c3eac02da admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:03.853833 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1141/2308] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:04:03 2022] PUT /identity/v3/projects/01f30f060e2444f9a2238c4c447c7dbd/users/f54c975b432a4678a5624ad5c9f54b74/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:04:03.861566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5e10c-c956-4499-83a2-20aaa443c8f5 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:03.862823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5e10c-c956-4499-83a2-20aaa443c8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:03.863419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5e10c-c956-4499-83a2-20aaa443c8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:03.909075 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-1da5e10c-c956-4499-83a2-20aaa443c8f5 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:03.912012 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1da5e10c-c956-4499-83a2-20aaa443c8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:03.995000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1168/2309] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:04:04.004797 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283075a-5a83-43f3-9330-c70c3eac02da admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:04.006702 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0283075a-5a83-43f3-9330-c70c3eac02da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:04.077067 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283075a-5a83-43f3-9330-c70c3eac02da admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:04.082866 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2824d9-e08e-4be5-8c14-c26f0d11baf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:04.083470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2824d9-e08e-4be5-8c14-c26f0d11baf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:04.083887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2824d9-e08e-4be5-8c14-c26f0d11baf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:04.084169 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2824d9-e08e-4be5-8c14-c26f0d11baf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:04.099314 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2824d9-e08e-4be5-8c14-c26f0d11baf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:04.101025 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2824d9-e08e-4be5-8c14-c26f0d11baf7 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:04.117142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1142/2310] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:04:05.832918 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5e10c-c956-4499-83a2-20aaa443c8f5 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:05.847847 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5e10c-c956-4499-83a2-20aaa443c8f5 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:05.857384 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7729191-63be-4580-b0fb-1874cedd28be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:05.860240 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7729191-63be-4580-b0fb-1874cedd28be service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:05.862385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7729191-63be-4580-b0fb-1874cedd28be service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:05.862781 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7729191-63be-4580-b0fb-1874cedd28be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:05.868679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d7729191-63be-4580-b0fb-1874cedd28be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:06.067502 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7729191-63be-4580-b0fb-1874cedd28be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:06.069751 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7729191-63be-4580-b0fb-1874cedd28be service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:06.120320 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1169/2311] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:04:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:04:09.831364 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2def6e2-8996-45dc-a2d4-4d70cf8ded43 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:09.832362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2def6e2-8996-45dc-a2d4-4d70cf8ded43 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:09.832362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2def6e2-8996-45dc-a2d4-4d70cf8ded43 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:09.835704 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1143/2312] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 2 19:04:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:04:09.848718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e96c6-d744-4b6d-aacf-589fba65f42d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:09.849648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e96c6-d744-4b6d-aacf-589fba65f42d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:09.849648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e96c6-d744-4b6d-aacf-589fba65f42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:09.996303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:10.058648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-7c3e96c6-d744-4b6d-aacf-589fba65f42d None None] MFA Rules not processed for user `6b8ff9f5032e498db3c70c79cc11989b`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:10.060150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7c3e96c6-d744-4b6d-aacf-589fba65f42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:10.346156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1170/2313] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 2 19:04:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:04:10.363688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2def6e2-8996-45dc-a2d4-4d70cf8ded43 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:10.366533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f2def6e2-8996-45dc-a2d4-4d70cf8ded43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:10.609924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2def6e2-8996-45dc-a2d4-4d70cf8ded43 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:10.628834 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c29312-c6d8-44a7-9677-a7d4803aa50f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1b010003c44dc19643558167424d13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:10.629531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c29312-c6d8-44a7-9677-a7d4803aa50f service glance] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:10.629862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c29312-c6d8-44a7-9677-a7d4803aa50f service glance] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:10.630335 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c29312-c6d8-44a7-9677-a7d4803aa50f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:10.675625 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c29312-c6d8-44a7-9677-a7d4803aa50f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:10.682859 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c29312-c6d8-44a7-9677-a7d4803aa50f service glance] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:10.721081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1144/2314] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:04:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:04:10.955387 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6f6e9-aca6-4c08-b846-a7cb58a2c5ac None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:10.956084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6f6e9-aca6-4c08-b846-a7cb58a2c5ac None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:10.956294 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6f6e9-aca6-4c08-b846-a7cb58a2c5ac None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:10.958582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1171/2315] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 2 19:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:04:10.965038 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044c3b3-b312-4a45-8922-a34f0214a06b None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:10.966723 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044c3b3-b312-4a45-8922-a34f0214a06b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:10.969071 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044c3b3-b312-4a45-8922-a34f0214a06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:11.018986 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d044c3b3-b312-4a45-8922-a34f0214a06b None None] MFA Rules not processed for user `e7714d3ad1d849f5a398fc1843f22e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:11.021113 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d044c3b3-b312-4a45-8922-a34f0214a06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:11.039005 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1145/2316] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 2 19:04:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:04:11.058274 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6f6e9-aca6-4c08-b846-a7cb58a2c5ac None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:11.062710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-dbc6f6e9-aca6-4c08-b846-a7cb58a2c5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:11.096967 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6f6e9-aca6-4c08-b846-a7cb58a2c5ac None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:11.133440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff688c7-cd2e-4b41-92a7-3fe6aa7d31ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:11.134962 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff688c7-cd2e-4b41-92a7-3fe6aa7d31ad service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:11.135480 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff688c7-cd2e-4b41-92a7-3fe6aa7d31ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:11.136007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff688c7-cd2e-4b41-92a7-3fe6aa7d31ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:11.163314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff688c7-cd2e-4b41-92a7-3fe6aa7d31ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:11.166943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff688c7-cd2e-4b41-92a7-3fe6aa7d31ad service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:11.184212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1172/2317] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:04:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:04:11.547621 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140530a-b381-4b32-ab33-c416d25d8643 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:11.550308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140530a-b381-4b32-ab33-c416d25d8643 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:11.550911 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140530a-b381-4b32-ab33-c416d25d8643 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:11.552833 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1146/2318] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 2 19:04:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 19:04:11.568373 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9a7e6-c36d-4d22-b44a-ed51d9b25b74 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:11.568660 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9a7e6-c36d-4d22-b44a-ed51d9b25b74 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:11.570499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9a7e6-c36d-4d22-b44a-ed51d9b25b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:11.673875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-eba9a7e6-c36d-4d22-b44a-ed51d9b25b74 None None] MFA Rules not processed for user `6b8ff9f5032e498db3c70c79cc11989b`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:11.679713 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-eba9a7e6-c36d-4d22-b44a-ed51d9b25b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:11.743815 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1173/2319] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 2 19:04:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:04:11.857061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140530a-b381-4b32-ab33-c416d25d8643 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:11.888137 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140530a-b381-4b32-ab33-c416d25d8643 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:11.905474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8237f2d-f491-4d67-b332-be698e342d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:11.906199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8237f2d-f491-4d67-b332-be698e342d89 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:11.906410 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8237f2d-f491-4d67-b332-be698e342d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:11.911831 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8237f2d-f491-4d67-b332-be698e342d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:11.959503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8237f2d-f491-4d67-b332-be698e342d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:11.962015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8237f2d-f491-4d67-b332-be698e342d89 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:11.982653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1147/2320] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:04:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:04:13.920080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa821bc0-e44f-4a1e-b361-be41371d20fd None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:13.921255 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa821bc0-e44f-4a1e-b361-be41371d20fd None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:13.921985 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa821bc0-e44f-4a1e-b361-be41371d20fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:14.015817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-fa821bc0-e44f-4a1e-b361-be41371d20fd None None] MFA Rules not processed for user `23aa142375c54b94ad276d1a4b9031e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:14.017213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fa821bc0-e44f-4a1e-b361-be41371d20fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:14.132023 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1174/2321] 10.222.0.15 () {58 vars in 967 bytes} [Thu Jun 2 19:04:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:04:14.147808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8237f2d-f491-4d67-b332-be698e342d89 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:14.149841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f8237f2d-f491-4d67-b332-be698e342d89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:14.277245 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:14.373735 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8237f2d-f491-4d67-b332-be698e342d89 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:14.382118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f7ab2-d704-4d4f-b9e3-75cabb336af8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4faac48f82244bebf039aab92898617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:14.383067 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f7ab2-d704-4d4f-b9e3-75cabb336af8 service swift] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:14.383527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f7ab2-d704-4d4f-b9e3-75cabb336af8 service swift] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:14.383983 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f7ab2-d704-4d4f-b9e3-75cabb336af8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:14.400745 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f7ab2-d704-4d4f-b9e3-75cabb336af8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:14.403722 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f7ab2-d704-4d4f-b9e3-75cabb336af8 service swift] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:14.415753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1148/2322] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 2 19:04:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:04:15.100912 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cc8e4-a0b7-4fa3-98e1-73396582e491 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:15.101833 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cc8e4-a0b7-4fa3-98e1-73396582e491 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:15.102273 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cc8e4-a0b7-4fa3-98e1-73396582e491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:15.145649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-0b5cc8e4-a0b7-4fa3-98e1-73396582e491 None None] MFA Rules not processed for user `f54c975b432a4678a5624ad5c9f54b74`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:15.148221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-0b5cc8e4-a0b7-4fa3-98e1-73396582e491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:15.175264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:15.252895 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1175/2323] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:04:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:04:15.258078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f7ab2-d704-4d4f-b9e3-75cabb336af8 service swift] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:15.270146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f7ab2-d704-4d4f-b9e3-75cabb336af8 service swift] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:15.276223 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f59aa-2f41-438a-841b-95d55f94dc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:15.277296 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f59aa-2f41-438a-841b-95d55f94dc12 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:15.277729 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f59aa-2f41-438a-841b-95d55f94dc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:15.278218 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f59aa-2f41-438a-841b-95d55f94dc12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:15.279171 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f59aa-2f41-438a-841b-95d55f94dc12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:15.281531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f59aa-2f41-438a-841b-95d55f94dc12 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:15.330508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1149/2324] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:04:15 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:04:15.335971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cc8e4-a0b7-4fa3-98e1-73396582e491 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:15.357008 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cc8e4-a0b7-4fa3-98e1-73396582e491 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:15.463434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b3055-19f5-4a85-a43d-afefcdae600b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:15.464606 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b3055-19f5-4a85-a43d-afefcdae600b admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:15.465058 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b3055-19f5-4a85-a43d-afefcdae600b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:15.465541 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b3055-19f5-4a85-a43d-afefcdae600b admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:15.466378 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b3055-19f5-4a85-a43d-afefcdae600b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:15.468755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b3055-19f5-4a85-a43d-afefcdae600b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:15.524164 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1176/2325] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:04:15 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:04:15.525174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f59aa-2f41-438a-841b-95d55f94dc12 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:15.542665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f59aa-2f41-438a-841b-95d55f94dc12 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:15.558487 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15438311-6dd7-47c6-82f9-bbb7340a6b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:15.559271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15438311-6dd7-47c6-82f9-bbb7340a6b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:15.560866 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15438311-6dd7-47c6-82f9-bbb7340a6b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:15.560866 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15438311-6dd7-47c6-82f9-bbb7340a6b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:15.562206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15438311-6dd7-47c6-82f9-bbb7340a6b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:15.563934 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15438311-6dd7-47c6-82f9-bbb7340a6b8d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:15.582756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1150/2326] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:04:15.588069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b3055-19f5-4a85-a43d-afefcdae600b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:15.607932 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b3055-19f5-4a85-a43d-afefcdae600b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:15.630605 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b21da9-7d0e-48fc-9748-ed5b30eeda67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:15.631543 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b21da9-7d0e-48fc-9748-ed5b30eeda67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:15.632174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b21da9-7d0e-48fc-9748-ed5b30eeda67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:15.632351 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b21da9-7d0e-48fc-9748-ed5b30eeda67 admin admin] PATH_INFO: `/v3/projects/341d6e18464a4fe1ae1418470e9106cd/users/58c2326a461b43d68b950311a332c0db/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:15.676650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b21da9-7d0e-48fc-9748-ed5b30eeda67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=341d6e18464a4fe1ae1418470e9106cd, user_id=58c2326a461b43d68b950311a332c0db, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:15.681069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b21da9-7d0e-48fc-9748-ed5b30eeda67 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:15.710793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1177/2327] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:04:15 2022] PUT /identity/v3/projects/341d6e18464a4fe1ae1418470e9106cd/users/58c2326a461b43d68b950311a332c0db/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:04:15.716604 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15438311-6dd7-47c6-82f9-bbb7340a6b8d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:15.745146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15438311-6dd7-47c6-82f9-bbb7340a6b8d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:15.872694 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19ce43-4e50-4b57-a9a7-503b11b7b7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:15.873433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19ce43-4e50-4b57-a9a7-503b11b7b7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:15.873715 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19ce43-4e50-4b57-a9a7-503b11b7b7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:15.874076 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19ce43-4e50-4b57-a9a7-503b11b7b7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:15.874823 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19ce43-4e50-4b57-a9a7-503b11b7b7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:15.876950 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19ce43-4e50-4b57-a9a7-503b11b7b7f6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:15.902006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1151/2328] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:04:15.904882 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b21da9-7d0e-48fc-9748-ed5b30eeda67 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:15.942272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b21da9-7d0e-48fc-9748-ed5b30eeda67 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:15.954195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb579207-b593-4896-ab14-586efdd0f79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:15.955138 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb579207-b593-4896-ab14-586efdd0f79e admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:15.955419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb579207-b593-4896-ab14-586efdd0f79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:15.955693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb579207-b593-4896-ab14-586efdd0f79e admin admin] PATH_INFO: `/v3/projects/341d6e18464a4fe1ae1418470e9106cd/users/58c2326a461b43d68b950311a332c0db/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:15.959748 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb579207-b593-4896-ab14-586efdd0f79e admin admin] RBAC: Authorizing `identity:create_grant(project_id=341d6e18464a4fe1ae1418470e9106cd, user_id=58c2326a461b43d68b950311a332c0db, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:15.966893 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb579207-b593-4896-ab14-586efdd0f79e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:15.996045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1178/2329] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:04:15 2022] PUT /identity/v3/projects/341d6e18464a4fe1ae1418470e9106cd/users/58c2326a461b43d68b950311a332c0db/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:04:16.257825 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ac322-2869-4793-b0e1-51d53de3de73 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:16.258172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ac322-2869-4793-b0e1-51d53de3de73 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:16.258728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ac322-2869-4793-b0e1-51d53de3de73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:16.335294 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-025ac322-2869-4793-b0e1-51d53de3de73 None None] MFA Rules not processed for user `23aa142375c54b94ad276d1a4b9031e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:16.337435 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-025ac322-2869-4793-b0e1-51d53de3de73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:16.483487 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1152/2330] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 2 19:04:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:04:16.500640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb579207-b593-4896-ab14-586efdd0f79e admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:16.627914 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb579207-b593-4896-ab14-586efdd0f79e admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:16.634869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b15a2-35da-4df5-a894-255ee37c0eaf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4faac48f82244bebf039aab92898617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:16.635682 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b15a2-35da-4df5-a894-255ee37c0eaf service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:16.636133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b15a2-35da-4df5-a894-255ee37c0eaf service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:16.636528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b15a2-35da-4df5-a894-255ee37c0eaf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:16.648401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b15a2-35da-4df5-a894-255ee37c0eaf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:16.651051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b15a2-35da-4df5-a894-255ee37c0eaf service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:16.656779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:16.663597 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1179/2331] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 2 19:04:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:04:17.768320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ac322-2869-4793-b0e1-51d53de3de73 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:17.770885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-025ac322-2869-4793-b0e1-51d53de3de73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:17.889645 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:17.980938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ac322-2869-4793-b0e1-51d53de3de73 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:17.995613 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d0357-c87c-42ee-8f26-84c245068518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:18.002297 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d0357-c87c-42ee-8f26-84c245068518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:18.003217 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d0357-c87c-42ee-8f26-84c245068518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:18.004000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d0357-c87c-42ee-8f26-84c245068518 admin admin] PATH_INFO: `/v3/users/7de00142413f4f57b4782279bc826f4f` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:18.010571 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d0357-c87c-42ee-8f26-84c245068518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7de00142413f4f57b4782279bc826f4f)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:18.016504 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d0357-c87c-42ee-8f26-84c245068518 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:18.166397 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f10d0357-c87c-42ee-8f26-84c245068518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7de00142413f4f57b4782279bc826f4f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:18.168115 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f10d0357-c87c-42ee-8f26-84c245068518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7de00142413f4f57b4782279bc826f4f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:18.199802 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f10d0357-c87c-42ee-8f26-84c245068518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7de00142413f4f57b4782279bc826f4f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:18.222171 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f10d0357-c87c-42ee-8f26-84c245068518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7de00142413f4f57b4782279bc826f4f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:18.223214 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f10d0357-c87c-42ee-8f26-84c245068518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7de00142413f4f57b4782279bc826f4f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:18.270893 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1153/2332] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:04:17 2022] DELETE /identity/v3/users/7de00142413f4f57b4782279bc826f4f => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:04:18.893319 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b15a2-35da-4df5-a894-255ee37c0eaf service swift] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:18.930901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b15a2-35da-4df5-a894-255ee37c0eaf service swift] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:19.134948 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3cab3-6843-4b4b-954b-973928a209cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:19.135937 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3cab3-6843-4b4b-954b-973928a209cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:19.136279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3cab3-6843-4b4b-954b-973928a209cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:19.136628 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3cab3-6843-4b4b-954b-973928a209cb admin admin] PATH_INFO: `/v3/projects/9f56ecf8c55d4db69eaa62e872d9f169` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:19.164980 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3cab3-6843-4b4b-954b-973928a209cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f56ecf8c55d4db69eaa62e872d9f169)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:19.168036 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3cab3-6843-4b4b-954b-973928a209cb admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:19.266540 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1ae3cab3-6843-4b4b-954b-973928a209cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f56ecf8c55d4db69eaa62e872d9f169', 'request_id': 'req-1ae3cab3-6843-4b4b-954b-973928a209cb'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:19.285434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1ae3cab3-6843-4b4b-954b-973928a209cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f56ecf8c55d4db69eaa62e872d9f169', 'request_id': 'req-1ae3cab3-6843-4b4b-954b-973928a209cb'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:19.306470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1ae3cab3-6843-4b4b-954b-973928a209cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f56ecf8c55d4db69eaa62e872d9f169', 'request_id': 'req-1ae3cab3-6843-4b4b-954b-973928a209cb'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:19.329519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1ae3cab3-6843-4b4b-954b-973928a209cb admin admin] The token cache is being invalidate because project 9f56ecf8c55d4db69eaa62e872d9f169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:04:19.330096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1ae3cab3-6843-4b4b-954b-973928a209cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:19.333628 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1ae3cab3-6843-4b4b-954b-973928a209cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:19.336384 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1180/2333] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:04:18 2022] DELETE /identity/v3/projects/9f56ecf8c55d4db69eaa62e872d9f169 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:04:19.343400 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88468136-ad66-40a2-a99f-9ac7ff652355 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:19.344264 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88468136-ad66-40a2-a99f-9ac7ff652355 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:19.344264 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88468136-ad66-40a2-a99f-9ac7ff652355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:19.377538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-88468136-ad66-40a2-a99f-9ac7ff652355 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:19.398981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-88468136-ad66-40a2-a99f-9ac7ff652355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:19.675117 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1154/2334] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:04:19.678159 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdee254-c3ff-4da5-b779-249aa31daeba None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:19.680048 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdee254-c3ff-4da5-b779-249aa31daeba None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:19.680575 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdee254-c3ff-4da5-b779-249aa31daeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:19.746998 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-0cdee254-c3ff-4da5-b779-249aa31daeba None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:19.756204 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-0cdee254-c3ff-4da5-b779-249aa31daeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:19.806396 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1181/2335] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:04:19.808555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88468136-ad66-40a2-a99f-9ac7ff652355 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:19.831389 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88468136-ad66-40a2-a99f-9ac7ff652355 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:19.871467 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07bea8-42e9-4ec4-adda-761463c396b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:19.874345 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07bea8-42e9-4ec4-adda-761463c396b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:19.877164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07bea8-42e9-4ec4-adda-761463c396b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:19.877828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07bea8-42e9-4ec4-adda-761463c396b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:19.882436 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07bea8-42e9-4ec4-adda-761463c396b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:04:19.883092 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07bea8-42e9-4ec4-adda-761463c396b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:19.890155 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07bea8-42e9-4ec4-adda-761463c396b0 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:19.932220 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1155/2336] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:04:19.933898 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdee254-c3ff-4da5-b779-249aa31daeba None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:19.962700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdee254-c3ff-4da5-b779-249aa31daeba None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:19.987483 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ced245-415a-4ca3-9545-7bfc418e5a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:19.989500 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ced245-415a-4ca3-9545-7bfc418e5a14 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:19.989929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ced245-415a-4ca3-9545-7bfc418e5a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:19.992734 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ced245-415a-4ca3-9545-7bfc418e5a14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:20.003217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ced245-415a-4ca3-9545-7bfc418e5a14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:20.005973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ced245-415a-4ca3-9545-7bfc418e5a14 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:20.094082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1182/2337] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:04:19 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:04:20.094425 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07bea8-42e9-4ec4-adda-761463c396b0 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:20.140329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07bea8-42e9-4ec4-adda-761463c396b0 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:20.304146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:20.387269 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5c5b8-1ef3-4de4-8a21-6bdb798016b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:20.388634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5c5b8-1ef3-4de4-8a21-6bdb798016b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:20.388634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5c5b8-1ef3-4de4-8a21-6bdb798016b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:20.388634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5c5b8-1ef3-4de4-8a21-6bdb798016b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:20.389343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5c5b8-1ef3-4de4-8a21-6bdb798016b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:20.391366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5c5b8-1ef3-4de4-8a21-6bdb798016b2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:20.456193 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1156/2338] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:04:20 2022] POST /identity/v3/users => generated 288 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:04:20.462120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ced245-415a-4ca3-9545-7bfc418e5a14 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:20.482961 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ced245-415a-4ca3-9545-7bfc418e5a14 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:20.510782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f28058-c7bc-4d2a-b516-ea4139a2f8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:20.511187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f28058-c7bc-4d2a-b516-ea4139a2f8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:20.511449 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f28058-c7bc-4d2a-b516-ea4139a2f8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:20.511719 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f28058-c7bc-4d2a-b516-ea4139a2f8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:20.512464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f28058-c7bc-4d2a-b516-ea4139a2f8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:20.519457 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f28058-c7bc-4d2a-b516-ea4139a2f8d8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:20.545527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1183/2339] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:04:20.550010 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5c5b8-1ef3-4de4-8a21-6bdb798016b2 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:20.573847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5c5b8-1ef3-4de4-8a21-6bdb798016b2 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:20.592103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43941aa0-9afc-41b8-813e-ab55353cd1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:20.592970 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43941aa0-9afc-41b8-813e-ab55353cd1fa admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:20.593226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43941aa0-9afc-41b8-813e-ab55353cd1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:20.593671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43941aa0-9afc-41b8-813e-ab55353cd1fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:20.594735 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43941aa0-9afc-41b8-813e-ab55353cd1fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:20.597249 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43941aa0-9afc-41b8-813e-ab55353cd1fa admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:20.637861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1157/2340] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:04:20.642500 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f28058-c7bc-4d2a-b516-ea4139a2f8d8 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:20.658480 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f28058-c7bc-4d2a-b516-ea4139a2f8d8 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:20.675837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b41fc-890d-453b-9387-86013bfed64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:20.676862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b41fc-890d-453b-9387-86013bfed64a admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:20.677379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b41fc-890d-453b-9387-86013bfed64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:20.677927 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b41fc-890d-453b-9387-86013bfed64a admin admin] PATH_INFO: `/v3/projects/87cda34c43c54957967898f6c8bd9e91/users/9271f3745f2140eb8ca13a43d2248d77/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:20.736135 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b41fc-890d-453b-9387-86013bfed64a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87cda34c43c54957967898f6c8bd9e91, user_id=9271f3745f2140eb8ca13a43d2248d77, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:20.744230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b41fc-890d-453b-9387-86013bfed64a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:20.784232 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1184/2341] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:04:20 2022] PUT /identity/v3/projects/87cda34c43c54957967898f6c8bd9e91/users/9271f3745f2140eb8ca13a43d2248d77/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:04:20.794670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60069c2e-ab0d-458d-bc2e-049044f701b4 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:20.795068 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60069c2e-ab0d-458d-bc2e-049044f701b4 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:20.795424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60069c2e-ab0d-458d-bc2e-049044f701b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:20.873553 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-60069c2e-ab0d-458d-bc2e-049044f701b4 None None] MFA Rules not processed for user `9271f3745f2140eb8ca13a43d2248d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:20.879127 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-60069c2e-ab0d-458d-bc2e-049044f701b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:21.140432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1158/2342] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:04:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:04:21.161043 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b41fc-890d-453b-9387-86013bfed64a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:21.163967 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-127b41fc-890d-453b-9387-86013bfed64a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:21.285447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:21.477694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b41fc-890d-453b-9387-86013bfed64a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:21.526782 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b2e9a-1e36-4eab-8fc4-1ab260fa732c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:21.528120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b2e9a-1e36-4eab-8fc4-1ab260fa732c service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:21.529497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b2e9a-1e36-4eab-8fc4-1ab260fa732c service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:21.529786 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b2e9a-1e36-4eab-8fc4-1ab260fa732c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:21.559460 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b2e9a-1e36-4eab-8fc4-1ab260fa732c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:21.561862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b2e9a-1e36-4eab-8fc4-1ab260fa732c service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:21.604962 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1185/2343] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:04:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:04:27.879030 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9a0d1-0ff5-4579-a8c4-e72d8664cda1 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:27.879571 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9a0d1-0ff5-4579-a8c4-e72d8664cda1 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:27.879571 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9a0d1-0ff5-4579-a8c4-e72d8664cda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:27.944700 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-dbd9a0d1-0ff5-4579-a8c4-e72d8664cda1 None None] MFA Rules not processed for user `58c2326a461b43d68b950311a332c0db`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:27.945671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-dbd9a0d1-0ff5-4579-a8c4-e72d8664cda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:28.089519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1159/2344] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:04:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:04:28.103131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b2e9a-1e36-4eab-8fc4-1ab260fa732c service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:28.106259 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ee0b2e9a-1e36-4eab-8fc4-1ab260fa732c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:28.253321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b2e9a-1e36-4eab-8fc4-1ab260fa732c service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:28.267990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cffe9-d6a3-47f6-a6ea-a29327c2c265 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:28.272678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cffe9-d6a3-47f6-a6ea-a29327c2c265 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:28.273043 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cffe9-d6a3-47f6-a6ea-a29327c2c265 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:28.273597 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cffe9-d6a3-47f6-a6ea-a29327c2c265 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:28.289897 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-542cffe9-d6a3-47f6-a6ea-a29327c2c265 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:28.435690 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cffe9-d6a3-47f6-a6ea-a29327c2c265 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:28.437464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cffe9-d6a3-47f6-a6ea-a29327c2c265 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:28.466491 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1186/2345] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:04:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:04:32.844647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9a0d1-0ff5-4579-a8c4-e72d8664cda1 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:32.846246 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-dbd9a0d1-0ff5-4579-a8c4-e72d8664cda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:32.886086 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:32.972003 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9a0d1-0ff5-4579-a8c4-e72d8664cda1 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:32.977723 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125003c-8f99-421f-919d-448f06d82f53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:32.978457 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125003c-8f99-421f-919d-448f06d82f53 service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:32.978774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125003c-8f99-421f-919d-448f06d82f53 service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:32.979065 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125003c-8f99-421f-919d-448f06d82f53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:32.981565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e125003c-8f99-421f-919d-448f06d82f53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:32.997201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125003c-8f99-421f-919d-448f06d82f53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:32.999054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125003c-8f99-421f-919d-448f06d82f53 service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:33.011872 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1160/2346] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:04:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:04:34.903421 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cffe9-d6a3-47f6-a6ea-a29327c2c265 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:34.996787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cffe9-d6a3-47f6-a6ea-a29327c2c265 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:35.001508 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b8cd7-c6f2-45a0-8cb8-4be6eef6beaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:35.002468 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b8cd7-c6f2-45a0-8cb8-4be6eef6beaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:35.002753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b8cd7-c6f2-45a0-8cb8-4be6eef6beaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:35.003029 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b8cd7-c6f2-45a0-8cb8-4be6eef6beaf admin admin] PATH_INFO: `/v3/users/9271f3745f2140eb8ca13a43d2248d77` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:35.004426 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b8cd7-c6f2-45a0-8cb8-4be6eef6beaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9271f3745f2140eb8ca13a43d2248d77)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:35.006566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b8cd7-c6f2-45a0-8cb8-4be6eef6beaf admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:35.019068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:35.069502 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c00b8cd7-c6f2-45a0-8cb8-4be6eef6beaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9271f3745f2140eb8ca13a43d2248d77'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:35.070240 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c00b8cd7-c6f2-45a0-8cb8-4be6eef6beaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9271f3745f2140eb8ca13a43d2248d77'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:35.080443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c00b8cd7-c6f2-45a0-8cb8-4be6eef6beaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9271f3745f2140eb8ca13a43d2248d77'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:35.091494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c00b8cd7-c6f2-45a0-8cb8-4be6eef6beaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9271f3745f2140eb8ca13a43d2248d77'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:35.102140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c00b8cd7-c6f2-45a0-8cb8-4be6eef6beaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9271f3745f2140eb8ca13a43d2248d77'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:35.142896 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1187/2347] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:04:34 2022] DELETE /identity/v3/users/9271f3745f2140eb8ca13a43d2248d77 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:04:35.144459 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b7760-5e8c-4011-9976-26d2276abf14 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:35.144459 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b7760-5e8c-4011-9976-26d2276abf14 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:35.144459 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b7760-5e8c-4011-9976-26d2276abf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:35.164842 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d29b7760-5e8c-4011-9976-26d2276abf14 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:35.166256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d29b7760-5e8c-4011-9976-26d2276abf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:35.246918 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1161/2348] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:04:35.265051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b8cd7-c6f2-45a0-8cb8-4be6eef6beaf admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:35.266384 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c00b8cd7-c6f2-45a0-8cb8-4be6eef6beaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:35.348978 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b8cd7-c6f2-45a0-8cb8-4be6eef6beaf admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:35.353145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca8fbb-2f8e-4605-b8b2-355cf1c391ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:35.353835 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca8fbb-2f8e-4605-b8b2-355cf1c391ec service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:35.354120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca8fbb-2f8e-4605-b8b2-355cf1c391ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:35.354396 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca8fbb-2f8e-4605-b8b2-355cf1c391ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:35.375467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca8fbb-2f8e-4605-b8b2-355cf1c391ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:35.377688 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca8fbb-2f8e-4605-b8b2-355cf1c391ec service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:35.401359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1188/2349] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:04:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:04:35.780903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b7760-5e8c-4011-9976-26d2276abf14 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:35.782426 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d29b7760-5e8c-4011-9976-26d2276abf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:35.797318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b7760-5e8c-4011-9976-26d2276abf14 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:35.806262 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69b542-391e-44f5-af88-f4b8253961b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:35.808704 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69b542-391e-44f5-af88-f4b8253961b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:35.809159 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69b542-391e-44f5-af88-f4b8253961b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:35.809562 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69b542-391e-44f5-af88-f4b8253961b6 admin admin] PATH_INFO: `/v3/projects/87cda34c43c54957967898f6c8bd9e91` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:35.812142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69b542-391e-44f5-af88-f4b8253961b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87cda34c43c54957967898f6c8bd9e91)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:35.815663 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69b542-391e-44f5-af88-f4b8253961b6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:35.876217 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-fd69b542-391e-44f5-af88-f4b8253961b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87cda34c43c54957967898f6c8bd9e91', 'request_id': 'req-fd69b542-391e-44f5-af88-f4b8253961b6'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:35.882885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-fd69b542-391e-44f5-af88-f4b8253961b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87cda34c43c54957967898f6c8bd9e91', 'request_id': 'req-fd69b542-391e-44f5-af88-f4b8253961b6'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:35.893880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-fd69b542-391e-44f5-af88-f4b8253961b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87cda34c43c54957967898f6c8bd9e91', 'request_id': 'req-fd69b542-391e-44f5-af88-f4b8253961b6'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:35.906558 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-fd69b542-391e-44f5-af88-f4b8253961b6 admin admin] The token cache is being invalidate because project 87cda34c43c54957967898f6c8bd9e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:04:35.906905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-fd69b542-391e-44f5-af88-f4b8253961b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:35.907493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-fd69b542-391e-44f5-af88-f4b8253961b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:04:35.909116 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1162/2350] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:04:35 2022] DELETE /identity/v3/projects/87cda34c43c54957967898f6c8bd9e91 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:04:43.615796 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031fb49-b52f-4921-a5d3-2a1ac09bf17e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:43.616362 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031fb49-b52f-4921-a5d3-2a1ac09bf17e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:43.616623 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031fb49-b52f-4921-a5d3-2a1ac09bf17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:43.635413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e031fb49-b52f-4921-a5d3-2a1ac09bf17e None None] MFA Rules not processed for user `4eda4b85484844ab8b424a1a42a97704`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:43.636773 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e031fb49-b52f-4921-a5d3-2a1ac09bf17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:43.700562 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1189/2351] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:04:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:04:45.902652 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:46.603597 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ad7de-202e-4c67-aba9-12f79f9c0e9f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:46.603887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ad7de-202e-4c67-aba9-12f79f9c0e9f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:46.604189 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ad7de-202e-4c67-aba9-12f79f9c0e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:46.640091 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-883ad7de-202e-4c67-aba9-12f79f9c0e9f None None] MFA Rules not processed for user `23aa142375c54b94ad276d1a4b9031e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:46.641308 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-883ad7de-202e-4c67-aba9-12f79f9c0e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:46.721131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1163/2352] 10.222.0.15 () {58 vars in 967 bytes} [Thu Jun 2 19:04:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:04:46.736317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031fb49-b52f-4921-a5d3-2a1ac09bf17e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:04:46.738012 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e031fb49-b52f-4921-a5d3-2a1ac09bf17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:46.790161 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:04:46.828923 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031fb49-b52f-4921-a5d3-2a1ac09bf17e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:04:46.834397 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf5388-f053-466f-a51e-bf2a33562b7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4faac48f82244bebf039aab92898617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:04:46.835064 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf5388-f053-466f-a51e-bf2a33562b7e service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:46.835344 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf5388-f053-466f-a51e-bf2a33562b7e service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:46.835617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf5388-f053-466f-a51e-bf2a33562b7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:46.844758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf5388-f053-466f-a51e-bf2a33562b7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:04:46.847604 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf5388-f053-466f-a51e-bf2a33562b7e service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:04:46.855461 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1190/2353] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 2 19:04:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:04:55.684343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d57e0-a5fd-49c0-8615-3a4cca82b489 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:04:55.684968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d57e0-a5fd-49c0-8615-3a4cca82b489 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:04:55.684968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d57e0-a5fd-49c0-8615-3a4cca82b489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:04:55.704939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a79d57e0-a5fd-49c0-8615-3a4cca82b489 None None] MFA Rules not processed for user `f54c975b432a4678a5624ad5c9f54b74`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:04:55.706205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a79d57e0-a5fd-49c0-8615-3a4cca82b489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:04:55.768546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1164/2354] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:04:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:04:56.851727 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=17 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:05.760984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=50 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:16.087891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218efb7c-1b20-4694-91da-80e63ba0039d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:05:16.089076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218efb7c-1b20-4694-91da-80e63ba0039d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:05:16.089322 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218efb7c-1b20-4694-91da-80e63ba0039d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:05:16.133656 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-218efb7c-1b20-4694-91da-80e63ba0039d None None] MFA Rules not processed for user `5c5875c5cba841a28560a475bb18d595`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:05:16.135688 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-218efb7c-1b20-4694-91da-80e63ba0039d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:05:16.258793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1191/2355] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:05:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:05:20.346377 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d57e0-a5fd-49c0-8615-3a4cca82b489 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:05:20.347961 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a79d57e0-a5fd-49c0-8615-3a4cca82b489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:05:20.416793 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d57e0-a5fd-49c0-8615-3a4cca82b489 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:05:20.423332 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b8c57-c394-42c7-aabf-4274e3dc7486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:05:20.424006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b8c57-c394-42c7-aabf-4274e3dc7486 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:05:20.424386 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b8c57-c394-42c7-aabf-4274e3dc7486 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:05:20.424862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b8c57-c394-42c7-aabf-4274e3dc7486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:05:20.426841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-fd3b8c57-c394-42c7-aabf-4274e3dc7486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:05:20.505944 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b8c57-c394-42c7-aabf-4274e3dc7486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:05:20.507418 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b8c57-c394-42c7-aabf-4274e3dc7486 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:05:20.519257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1165/2356] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:05:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:05:26.246147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=25 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:28.911981 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bcb35-0bdb-4339-9080-412665273dc9 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:05:28.912667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bcb35-0bdb-4339-9080-412665273dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:05:28.912667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bcb35-0bdb-4339-9080-412665273dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:05:28.936401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-509bcb35-0bdb-4339-9080-412665273dc9 None None] MFA Rules not processed for user `4a660a47927140d6b4d0543de5e281a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:05:28.937597 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-509bcb35-0bdb-4339-9080-412665273dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:05:29.001846 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1192/2357] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:05:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:05:30.514323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=50 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:05:38.992380 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=25 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:30.038772 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b8c57-c394-42c7-aabf-4274e3dc7486 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:30.040969 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-fd3b8c57-c394-42c7-aabf-4274e3dc7486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:06:30.126126 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b8c57-c394-42c7-aabf-4274e3dc7486 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:30.133028 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e3676-0ff9-4a18-85b4-5a10a3e3cc0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:30.133694 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e3676-0ff9-4a18-85b4-5a10a3e3cc0e service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:30.134005 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e3676-0ff9-4a18-85b4-5a10a3e3cc0e service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:30.134316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e3676-0ff9-4a18-85b4-5a10a3e3cc0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:30.136288 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-348e3676-0ff9-4a18-85b4-5a10a3e3cc0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:06:30.204999 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e3676-0ff9-4a18-85b4-5a10a3e3cc0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:30.206803 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e3676-0ff9-4a18-85b4-5a10a3e3cc0e service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:30.217579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1166/2358] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:06:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:06:40.219278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=56 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:06:40.472099 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bcb35-0bdb-4339-9080-412665273dc9 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:06:40.474755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-509bcb35-0bdb-4339-9080-412665273dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:06:40.549241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bcb35-0bdb-4339-9080-412665273dc9 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:06:40.553182 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41098c-f156-4bd5-9aff-69e30e7f0880 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:06:40.553837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41098c-f156-4bd5-9aff-69e30e7f0880 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:06:40.554143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41098c-f156-4bd5-9aff-69e30e7f0880 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:06:40.554410 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41098c-f156-4bd5-9aff-69e30e7f0880 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:06:40.557005 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-af41098c-f156-4bd5-9aff-69e30e7f0880 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:06:40.573223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41098c-f156-4bd5-9aff-69e30e7f0880 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:06:40.574680 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41098c-f156-4bd5-9aff-69e30e7f0880 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:06:40.584605 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1193/2359] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:06:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:06:50.579933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=26 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:20.846852 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e3676-0ff9-4a18-85b4-5a10a3e3cc0e service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:07:20.848533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-348e3676-0ff9-4a18-85b4-5a10a3e3cc0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:07:20.861762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e3676-0ff9-4a18-85b4-5a10a3e3cc0e service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:07:20.866453 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97aac5-4643-4f7c-9578-3e6fbf96b748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:07:20.867119 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97aac5-4643-4f7c-9578-3e6fbf96b748 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:07:20.867403 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97aac5-4643-4f7c-9578-3e6fbf96b748 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:07:20.867671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97aac5-4643-4f7c-9578-3e6fbf96b748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:07:20.869900 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3f97aac5-4643-4f7c-9578-3e6fbf96b748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:07:20.881017 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97aac5-4643-4f7c-9578-3e6fbf96b748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:07:20.882519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97aac5-4643-4f7c-9578-3e6fbf96b748 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:07:20.891219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1167/2360] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:07:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:07:30.887483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:30.990174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41098c-f156-4bd5-9aff-69e30e7f0880 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:07:31.001064 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41098c-f156-4bd5-9aff-69e30e7f0880 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:07:31.005604 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce58003-004d-45e9-962c-a2c9fdb7b5c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:07:31.006300 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce58003-004d-45e9-962c-a2c9fdb7b5c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:07:31.006583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce58003-004d-45e9-962c-a2c9fdb7b5c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:07:31.006861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce58003-004d-45e9-962c-a2c9fdb7b5c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:07:31.008800 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-0ce58003-004d-45e9-962c-a2c9fdb7b5c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:07:31.024459 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce58003-004d-45e9-962c-a2c9fdb7b5c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:07:31.026036 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce58003-004d-45e9-962c-a2c9fdb7b5c0 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:07:31.037516 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1194/2361] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:07:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:07:32.214836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97aac5-4643-4f7c-9578-3e6fbf96b748 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:07:32.228766 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97aac5-4643-4f7c-9578-3e6fbf96b748 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:07:32.233490 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a3e85-3c5c-43fe-b41b-2274c1694ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:07:32.234172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a3e85-3c5c-43fe-b41b-2274c1694ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:07:32.234427 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a3e85-3c5c-43fe-b41b-2274c1694ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:07:32.234727 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a3e85-3c5c-43fe-b41b-2274c1694ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:07:32.236770 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-597a3e85-3c5c-43fe-b41b-2274c1694ee4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:07:32.251565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a3e85-3c5c-43fe-b41b-2274c1694ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:07:32.253061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a3e85-3c5c-43fe-b41b-2274c1694ee4 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:07:32.265457 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1168/2362] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:07:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:07:33.710579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce58003-004d-45e9-962c-a2c9fdb7b5c0 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:07:33.712219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-0ce58003-004d-45e9-962c-a2c9fdb7b5c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:07:33.734113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce58003-004d-45e9-962c-a2c9fdb7b5c0 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:07:33.746918 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2257a-fb69-4b0f-be16-ac96cad80246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:07:33.747908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2257a-fb69-4b0f-be16-ac96cad80246 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:07:33.748366 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2257a-fb69-4b0f-be16-ac96cad80246 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:07:33.748975 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2257a-fb69-4b0f-be16-ac96cad80246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:07:33.752192 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-cbb2257a-fb69-4b0f-be16-ac96cad80246 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:07:33.771068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2257a-fb69-4b0f-be16-ac96cad80246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:07:33.773336 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2257a-fb69-4b0f-be16-ac96cad80246 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:07:33.790529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1195/2363] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:07:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:07:42.260321 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:43.781484 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=12 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:07:44.669213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a3e85-3c5c-43fe-b41b-2274c1694ee4 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:07:44.671833 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-597a3e85-3c5c-43fe-b41b-2274c1694ee4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:07:44.690323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a3e85-3c5c-43fe-b41b-2274c1694ee4 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:07:44.694179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ea659-edb5-4acc-add1-4c54a8f42078 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:07:44.694829 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ea659-edb5-4acc-add1-4c54a8f42078 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:07:44.695113 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ea659-edb5-4acc-add1-4c54a8f42078 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:07:44.695388 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ea659-edb5-4acc-add1-4c54a8f42078 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:07:44.697900 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-925ea659-edb5-4acc-add1-4c54a8f42078 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:07:44.709377 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ea659-edb5-4acc-add1-4c54a8f42078 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:07:44.710869 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ea659-edb5-4acc-add1-4c54a8f42078 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:07:44.720333 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1169/2364] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:07:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:07:54.715879 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:08:00.392401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2257a-fb69-4b0f-be16-ac96cad80246 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:08:00.410042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2257a-fb69-4b0f-be16-ac96cad80246 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:08:00.417186 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc908d-a405-458b-a24b-2d814fad5810 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:08:00.417956 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc908d-a405-458b-a24b-2d814fad5810 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:08:00.418233 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc908d-a405-458b-a24b-2d814fad5810 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:08:00.418499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc908d-a405-458b-a24b-2d814fad5810 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:08:00.420650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a4fc908d-a405-458b-a24b-2d814fad5810 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:08:00.482825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc908d-a405-458b-a24b-2d814fad5810 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:08:00.484501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc908d-a405-458b-a24b-2d814fad5810 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:08:00.494244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1196/2365] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:08:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:08:10.490192 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=28 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:09:27.894180 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ea659-edb5-4acc-add1-4c54a8f42078 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:09:27.909978 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ea659-edb5-4acc-add1-4c54a8f42078 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:09:27.916771 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1a031-9fc7-4eae-8dc8-e0a7df2facb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:09:27.917411 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1a031-9fc7-4eae-8dc8-e0a7df2facb2 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:09:27.917696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1a031-9fc7-4eae-8dc8-e0a7df2facb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:09:27.918006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1a031-9fc7-4eae-8dc8-e0a7df2facb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:09:27.919902 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ffc1a031-9fc7-4eae-8dc8-e0a7df2facb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:09:27.931277 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1a031-9fc7-4eae-8dc8-e0a7df2facb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:09:27.932886 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1a031-9fc7-4eae-8dc8-e0a7df2facb2 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:09:27.942070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1170/2366] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:09:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:09:33.849969 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc908d-a405-458b-a24b-2d814fad5810 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:09:33.860991 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc908d-a405-458b-a24b-2d814fad5810 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:09:33.865109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2598025-290f-4860-a6f0-6f5350ee01b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:09:33.865762 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2598025-290f-4860-a6f0-6f5350ee01b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:09:33.866078 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2598025-290f-4860-a6f0-6f5350ee01b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:09:33.866377 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2598025-290f-4860-a6f0-6f5350ee01b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:09:33.868594 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d2598025-290f-4860-a6f0-6f5350ee01b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:09:33.880772 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2598025-290f-4860-a6f0-6f5350ee01b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:09:33.882240 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2598025-290f-4860-a6f0-6f5350ee01b4 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:09:33.891310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1197/2367] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:09:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:09:37.937877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:09:43.887330 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=6 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:10:31.162637 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1a031-9fc7-4eae-8dc8-e0a7df2facb2 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:10:31.164451 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ffc1a031-9fc7-4eae-8dc8-e0a7df2facb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:10:31.240476 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1a031-9fc7-4eae-8dc8-e0a7df2facb2 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:10:31.245884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f72f0-6dd8-4c84-b41d-cfeaf2b64fe5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:10:31.246544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f72f0-6dd8-4c84-b41d-cfeaf2b64fe5 service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:10:31.246823 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f72f0-6dd8-4c84-b41d-cfeaf2b64fe5 service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:10:31.247213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f72f0-6dd8-4c84-b41d-cfeaf2b64fe5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:10:31.248973 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a43f72f0-6dd8-4c84-b41d-cfeaf2b64fe5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:10:31.261280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f72f0-6dd8-4c84-b41d-cfeaf2b64fe5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:10:31.263035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f72f0-6dd8-4c84-b41d-cfeaf2b64fe5 service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:10:31.273847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1171/2368] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:10:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:10:41.269555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=32 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:11:30.700876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2598025-290f-4860-a6f0-6f5350ee01b4 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:11:30.715048 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2598025-290f-4860-a6f0-6f5350ee01b4 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:11:30.721985 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be522eb-79cf-4ea1-bc08-f38a41d242db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:11:30.722625 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be522eb-79cf-4ea1-bc08-f38a41d242db service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:11:30.722905 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be522eb-79cf-4ea1-bc08-f38a41d242db service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:11:30.723179 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be522eb-79cf-4ea1-bc08-f38a41d242db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:11:30.731960 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be522eb-79cf-4ea1-bc08-f38a41d242db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:11:30.733615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be522eb-79cf-4ea1-bc08-f38a41d242db service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:11:30.764174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1198/2369] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:11:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:11:40.761415 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=13 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:11:45.072883 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f72f0-6dd8-4c84-b41d-cfeaf2b64fe5 service placement] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:11:45.082494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f72f0-6dd8-4c84-b41d-cfeaf2b64fe5 service placement] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:11:45.086246 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91d855-b879-4c90-9ee4-697c1449a510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:11:45.086887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91d855-b879-4c90-9ee4-697c1449a510 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:11:45.087167 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91d855-b879-4c90-9ee4-697c1449a510 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:11:45.087440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91d855-b879-4c90-9ee4-697c1449a510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:11:45.096357 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91d855-b879-4c90-9ee4-697c1449a510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:11:45.097842 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91d855-b879-4c90-9ee4-697c1449a510 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:11:45.127828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1172/2370] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:11:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:11:55.125046 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=13 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:12:20.898173 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be522eb-79cf-4ea1-bc08-f38a41d242db service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:12:20.909091 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be522eb-79cf-4ea1-bc08-f38a41d242db service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:12:20.913618 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8d6f8-fcc4-487a-a57e-f27b0f51f64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:12:20.914305 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8d6f8-fcc4-487a-a57e-f27b0f51f64e service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:12:20.914585 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8d6f8-fcc4-487a-a57e-f27b0f51f64e service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:12:20.914861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8d6f8-fcc4-487a-a57e-f27b0f51f64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:12:20.923430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8d6f8-fcc4-487a-a57e-f27b0f51f64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:12:20.924943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8d6f8-fcc4-487a-a57e-f27b0f51f64e service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:12:20.933919 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1199/2371] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:12:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:12:30.929989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=6 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:13:34.321564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91d855-b879-4c90-9ee4-697c1449a510 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:13:34.347590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91d855-b879-4c90-9ee4-697c1449a510 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:13:34.351768 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf691223-268b-41d2-a447-690e199345db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:13:34.352420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf691223-268b-41d2-a447-690e199345db service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:13:34.352709 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf691223-268b-41d2-a447-690e199345db service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:13:34.352983 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf691223-268b-41d2-a447-690e199345db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:13:34.394464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf691223-268b-41d2-a447-690e199345db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:13:34.397395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf691223-268b-41d2-a447-690e199345db service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:13:34.411869 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1173/2372] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:13:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:13:34.469620 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8d6f8-fcc4-487a-a57e-f27b0f51f64e service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:13:34.491829 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8d6f8-fcc4-487a-a57e-f27b0f51f64e service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:13:34.496002 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a6486-0ea1-46bb-9b63-2856267e92aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:13:34.497119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a6486-0ea1-46bb-9b63-2856267e92aa service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:13:34.497420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a6486-0ea1-46bb-9b63-2856267e92aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:13:34.497689 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a6486-0ea1-46bb-9b63-2856267e92aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:13:34.507279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a6486-0ea1-46bb-9b63-2856267e92aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:13:34.508726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a6486-0ea1-46bb-9b63-2856267e92aa service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:13:34.537533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1200/2373] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:13:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:13:34.668551 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf691223-268b-41d2-a447-690e199345db service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:13:34.678052 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf691223-268b-41d2-a447-690e199345db service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:13:34.682786 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbe8c3-76ff-46de-ac37-ee3dfa890567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:13:34.683426 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbe8c3-76ff-46de-ac37-ee3dfa890567 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:13:34.683701 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbe8c3-76ff-46de-ac37-ee3dfa890567 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:13:34.683954 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbe8c3-76ff-46de-ac37-ee3dfa890567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:13:34.697048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbe8c3-76ff-46de-ac37-ee3dfa890567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:13:34.698490 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbe8c3-76ff-46de-ac37-ee3dfa890567 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:13:34.709899 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1174/2374] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:13:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:13:34.717319 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a6486-0ea1-46bb-9b63-2856267e92aa service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:13:34.727249 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a6486-0ea1-46bb-9b63-2856267e92aa service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:13:34.732732 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fec881-5d12-4558-858b-474d0581c396 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:13:34.733381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fec881-5d12-4558-858b-474d0581c396 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:13:34.733658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fec881-5d12-4558-858b-474d0581c396 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:13:34.733967 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fec881-5d12-4558-858b-474d0581c396 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:13:34.743836 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fec881-5d12-4558-858b-474d0581c396 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:13:34.745278 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fec881-5d12-4558-858b-474d0581c396 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:13:34.775629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1201/2375] 10.222.0.15 () {60 vars in 1396 bytes} [Thu Jun 2 19:13:34 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3248 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:13:44.704975 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=26 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:13:44.772625 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=31 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:15:34.996823 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbe8c3-76ff-46de-ac37-ee3dfa890567 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:35.024993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbe8c3-76ff-46de-ac37-ee3dfa890567 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:35.029142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d97de-75f2-4b04-a8d0-3fb3e6e9c3c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:35.029840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d97de-75f2-4b04-a8d0-3fb3e6e9c3c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:35.030117 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d97de-75f2-4b04-a8d0-3fb3e6e9c3c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:35.030385 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d97de-75f2-4b04-a8d0-3fb3e6e9c3c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:35.105948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d97de-75f2-4b04-a8d0-3fb3e6e9c3c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:35.107595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d97de-75f2-4b04-a8d0-3fb3e6e9c3c4 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:35.129578 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1175/2376] 10.222.0.15 () {60 vars in 1396 bytes} [Thu Jun 2 19:15:34 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3248 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:35.308398 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fec881-5d12-4558-858b-474d0581c396 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:35.330880 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fec881-5d12-4558-858b-474d0581c396 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:35.336990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95500f89-659f-4ef2-aa67-40dbef9a028c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:35.338044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95500f89-659f-4ef2-aa67-40dbef9a028c service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:35.338272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95500f89-659f-4ef2-aa67-40dbef9a028c service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:35.338712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95500f89-659f-4ef2-aa67-40dbef9a028c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:35.414534 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95500f89-659f-4ef2-aa67-40dbef9a028c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:35.415996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95500f89-659f-4ef2-aa67-40dbef9a028c service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:35.435415 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1202/2377] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:37.111777 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d97de-75f2-4b04-a8d0-3fb3e6e9c3c4 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:15:37.113460 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1f7d97de-75f2-4b04-a8d0-3fb3e6e9c3c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:15:37.169771 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d97de-75f2-4b04-a8d0-3fb3e6e9c3c4 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:15:37.176088 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277e8d6-ad71-487f-9e70-67733da8bab6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:15:37.176743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277e8d6-ad71-487f-9e70-67733da8bab6 service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:15:37.177022 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277e8d6-ad71-487f-9e70-67733da8bab6 service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:15:37.177284 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277e8d6-ad71-487f-9e70-67733da8bab6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:15:37.186192 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277e8d6-ad71-487f-9e70-67733da8bab6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:15:37.187896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277e8d6-ad71-487f-9e70-67733da8bab6 service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:15:37.197981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1176/2378] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:15:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:15:45.432599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=40 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:15:47.193505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=62 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:17:26.441556 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95500f89-659f-4ef2-aa67-40dbef9a028c service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:17:26.444468 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-95500f89-659f-4ef2-aa67-40dbef9a028c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:17:26.540464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95500f89-659f-4ef2-aa67-40dbef9a028c service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:17:26.544844 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef29e73-2736-4445-b6f6-b746f94f33ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:17:26.545495 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef29e73-2736-4445-b6f6-b746f94f33ac service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:26.545772 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef29e73-2736-4445-b6f6-b746f94f33ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:26.546070 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef29e73-2736-4445-b6f6-b746f94f33ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:26.548186 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9ef29e73-2736-4445-b6f6-b746f94f33ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:17:26.563122 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef29e73-2736-4445-b6f6-b746f94f33ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:17:26.565085 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef29e73-2736-4445-b6f6-b746f94f33ac service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:17:26.573717 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1203/2379] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:17:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:17:35.523394 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277e8d6-ad71-487f-9e70-67733da8bab6 service placement] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:17:35.528090 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2277e8d6-ad71-487f-9e70-67733da8bab6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:17:35.592838 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef29e73-2736-4445-b6f6-b746f94f33ac service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:17:35.594715 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9ef29e73-2736-4445-b6f6-b746f94f33ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:17:35.649432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277e8d6-ad71-487f-9e70-67733da8bab6 service placement] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:17:35.655138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f206a-c4b5-4407-8066-bc759af55279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:17:35.655883 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f206a-c4b5-4407-8066-bc759af55279 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:35.656164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f206a-c4b5-4407-8066-bc759af55279 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:35.656437 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f206a-c4b5-4407-8066-bc759af55279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:35.658577 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-bd3f206a-c4b5-4407-8066-bc759af55279 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:17:35.671320 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef29e73-2736-4445-b6f6-b746f94f33ac service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:17:35.675164 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338f2e1-5107-4ba2-9cdb-be6463f958c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:17:35.675858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338f2e1-5107-4ba2-9cdb-be6463f958c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:35.676186 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338f2e1-5107-4ba2-9cdb-be6463f958c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:35.676465 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338f2e1-5107-4ba2-9cdb-be6463f958c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:35.678450 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8338f2e1-5107-4ba2-9cdb-be6463f958c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:17:35.735813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f206a-c4b5-4407-8066-bc759af55279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:17:35.737485 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f206a-c4b5-4407-8066-bc759af55279 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:17:35.747288 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1177/2380] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:17:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:17:35.756440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338f2e1-5107-4ba2-9cdb-be6463f958c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:17:35.757937 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338f2e1-5107-4ba2-9cdb-be6463f958c0 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:17:35.767935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1204/2381] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:17:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:17:35.961528 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f206a-c4b5-4407-8066-bc759af55279 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:17:35.972586 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f206a-c4b5-4407-8066-bc759af55279 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:17:35.978685 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba9ae7-2c18-4358-b5af-9ff356a0a229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:17:35.979643 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba9ae7-2c18-4358-b5af-9ff356a0a229 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:35.979974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba9ae7-2c18-4358-b5af-9ff356a0a229 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:35.980257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba9ae7-2c18-4358-b5af-9ff356a0a229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:35.982329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-bcba9ae7-2c18-4358-b5af-9ff356a0a229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:17:35.996375 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba9ae7-2c18-4358-b5af-9ff356a0a229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:17:35.998056 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba9ae7-2c18-4358-b5af-9ff356a0a229 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:17:36.010025 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1178/2382] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:17:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:17:39.252119 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c3ea0-0d0d-4e71-842f-e66ae7142e39 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:39.252696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c3ea0-0d0d-4e71-842f-e66ae7142e39 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:39.252696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c3ea0-0d0d-4e71-842f-e66ae7142e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:39.282595 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c34c3ea0-0d0d-4e71-842f-e66ae7142e39 None None] MFA Rules not processed for user `4a660a47927140d6b4d0543de5e281a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:17:39.284087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c34c3ea0-0d0d-4e71-842f-e66ae7142e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:17:39.293866 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1205/2383] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:17:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:17:39.627654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba9ae7-2c18-4358-b5af-9ff356a0a229 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:17:39.629989 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-bcba9ae7-2c18-4358-b5af-9ff356a0a229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:17:39.641820 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba9ae7-2c18-4358-b5af-9ff356a0a229 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:17:39.645478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2c47d-edc4-4c57-9dcd-bfa8522c6784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:17:39.646203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2c47d-edc4-4c57-9dcd-bfa8522c6784 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:39.646486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2c47d-edc4-4c57-9dcd-bfa8522c6784 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:39.646761 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2c47d-edc4-4c57-9dcd-bfa8522c6784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:39.648521 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b7a2c47d-edc4-4c57-9dcd-bfa8522c6784 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:17:39.658450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2c47d-edc4-4c57-9dcd-bfa8522c6784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:17:39.659911 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2c47d-edc4-4c57-9dcd-bfa8522c6784 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:17:39.668385 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1179/2384] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:17:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:17:40.003097 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c3ea0-0d0d-4e71-842f-e66ae7142e39 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:17:40.009400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:17:40.018920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c3ea0-0d0d-4e71-842f-e66ae7142e39 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:17:40.024089 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3fa25-8dcf-42f7-a20c-e3a0f656acff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:17:40.024829 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3fa25-8dcf-42f7-a20c-e3a0f656acff service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:40.025105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3fa25-8dcf-42f7-a20c-e3a0f656acff service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:40.025373 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3fa25-8dcf-42f7-a20c-e3a0f656acff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:40.028214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1dc3fa25-8dcf-42f7-a20c-e3a0f656acff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:17:40.041357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3fa25-8dcf-42f7-a20c-e3a0f656acff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:17:40.043095 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3fa25-8dcf-42f7-a20c-e3a0f656acff service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:17:40.060821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1206/2385] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:17:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:17:48.935228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2c47d-edc4-4c57-9dcd-bfa8522c6784 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:17:48.957580 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2c47d-edc4-4c57-9dcd-bfa8522c6784 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:17:48.965080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82994f8a-95a2-44db-a9d7-96b089615af6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:17:48.965433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82994f8a-95a2-44db-a9d7-96b089615af6 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:17:48.965433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82994f8a-95a2-44db-a9d7-96b089615af6 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:17:48.965738 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82994f8a-95a2-44db-a9d7-96b089615af6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:17:48.968143 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-82994f8a-95a2-44db-a9d7-96b089615af6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:17:48.982218 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82994f8a-95a2-44db-a9d7-96b089615af6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:17:48.983947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82994f8a-95a2-44db-a9d7-96b089615af6 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:17:49.000401 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1180/2386] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:17:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:17:50.057009 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:17:58.994230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:18:34.840411 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3fa25-8dcf-42f7-a20c-e3a0f656acff service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:18:34.853483 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3fa25-8dcf-42f7-a20c-e3a0f656acff service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:18:34.861660 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a66c55-0a6e-4f54-b38d-56b124fc6aac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:18:34.862352 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a66c55-0a6e-4f54-b38d-56b124fc6aac service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:34.862658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a66c55-0a6e-4f54-b38d-56b124fc6aac service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:34.862936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a66c55-0a6e-4f54-b38d-56b124fc6aac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:34.864936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b6a66c55-0a6e-4f54-b38d-56b124fc6aac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:18:34.945726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a66c55-0a6e-4f54-b38d-56b124fc6aac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:18:34.947348 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a66c55-0a6e-4f54-b38d-56b124fc6aac service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:18:34.961940 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1207/2387] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:18:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:18:35.016538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82994f8a-95a2-44db-a9d7-96b089615af6 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:18:35.030778 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82994f8a-95a2-44db-a9d7-96b089615af6 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:18:35.034598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50762f8-5343-47fe-a6f1-5775a98327e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:18:35.035235 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50762f8-5343-47fe-a6f1-5775a98327e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:35.035510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50762f8-5343-47fe-a6f1-5775a98327e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:35.035779 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50762f8-5343-47fe-a6f1-5775a98327e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:35.037897 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c50762f8-5343-47fe-a6f1-5775a98327e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:18:35.053600 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50762f8-5343-47fe-a6f1-5775a98327e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:18:35.055839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50762f8-5343-47fe-a6f1-5775a98327e9 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:18:35.068571 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1181/2388] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:18:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:18:35.206722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a66c55-0a6e-4f54-b38d-56b124fc6aac service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:18:35.216391 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a66c55-0a6e-4f54-b38d-56b124fc6aac service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:18:35.220414 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b9729-5eac-4f97-9fe9-ba8338a94779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:18:35.221084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b9729-5eac-4f97-9fe9-ba8338a94779 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:18:35.221479 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b9729-5eac-4f97-9fe9-ba8338a94779 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:18:35.221638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b9729-5eac-4f97-9fe9-ba8338a94779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:18:35.223699 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-127b9729-5eac-4f97-9fe9-ba8338a94779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:18:35.239508 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b9729-5eac-4f97-9fe9-ba8338a94779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:18:35.241197 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b9729-5eac-4f97-9fe9-ba8338a94779 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:18:35.255231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1208/2389] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:18:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:18:45.063037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:18:45.248580 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=39 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:19:46.327337 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50762f8-5343-47fe-a6f1-5775a98327e9 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:19:46.338889 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50762f8-5343-47fe-a6f1-5775a98327e9 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:19:46.343960 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147d3ef-3be6-4c63-a1de-ab972bcc3ec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:19:46.344631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147d3ef-3be6-4c63-a1de-ab972bcc3ec5 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:19:46.344910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147d3ef-3be6-4c63-a1de-ab972bcc3ec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:19:46.345185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147d3ef-3be6-4c63-a1de-ab972bcc3ec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:19:46.347395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4147d3ef-3be6-4c63-a1de-ab972bcc3ec5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:19:46.429689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147d3ef-3be6-4c63-a1de-ab972bcc3ec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:19:46.431720 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147d3ef-3be6-4c63-a1de-ab972bcc3ec5 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:19:46.441319 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1182/2390] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:19:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:19:56.436859 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=33 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:20:41.127743 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b9729-5eac-4f97-9fe9-ba8338a94779 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:20:41.208940 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b9729-5eac-4f97-9fe9-ba8338a94779 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:20:41.214214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cf7fb-3d55-4385-b441-81eb2914466c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:20:41.214895 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cf7fb-3d55-4385-b441-81eb2914466c service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:20:41.215198 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cf7fb-3d55-4385-b441-81eb2914466c service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:20:41.215465 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cf7fb-3d55-4385-b441-81eb2914466c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:20:41.218521 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1c2cf7fb-3d55-4385-b441-81eb2914466c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:20:41.231021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cf7fb-3d55-4385-b441-81eb2914466c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:20:41.232917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cf7fb-3d55-4385-b441-81eb2914466c service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:20:41.244353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1209/2391] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:20:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:20:51.239798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=32 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:21:47.067097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147d3ef-3be6-4c63-a1de-ab972bcc3ec5 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:21:47.076949 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147d3ef-3be6-4c63-a1de-ab972bcc3ec5 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:21:47.081717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40def19e-acc9-465a-bee0-5853d951cdfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:21:47.082402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40def19e-acc9-465a-bee0-5853d951cdfe service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:21:47.082665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40def19e-acc9-465a-bee0-5853d951cdfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:21:47.082955 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40def19e-acc9-465a-bee0-5853d951cdfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:21:47.085209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-40def19e-acc9-465a-bee0-5853d951cdfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:21:47.112814 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40def19e-acc9-465a-bee0-5853d951cdfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:21:47.114376 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40def19e-acc9-465a-bee0-5853d951cdfe service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:21:47.126132 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1183/2392] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:21:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:21:47.181827 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cf7fb-3d55-4385-b441-81eb2914466c service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:21:47.192672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cf7fb-3d55-4385-b441-81eb2914466c service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:21:47.196616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221e538-c52b-469a-a92b-9de10b520f59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:21:47.197248 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221e538-c52b-469a-a92b-9de10b520f59 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:21:47.197528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221e538-c52b-469a-a92b-9de10b520f59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:21:47.197827 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221e538-c52b-469a-a92b-9de10b520f59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:21:47.200376 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7221e538-c52b-469a-a92b-9de10b520f59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:21:47.226636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221e538-c52b-469a-a92b-9de10b520f59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:21:47.228107 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221e538-c52b-469a-a92b-9de10b520f59 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:21:47.239335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1210/2393] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:21:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:21:57.121001 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=11 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:21:57.233814 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=11 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:30.459711 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40def19e-acc9-465a-bee0-5853d951cdfe service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:30.470458 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40def19e-acc9-465a-bee0-5853d951cdfe service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:30.474739 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bacd2-ccbe-4222-bf6d-8382d4d9ed35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:30.475374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bacd2-ccbe-4222-bf6d-8382d4d9ed35 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:30.475649 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bacd2-ccbe-4222-bf6d-8382d4d9ed35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:30.475941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bacd2-ccbe-4222-bf6d-8382d4d9ed35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:30.483937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bacd2-ccbe-4222-bf6d-8382d4d9ed35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:30.485383 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bacd2-ccbe-4222-bf6d-8382d4d9ed35 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:30.494018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1184/2394] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:22:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:22:36.478667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221e538-c52b-469a-a92b-9de10b520f59 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:22:36.496854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221e538-c52b-469a-a92b-9de10b520f59 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:22:36.505857 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6090d5-8cd7-4839-805c-73eaad8c2f68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:22:36.506555 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6090d5-8cd7-4839-805c-73eaad8c2f68 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:22:36.506850 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6090d5-8cd7-4839-805c-73eaad8c2f68 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:22:36.507120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6090d5-8cd7-4839-805c-73eaad8c2f68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:22:36.515772 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6090d5-8cd7-4839-805c-73eaad8c2f68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:22:36.517367 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6090d5-8cd7-4839-805c-73eaad8c2f68 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:22:36.547690 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1211/2395] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:22:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:22:40.490259 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:22:46.544283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=13 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:35.391898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bacd2-ccbe-4222-bf6d-8382d4d9ed35 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:35.394305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9a5bacd2-ccbe-4222-bf6d-8382d4d9ed35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:35.451412 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bacd2-ccbe-4222-bf6d-8382d4d9ed35 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:35.457359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491705a9-a151-4417-86d2-c5541e8d18ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:35.458187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491705a9-a151-4417-86d2-c5541e8d18ff service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:35.458489 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491705a9-a151-4417-86d2-c5541e8d18ff service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:35.458763 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491705a9-a151-4417-86d2-c5541e8d18ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:35.467806 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491705a9-a151-4417-86d2-c5541e8d18ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:35.469431 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491705a9-a151-4417-86d2-c5541e8d18ff service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:35.499330 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1185/2396] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:35.550927 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6090d5-8cd7-4839-805c-73eaad8c2f68 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:35.572787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6090d5-8cd7-4839-805c-73eaad8c2f68 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:35.577642 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab527d-9ecf-4c88-82fa-9eac12d174f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:35.578340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab527d-9ecf-4c88-82fa-9eac12d174f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:35.578618 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab527d-9ecf-4c88-82fa-9eac12d174f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:35.578886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab527d-9ecf-4c88-82fa-9eac12d174f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:35.590833 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab527d-9ecf-4c88-82fa-9eac12d174f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:35.592834 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab527d-9ecf-4c88-82fa-9eac12d174f2 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:35.604511 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1212/2397] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:23:35.661720 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491705a9-a151-4417-86d2-c5541e8d18ff service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:35.672142 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491705a9-a151-4417-86d2-c5541e8d18ff service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:35.676254 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972c9ba-0ede-4ea2-b765-8e9d0335ec38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:35.676915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972c9ba-0ede-4ea2-b765-8e9d0335ec38 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:35.677192 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972c9ba-0ede-4ea2-b765-8e9d0335ec38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:35.677466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972c9ba-0ede-4ea2-b765-8e9d0335ec38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:35.689616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972c9ba-0ede-4ea2-b765-8e9d0335ec38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:35.691144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972c9ba-0ede-4ea2-b765-8e9d0335ec38 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:35.703359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1186/2398] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:37.913534 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab527d-9ecf-4c88-82fa-9eac12d174f2 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:37.924991 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab527d-9ecf-4c88-82fa-9eac12d174f2 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:37.930775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfec6a4-8975-47ed-be62-8f9e7a0582eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:37.931434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfec6a4-8975-47ed-be62-8f9e7a0582eb service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:37.931691 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfec6a4-8975-47ed-be62-8f9e7a0582eb service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:37.932137 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfec6a4-8975-47ed-be62-8f9e7a0582eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:37.934004 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ddfec6a4-8975-47ed-be62-8f9e7a0582eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:37.947655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfec6a4-8975-47ed-be62-8f9e7a0582eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:37.949922 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfec6a4-8975-47ed-be62-8f9e7a0582eb service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:37.961816 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1213/2399] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:45.698378 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=33 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:47.582900 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972c9ba-0ede-4ea2-b765-8e9d0335ec38 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:47.593604 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972c9ba-0ede-4ea2-b765-8e9d0335ec38 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:47.600803 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dff658-d6fa-4105-a369-db685cc72028 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:47.602055 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dff658-d6fa-4105-a369-db685cc72028 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:47.604778 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dff658-d6fa-4105-a369-db685cc72028 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:47.619937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dff658-d6fa-4105-a369-db685cc72028 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:47.651264 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dff658-d6fa-4105-a369-db685cc72028 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:47.652785 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dff658-d6fa-4105-a369-db685cc72028 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:47.702347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1187/2400] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:47.956728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=17 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:48.228896 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fe8a2-2c34-4b68-bb84-6ae8095f31ca None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:48.229377 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fe8a2-2c34-4b68-bb84-6ae8095f31ca None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:48.230233 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fe8a2-2c34-4b68-bb84-6ae8095f31ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:48.265496 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-2d5fe8a2-2c34-4b68-bb84-6ae8095f31ca None None] MFA Rules not processed for user `cef7ac127d2f4284a1808c580148c9e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:23:48.269077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2d5fe8a2-2c34-4b68-bb84-6ae8095f31ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:48.277341 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1214/2401] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:23:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:23:48.330272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dff658-d6fa-4105-a369-db685cc72028 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:48.343530 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dff658-d6fa-4105-a369-db685cc72028 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:48.347009 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc216f-e8ca-476f-9ed3-cada961cf760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:48.347666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc216f-e8ca-476f-9ed3-cada961cf760 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:48.347947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc216f-e8ca-476f-9ed3-cada961cf760 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:48.348221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc216f-e8ca-476f-9ed3-cada961cf760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:48.350043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-26dc216f-e8ca-476f-9ed3-cada961cf760 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:48.455396 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc216f-e8ca-476f-9ed3-cada961cf760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:48.457343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc216f-e8ca-476f-9ed3-cada961cf760 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:48.479751 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1188/2402] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:23:48.632552 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fe8a2-2c34-4b68-bb84-6ae8095f31ca None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:48.643441 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fe8a2-2c34-4b68-bb84-6ae8095f31ca None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:48.647264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59949a4c-18d0-4fe1-a846-73d9cc6a100a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:48.647918 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59949a4c-18d0-4fe1-a846-73d9cc6a100a service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:48.648400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59949a4c-18d0-4fe1-a846-73d9cc6a100a service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:48.648682 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59949a4c-18d0-4fe1-a846-73d9cc6a100a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:48.650712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-59949a4c-18d0-4fe1-a846-73d9cc6a100a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:48.661463 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59949a4c-18d0-4fe1-a846-73d9cc6a100a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:48.662995 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59949a4c-18d0-4fe1-a846-73d9cc6a100a service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:48.672389 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1215/2403] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:23:49.030595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc216f-e8ca-476f-9ed3-cada961cf760 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:49.043526 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc216f-e8ca-476f-9ed3-cada961cf760 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:49.059557 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caecaf9-8ec7-4d58-a5ef-d24f5f59f843 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:49.060913 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caecaf9-8ec7-4d58-a5ef-d24f5f59f843 service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:49.061417 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caecaf9-8ec7-4d58-a5ef-d24f5f59f843 service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:49.062077 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caecaf9-8ec7-4d58-a5ef-d24f5f59f843 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:49.072309 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caecaf9-8ec7-4d58-a5ef-d24f5f59f843 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:49.073997 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caecaf9-8ec7-4d58-a5ef-d24f5f59f843 service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:49.086059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1189/2404] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:52.396957 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59949a4c-18d0-4fe1-a846-73d9cc6a100a service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:52.443107 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59949a4c-18d0-4fe1-a846-73d9cc6a100a service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:52.452928 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cae36f-3635-4706-ace5-ccf4eede5d79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:52.453597 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cae36f-3635-4706-ace5-ccf4eede5d79 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:52.453909 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cae36f-3635-4706-ace5-ccf4eede5d79 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:52.454393 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cae36f-3635-4706-ace5-ccf4eede5d79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:52.466934 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cae36f-3635-4706-ace5-ccf4eede5d79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:52.469708 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cae36f-3635-4706-ace5-ccf4eede5d79 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:52.494756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1216/2405] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:52.948733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caecaf9-8ec7-4d58-a5ef-d24f5f59f843 service placement] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:52.965260 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caecaf9-8ec7-4d58-a5ef-d24f5f59f843 service placement] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:52.973693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fb8ad-0387-4039-8b17-cbd52c1c131e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:52.974551 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fb8ad-0387-4039-8b17-cbd52c1c131e service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:52.975339 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fb8ad-0387-4039-8b17-cbd52c1c131e service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:52.975868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fb8ad-0387-4039-8b17-cbd52c1c131e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:52.979171 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0e9fb8ad-0387-4039-8b17-cbd52c1c131e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:53.007845 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fb8ad-0387-4039-8b17-cbd52c1c131e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:53.010203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fb8ad-0387-4039-8b17-cbd52c1c131e service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:53.026585 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1190/2406] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:56.952670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cae36f-3635-4706-ace5-ccf4eede5d79 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:56.967227 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cae36f-3635-4706-ace5-ccf4eede5d79 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:56.973661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976fb7e-f4d9-40ca-a9f0-7a14b8e59a93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:56.982956 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976fb7e-f4d9-40ca-a9f0-7a14b8e59a93 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:56.982956 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976fb7e-f4d9-40ca-a9f0-7a14b8e59a93 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:56.982956 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976fb7e-f4d9-40ca-a9f0-7a14b8e59a93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:56.982956 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7976fb7e-f4d9-40ca-a9f0-7a14b8e59a93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:56.990338 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976fb7e-f4d9-40ca-a9f0-7a14b8e59a93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:56.992019 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976fb7e-f4d9-40ca-a9f0-7a14b8e59a93 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:57.019961 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1217/2407] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:23:57.068126 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fb8ad-0387-4039-8b17-cbd52c1c131e service placement] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:57.069602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0e9fb8ad-0387-4039-8b17-cbd52c1c131e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:57.084193 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fb8ad-0387-4039-8b17-cbd52c1c131e service placement] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:57.089145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202bd1f-abf9-414e-8523-1906045569a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:57.090546 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202bd1f-abf9-414e-8523-1906045569a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:57.091134 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202bd1f-abf9-414e-8523-1906045569a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:57.091507 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202bd1f-abf9-414e-8523-1906045569a0 admin admin] PATH_INFO: `/v3/users/f54c975b432a4678a5624ad5c9f54b74` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:57.092895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8202bd1f-abf9-414e-8523-1906045569a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f54c975b432a4678a5624ad5c9f54b74)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:57.095028 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8202bd1f-abf9-414e-8523-1906045569a0 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:57.156040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8202bd1f-abf9-414e-8523-1906045569a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f54c975b432a4678a5624ad5c9f54b74'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:57.156690 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8202bd1f-abf9-414e-8523-1906045569a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f54c975b432a4678a5624ad5c9f54b74'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:57.164151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8202bd1f-abf9-414e-8523-1906045569a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f54c975b432a4678a5624ad5c9f54b74'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:57.171671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:57.178458 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8202bd1f-abf9-414e-8523-1906045569a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f54c975b432a4678a5624ad5c9f54b74'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:57.179589 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8202bd1f-abf9-414e-8523-1906045569a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f54c975b432a4678a5624ad5c9f54b74'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:57.195353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1191/2408] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:23:57 2022] DELETE /identity/v3/users/f54c975b432a4678a5624ad5c9f54b74 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:57.402541 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976fb7e-f4d9-40ca-a9f0-7a14b8e59a93 service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:57.418856 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976fb7e-f4d9-40ca-a9f0-7a14b8e59a93 service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:57.495704 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ce0b9-627c-42fb-9e9a-cbdd13f3e9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:57.496615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ce0b9-627c-42fb-9e9a-cbdd13f3e9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:57.497488 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ce0b9-627c-42fb-9e9a-cbdd13f3e9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:57.497769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ce0b9-627c-42fb-9e9a-cbdd13f3e9ea admin admin] PATH_INFO: `/v3/projects/01f30f060e2444f9a2238c4c447c7dbd` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:57.499047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ce0b9-627c-42fb-9e9a-cbdd13f3e9ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f30f060e2444f9a2238c4c447c7dbd)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:57.500982 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ce0b9-627c-42fb-9e9a-cbdd13f3e9ea admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:57.560118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-088ce0b9-627c-42fb-9e9a-cbdd13f3e9ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f30f060e2444f9a2238c4c447c7dbd', 'request_id': 'req-088ce0b9-627c-42fb-9e9a-cbdd13f3e9ea'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:57.571379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-088ce0b9-627c-42fb-9e9a-cbdd13f3e9ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f30f060e2444f9a2238c4c447c7dbd', 'request_id': 'req-088ce0b9-627c-42fb-9e9a-cbdd13f3e9ea'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:57.578917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-088ce0b9-627c-42fb-9e9a-cbdd13f3e9ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f30f060e2444f9a2238c4c447c7dbd', 'request_id': 'req-088ce0b9-627c-42fb-9e9a-cbdd13f3e9ea'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:57.591347 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-088ce0b9-627c-42fb-9e9a-cbdd13f3e9ea admin admin] The token cache is being invalidate because project 01f30f060e2444f9a2238c4c447c7dbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:23:57.591657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-088ce0b9-627c-42fb-9e9a-cbdd13f3e9ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:57.592205 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-088ce0b9-627c-42fb-9e9a-cbdd13f3e9ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:57.593818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1218/2409] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:23:57 2022] DELETE /identity/v3/projects/01f30f060e2444f9a2238c4c447c7dbd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:57.597939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202bd1f-abf9-414e-8523-1906045569a0 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:57.600942 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8202bd1f-abf9-414e-8523-1906045569a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:57.614371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202bd1f-abf9-414e-8523-1906045569a0 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:57.677049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e94f92-235c-416a-98d1-fa12e2b8187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:57.678003 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e94f92-235c-416a-98d1-fa12e2b8187d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:57.678270 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e94f92-235c-416a-98d1-fa12e2b8187d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:57.678541 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e94f92-235c-416a-98d1-fa12e2b8187d admin admin] PATH_INFO: `/v3/users/58c2326a461b43d68b950311a332c0db` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:57.694521 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e94f92-235c-416a-98d1-fa12e2b8187d admin admin] RBAC: Authorizing `identity:delete_user(user_id=58c2326a461b43d68b950311a332c0db)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:57.696623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e94f92-235c-416a-98d1-fa12e2b8187d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:57.751587 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-58e94f92-235c-416a-98d1-fa12e2b8187d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58c2326a461b43d68b950311a332c0db'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:57.752274 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-58e94f92-235c-416a-98d1-fa12e2b8187d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58c2326a461b43d68b950311a332c0db'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:57.759712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-58e94f92-235c-416a-98d1-fa12e2b8187d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58c2326a461b43d68b950311a332c0db'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:57.774727 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-58e94f92-235c-416a-98d1-fa12e2b8187d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58c2326a461b43d68b950311a332c0db'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:57.775760 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-58e94f92-235c-416a-98d1-fa12e2b8187d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58c2326a461b43d68b950311a332c0db'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:57.793371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1192/2410] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:23:57 2022] DELETE /identity/v3/users/58c2326a461b43d68b950311a332c0db => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:57.994556 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ce0b9-627c-42fb-9e9a-cbdd13f3e9ea admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:57.996131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-088ce0b9-627c-42fb-9e9a-cbdd13f3e9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:58.010193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ce0b9-627c-42fb-9e9a-cbdd13f3e9ea admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:58.052062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:58.078865 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67d132-0e0f-4d58-8578-0d02cf1a18ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:58.079747 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67d132-0e0f-4d58-8578-0d02cf1a18ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:58.080032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67d132-0e0f-4d58-8578-0d02cf1a18ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:58.080499 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67d132-0e0f-4d58-8578-0d02cf1a18ad admin admin] PATH_INFO: `/v3/projects/341d6e18464a4fe1ae1418470e9106cd` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:58.092699 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67d132-0e0f-4d58-8578-0d02cf1a18ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=341d6e18464a4fe1ae1418470e9106cd)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:58.094945 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67d132-0e0f-4d58-8578-0d02cf1a18ad admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:58.145096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cb67d132-0e0f-4d58-8578-0d02cf1a18ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '341d6e18464a4fe1ae1418470e9106cd', 'request_id': 'req-cb67d132-0e0f-4d58-8578-0d02cf1a18ad'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:58.153755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cb67d132-0e0f-4d58-8578-0d02cf1a18ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '341d6e18464a4fe1ae1418470e9106cd', 'request_id': 'req-cb67d132-0e0f-4d58-8578-0d02cf1a18ad'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:58.163170 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cb67d132-0e0f-4d58-8578-0d02cf1a18ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '341d6e18464a4fe1ae1418470e9106cd', 'request_id': 'req-cb67d132-0e0f-4d58-8578-0d02cf1a18ad'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:58.174819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cb67d132-0e0f-4d58-8578-0d02cf1a18ad admin admin] The token cache is being invalidate because project 341d6e18464a4fe1ae1418470e9106cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:23:58.175114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cb67d132-0e0f-4d58-8578-0d02cf1a18ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:58.175795 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cb67d132-0e0f-4d58-8578-0d02cf1a18ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:23:58.177394 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1219/2411] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:23:57 2022] DELETE /identity/v3/projects/341d6e18464a4fe1ae1418470e9106cd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:23:58.481908 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e94f92-235c-416a-98d1-fa12e2b8187d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:23:58.483824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-58e94f92-235c-416a-98d1-fa12e2b8187d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:58.567438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:23:58.596961 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e94f92-235c-416a-98d1-fa12e2b8187d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:23:58.665223 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e9c62-ea08-42b8-ae5e-05bffa80d71e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:23:58.666034 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e9c62-ea08-42b8-ae5e-05bffa80d71e service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:23:58.666242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e9c62-ea08-42b8-ae5e-05bffa80d71e service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:23:58.666522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e9c62-ea08-42b8-ae5e-05bffa80d71e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:23:58.668595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-fa0e9c62-ea08-42b8-ae5e-05bffa80d71e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:23:58.683384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e9c62-ea08-42b8-ae5e-05bffa80d71e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:23:58.687231 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e9c62-ea08-42b8-ae5e-05bffa80d71e service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:23:58.699057 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1193/2412] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:23:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:08.171529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:08.695090 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=39 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:24:47.381088 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67d132-0e0f-4d58-8578-0d02cf1a18ad admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:24:47.383597 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-cb67d132-0e0f-4d58-8578-0d02cf1a18ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:47.402148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67d132-0e0f-4d58-8578-0d02cf1a18ad admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:24:47.409652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea32465-0ecf-4a03-9c91-a2ba3f071fc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:24:47.410349 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea32465-0ecf-4a03-9c91-a2ba3f071fc9 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:24:47.410629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea32465-0ecf-4a03-9c91-a2ba3f071fc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:24:47.410898 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea32465-0ecf-4a03-9c91-a2ba3f071fc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:24:47.412876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-aea32465-0ecf-4a03-9c91-a2ba3f071fc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:24:47.482785 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea32465-0ecf-4a03-9c91-a2ba3f071fc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:24:47.484401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea32465-0ecf-4a03-9c91-a2ba3f071fc9 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:24:47.503948 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1220/2413] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:24:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:24:57.500658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=36 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:25:46.101850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e9c62-ea08-42b8-ae5e-05bffa80d71e service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:25:46.103326 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-fa0e9c62-ea08-42b8-ae5e-05bffa80d71e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:46.228136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e9c62-ea08-42b8-ae5e-05bffa80d71e service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:25:46.233716 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb49de-35b9-4035-9483-ebc0067435a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:25:46.235433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb49de-35b9-4035-9483-ebc0067435a0 service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:25:46.235720 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb49de-35b9-4035-9483-ebc0067435a0 service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:25:46.235990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb49de-35b9-4035-9483-ebc0067435a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:25:46.238033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ddeb49de-35b9-4035-9483-ebc0067435a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:25:46.253180 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb49de-35b9-4035-9483-ebc0067435a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:25:46.254881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb49de-35b9-4035-9483-ebc0067435a0 service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:25:46.266863 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1194/2414] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:25:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:25:56.261122 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=49 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:26:47.035155 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea32465-0ecf-4a03-9c91-a2ba3f071fc9 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:26:47.047946 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea32465-0ecf-4a03-9c91-a2ba3f071fc9 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:26:47.059703 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9c5d5-0b56-4675-99f2-66581561a002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:26:47.060376 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9c5d5-0b56-4675-99f2-66581561a002 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:26:47.060658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9c5d5-0b56-4675-99f2-66581561a002 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:26:47.061276 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9c5d5-0b56-4675-99f2-66581561a002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:26:47.063646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-baf9c5d5-0b56-4675-99f2-66581561a002 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:26:47.139433 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9c5d5-0b56-4675-99f2-66581561a002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:26:47.141058 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9c5d5-0b56-4675-99f2-66581561a002 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:26:47.160900 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1221/2415] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:26:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:26:57.157766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=36 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:27:48.268952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb49de-35b9-4035-9483-ebc0067435a0 service placement] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:27:48.270590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ddeb49de-35b9-4035-9483-ebc0067435a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:27:48.378517 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb49de-35b9-4035-9483-ebc0067435a0 service placement] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:27:48.386486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37f142-09bb-416b-89f0-c58907b2aa17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:27:48.387432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37f142-09bb-416b-89f0-c58907b2aa17 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:27:48.387933 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37f142-09bb-416b-89f0-c58907b2aa17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:27:48.388344 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37f142-09bb-416b-89f0-c58907b2aa17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:27:48.390943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-bd37f142-09bb-416b-89f0-c58907b2aa17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:27:48.503591 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37f142-09bb-416b-89f0-c58907b2aa17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:27:48.505056 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37f142-09bb-416b-89f0-c58907b2aa17 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:27:48.515496 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1195/2416] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:27:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:27:58.510467 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=62 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:28:32.824977 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9c5d5-0b56-4675-99f2-66581561a002 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:28:32.826619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-baf9c5d5-0b56-4675-99f2-66581561a002 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:32.920831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9c5d5-0b56-4675-99f2-66581561a002 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:28:32.924569 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155e7bb-729c-423b-b17f-8b8356781131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:28:32.925211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155e7bb-729c-423b-b17f-8b8356781131 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:28:32.925493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155e7bb-729c-423b-b17f-8b8356781131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:28:32.925769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155e7bb-729c-423b-b17f-8b8356781131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:28:32.927581 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6155e7bb-729c-423b-b17f-8b8356781131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:32.938542 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155e7bb-729c-423b-b17f-8b8356781131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:28:32.940021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155e7bb-729c-423b-b17f-8b8356781131 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:28:32.953268 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1222/2417] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:28:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:28:36.018948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37f142-09bb-416b-89f0-c58907b2aa17 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:28:36.020635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-bd37f142-09bb-416b-89f0-c58907b2aa17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:36.034497 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37f142-09bb-416b-89f0-c58907b2aa17 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:28:36.039941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ecdb2-f820-4f46-8e1e-5211652a9218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:28:36.040622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ecdb2-f820-4f46-8e1e-5211652a9218 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:28:36.040894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ecdb2-f820-4f46-8e1e-5211652a9218 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:28:36.041164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ecdb2-f820-4f46-8e1e-5211652a9218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:28:36.043374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e89ecdb2-f820-4f46-8e1e-5211652a9218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:36.081604 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ecdb2-f820-4f46-8e1e-5211652a9218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:28:36.083128 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ecdb2-f820-4f46-8e1e-5211652a9218 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:28:36.117294 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1196/2418] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:28:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:28:36.355832 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155e7bb-729c-423b-b17f-8b8356781131 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:28:36.366902 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155e7bb-729c-423b-b17f-8b8356781131 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:28:36.370733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bbd30-260c-4cda-96c2-00e9af902731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:28:36.371378 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bbd30-260c-4cda-96c2-00e9af902731 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:28:36.371704 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bbd30-260c-4cda-96c2-00e9af902731 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:28:36.372060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bbd30-260c-4cda-96c2-00e9af902731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:28:36.374040 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-193bbd30-260c-4cda-96c2-00e9af902731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:28:36.388287 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bbd30-260c-4cda-96c2-00e9af902731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:28:36.389749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bbd30-260c-4cda-96c2-00e9af902731 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:28:36.407225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1223/2419] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:28:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:28:46.114154 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=18 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:28:46.396567 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=41 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:46.984530 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ecdb2-f820-4f46-8e1e-5211652a9218 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:46.996453 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ecdb2-f820-4f46-8e1e-5211652a9218 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:47.003696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7601b0e-492b-4a96-babc-09c81aaefba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:47.004346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7601b0e-492b-4a96-babc-09c81aaefba6 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:47.004632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7601b0e-492b-4a96-babc-09c81aaefba6 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:47.004902 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7601b0e-492b-4a96-babc-09c81aaefba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:47.013790 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7601b0e-492b-4a96-babc-09c81aaefba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:47.015461 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7601b0e-492b-4a96-babc-09c81aaefba6 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:47.025286 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1197/2420] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:29:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:29:48.491168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bbd30-260c-4cda-96c2-00e9af902731 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:48.492688 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-193bbd30-260c-4cda-96c2-00e9af902731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:48.504535 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bbd30-260c-4cda-96c2-00e9af902731 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:48.508766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d66af-9d61-4ffc-9c68-5b42ceff049f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:48.509413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d66af-9d61-4ffc-9c68-5b42ceff049f service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:48.509787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d66af-9d61-4ffc-9c68-5b42ceff049f service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:48.510157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d66af-9d61-4ffc-9c68-5b42ceff049f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:48.512094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-527d66af-9d61-4ffc-9c68-5b42ceff049f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:48.588345 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d66af-9d61-4ffc-9c68-5b42ceff049f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:48.589829 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d66af-9d61-4ffc-9c68-5b42ceff049f service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:48.599006 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1224/2421] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:29:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:29:48.683263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7601b0e-492b-4a96-babc-09c81aaefba6 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:48.692537 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7601b0e-492b-4a96-babc-09c81aaefba6 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:48.696360 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a311ea8-000e-46ef-b631-ee9ab1309755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:48.696998 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a311ea8-000e-46ef-b631-ee9ab1309755 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:48.697278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a311ea8-000e-46ef-b631-ee9ab1309755 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:48.697548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a311ea8-000e-46ef-b631-ee9ab1309755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:48.699404 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3a311ea8-000e-46ef-b631-ee9ab1309755 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:48.777475 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a311ea8-000e-46ef-b631-ee9ab1309755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:48.779093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a311ea8-000e-46ef-b631-ee9ab1309755 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:48.788934 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1198/2422] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:29:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:29:49.305106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688977-527c-4821-852e-87ea7d0b64ee None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:49.305409 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688977-527c-4821-852e-87ea7d0b64ee None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:49.305673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688977-527c-4821-852e-87ea7d0b64ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:49.377498 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c8688977-527c-4821-852e-87ea7d0b64ee None None] MFA Rules not processed for user `23aa142375c54b94ad276d1a4b9031e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:29:49.378756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c8688977-527c-4821-852e-87ea7d0b64ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:49.458628 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1225/2423] 10.222.0.15 () {58 vars in 967 bytes} [Thu Jun 2 19:29:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:29:49.507920 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a311ea8-000e-46ef-b631-ee9ab1309755 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:49.509328 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3a311ea8-000e-46ef-b631-ee9ab1309755 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:49.609566 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a311ea8-000e-46ef-b631-ee9ab1309755 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:49.615314 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bdb8a-544b-4637-b761-56d99d190374 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4faac48f82244bebf039aab92898617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:49.616170 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bdb8a-544b-4637-b761-56d99d190374 service swift] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:49.616855 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bdb8a-544b-4637-b761-56d99d190374 service swift] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:49.616855 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bdb8a-544b-4637-b761-56d99d190374 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:49.627349 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bdb8a-544b-4637-b761-56d99d190374 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:49.628985 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bdb8a-544b-4637-b761-56d99d190374 service swift] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:49.638390 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1199/2424] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 2 19:29:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:29:50.174540 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688977-527c-4821-852e-87ea7d0b64ee None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:50.186924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688977-527c-4821-852e-87ea7d0b64ee None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:50.191092 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8d146-e1f1-4bfd-9497-739489762d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:50.191761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8d146-e1f1-4bfd-9497-739489762d76 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:50.192038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8d146-e1f1-4bfd-9497-739489762d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:50.192310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8d146-e1f1-4bfd-9497-739489762d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:50.194998 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2db8d146-e1f1-4bfd-9497-739489762d76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:50.246967 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:50.263586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8d146-e1f1-4bfd-9497-739489762d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:50.265129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8d146-e1f1-4bfd-9497-739489762d76 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:50.276182 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1226/2425] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:29:53.427535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bdb8a-544b-4637-b761-56d99d190374 service swift] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:53.430985 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-559bdb8a-544b-4637-b761-56d99d190374 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:53.459303 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bdb8a-544b-4637-b761-56d99d190374 service swift] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:53.472073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b215b-31d8-4d0e-865f-e9ec902b1ee3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:53.472756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b215b-31d8-4d0e-865f-e9ec902b1ee3 service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:53.473037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b215b-31d8-4d0e-865f-e9ec902b1ee3 service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:53.473316 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b215b-31d8-4d0e-865f-e9ec902b1ee3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:53.476156 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-154b215b-31d8-4d0e-865f-e9ec902b1ee3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:53.488941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b215b-31d8-4d0e-865f-e9ec902b1ee3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:53.493543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b215b-31d8-4d0e-865f-e9ec902b1ee3 service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:53.504280 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1200/2426] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:29:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:29:56.721523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8d146-e1f1-4bfd-9497-739489762d76 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:56.723125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2db8d146-e1f1-4bfd-9497-739489762d76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:56.736595 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8d146-e1f1-4bfd-9497-739489762d76 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:56.741551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad083430-1143-43d4-80ed-d38a8efb7904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:56.742608 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad083430-1143-43d4-80ed-d38a8efb7904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:56.742891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad083430-1143-43d4-80ed-d38a8efb7904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:56.743165 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad083430-1143-43d4-80ed-d38a8efb7904 admin admin] PATH_INFO: `/v3/users/9791fd04ff4045578041a3c7f613f495` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:56.757743 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad083430-1143-43d4-80ed-d38a8efb7904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9791fd04ff4045578041a3c7f613f495)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:56.759762 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad083430-1143-43d4-80ed-d38a8efb7904 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:56.806321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ad083430-1143-43d4-80ed-d38a8efb7904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9791fd04ff4045578041a3c7f613f495'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:56.806964 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ad083430-1143-43d4-80ed-d38a8efb7904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9791fd04ff4045578041a3c7f613f495'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:56.814220 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ad083430-1143-43d4-80ed-d38a8efb7904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9791fd04ff4045578041a3c7f613f495'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:56.822117 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ad083430-1143-43d4-80ed-d38a8efb7904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9791fd04ff4045578041a3c7f613f495'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:56.822741 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ad083430-1143-43d4-80ed-d38a8efb7904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9791fd04ff4045578041a3c7f613f495'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:56.840262 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1227/2427] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:29:56 2022] DELETE /identity/v3/users/9791fd04ff4045578041a3c7f613f495 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:57.025233 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b215b-31d8-4d0e-865f-e9ec902b1ee3 service placement] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:57.036114 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b215b-31d8-4d0e-865f-e9ec902b1ee3 service placement] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:57.066389 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:57.095619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42cc67-29e1-4a11-9473-6264ec1d30c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:57.096494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42cc67-29e1-4a11-9473-6264ec1d30c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:57.096777 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42cc67-29e1-4a11-9473-6264ec1d30c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:57.097070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42cc67-29e1-4a11-9473-6264ec1d30c1 admin admin] PATH_INFO: `/v3/projects/3cefe0d5fbae4b6ca7578bf08f275bac` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:57.098365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42cc67-29e1-4a11-9473-6264ec1d30c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cefe0d5fbae4b6ca7578bf08f275bac)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:57.100432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42cc67-29e1-4a11-9473-6264ec1d30c1 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:57.151065 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1c42cc67-29e1-4a11-9473-6264ec1d30c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cefe0d5fbae4b6ca7578bf08f275bac', 'request_id': 'req-1c42cc67-29e1-4a11-9473-6264ec1d30c1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.156743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1c42cc67-29e1-4a11-9473-6264ec1d30c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cefe0d5fbae4b6ca7578bf08f275bac', 'request_id': 'req-1c42cc67-29e1-4a11-9473-6264ec1d30c1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.165917 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1c42cc67-29e1-4a11-9473-6264ec1d30c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cefe0d5fbae4b6ca7578bf08f275bac', 'request_id': 'req-1c42cc67-29e1-4a11-9473-6264ec1d30c1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.178069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1c42cc67-29e1-4a11-9473-6264ec1d30c1 admin admin] The token cache is being invalidate because project 3cefe0d5fbae4b6ca7578bf08f275bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:29:57.178361 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1c42cc67-29e1-4a11-9473-6264ec1d30c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.179127 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1c42cc67-29e1-4a11-9473-6264ec1d30c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.181013 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1201/2428] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:29:57 2022] DELETE /identity/v3/projects/3cefe0d5fbae4b6ca7578bf08f275bac => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:57.185403 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad083430-1143-43d4-80ed-d38a8efb7904 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:57.186919 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ad083430-1143-43d4-80ed-d38a8efb7904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:57.200963 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad083430-1143-43d4-80ed-d38a8efb7904 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:57.261531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d397b-c1cb-495b-bfb8-677ad77ed1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:57.261714 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d397b-c1cb-495b-bfb8-677ad77ed1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:57.262010 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d397b-c1cb-495b-bfb8-677ad77ed1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:57.262277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d397b-c1cb-495b-bfb8-677ad77ed1b7 admin admin] PATH_INFO: `/v3/users/276e34228e454afba1a20007fb6776e1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:57.276922 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d397b-c1cb-495b-bfb8-677ad77ed1b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=276e34228e454afba1a20007fb6776e1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:57.278893 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d397b-c1cb-495b-bfb8-677ad77ed1b7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:57.318725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:57.328136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1b9d397b-c1cb-495b-bfb8-677ad77ed1b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276e34228e454afba1a20007fb6776e1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.328812 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1b9d397b-c1cb-495b-bfb8-677ad77ed1b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276e34228e454afba1a20007fb6776e1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.335893 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1b9d397b-c1cb-495b-bfb8-677ad77ed1b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276e34228e454afba1a20007fb6776e1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.344022 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1b9d397b-c1cb-495b-bfb8-677ad77ed1b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276e34228e454afba1a20007fb6776e1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.344673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1b9d397b-c1cb-495b-bfb8-677ad77ed1b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276e34228e454afba1a20007fb6776e1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.361887 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1228/2429] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:29:57 2022] DELETE /identity/v3/users/276e34228e454afba1a20007fb6776e1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:29:57.540923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42cc67-29e1-4a11-9473-6264ec1d30c1 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:29:57.542614 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1c42cc67-29e1-4a11-9473-6264ec1d30c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:29:57.557337 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42cc67-29e1-4a11-9473-6264ec1d30c1 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:29:57.617391 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b782e9b-79ee-4db5-9ff0-152857ec73d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:29:57.618296 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b782e9b-79ee-4db5-9ff0-152857ec73d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:29:57.618611 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b782e9b-79ee-4db5-9ff0-152857ec73d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:29:57.618909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b782e9b-79ee-4db5-9ff0-152857ec73d7 admin admin] PATH_INFO: `/v3/projects/63e83d012e1643358b11637c0279658f` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:29:57.630202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b782e9b-79ee-4db5-9ff0-152857ec73d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63e83d012e1643358b11637c0279658f)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:29:57.632201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b782e9b-79ee-4db5-9ff0-152857ec73d7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:29:57.680286 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3b782e9b-79ee-4db5-9ff0-152857ec73d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63e83d012e1643358b11637c0279658f', 'request_id': 'req-3b782e9b-79ee-4db5-9ff0-152857ec73d7'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.684650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:29:57.687112 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3b782e9b-79ee-4db5-9ff0-152857ec73d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63e83d012e1643358b11637c0279658f', 'request_id': 'req-3b782e9b-79ee-4db5-9ff0-152857ec73d7'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.696499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3b782e9b-79ee-4db5-9ff0-152857ec73d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63e83d012e1643358b11637c0279658f', 'request_id': 'req-3b782e9b-79ee-4db5-9ff0-152857ec73d7'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.708667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3b782e9b-79ee-4db5-9ff0-152857ec73d7 admin admin] The token cache is being invalidate because project 63e83d012e1643358b11637c0279658f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:29:57.708951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3b782e9b-79ee-4db5-9ff0-152857ec73d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.709672 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3b782e9b-79ee-4db5-9ff0-152857ec73d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:29:57.711338 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1202/2430] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:29:57 2022] DELETE /identity/v3/projects/63e83d012e1643358b11637c0279658f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:30:07.358645 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=15,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:07.705750 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:DELETE=2,keystone:SELECT=5,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:30:50.068303 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d397b-c1cb-495b-bfb8-677ad77ed1b7 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:30:50.069971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1b9d397b-c1cb-495b-bfb8-677ad77ed1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:50.157390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d397b-c1cb-495b-bfb8-677ad77ed1b7 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:30:50.226414 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7aba4-2cc9-49c0-8d57-c5c67001c778 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:30:50.227054 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7aba4-2cc9-49c0-8d57-c5c67001c778 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:30:50.227350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7aba4-2cc9-49c0-8d57-c5c67001c778 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:30:50.227697 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7aba4-2cc9-49c0-8d57-c5c67001c778 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:30:50.229691 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9bd7aba4-2cc9-49c0-8d57-c5c67001c778 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:30:50.241712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7aba4-2cc9-49c0-8d57-c5c67001c778 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:30:50.243371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7aba4-2cc9-49c0-8d57-c5c67001c778 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:30:50.259217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1229/2431] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:30:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:31:00.254881 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=58 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:31:49.033393 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b782e9b-79ee-4db5-9ff0-152857ec73d7 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:49.034967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3b782e9b-79ee-4db5-9ff0-152857ec73d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:49.102774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b782e9b-79ee-4db5-9ff0-152857ec73d7 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:49.107075 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b96f08-029d-4c08-8bf0-0e721248b1c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:49.107742 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b96f08-029d-4c08-8bf0-0e721248b1c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:49.108018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b96f08-029d-4c08-8bf0-0e721248b1c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:49.108271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b96f08-029d-4c08-8bf0-0e721248b1c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:49.110339 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-22b96f08-029d-4c08-8bf0-0e721248b1c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:49.194605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b96f08-029d-4c08-8bf0-0e721248b1c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:49.196068 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b96f08-029d-4c08-8bf0-0e721248b1c0 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:49.206211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1203/2432] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:31:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:31:49.578831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7aba4-2cc9-49c0-8d57-c5c67001c778 service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:49.580368 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9bd7aba4-2cc9-49c0-8d57-c5c67001c778 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:49.651976 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7aba4-2cc9-49c0-8d57-c5c67001c778 service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:49.656192 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc695f1a-ede6-44f3-818d-4b04fa48feba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:49.656878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc695f1a-ede6-44f3-818d-4b04fa48feba service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:49.657159 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc695f1a-ede6-44f3-818d-4b04fa48feba service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:49.657437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc695f1a-ede6-44f3-818d-4b04fa48feba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:49.659461 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-bc695f1a-ede6-44f3-818d-4b04fa48feba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:49.733093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc695f1a-ede6-44f3-818d-4b04fa48feba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:49.734622 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc695f1a-ede6-44f3-818d-4b04fa48feba service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:49.745437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1230/2433] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:31:53.160418 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b96f08-029d-4c08-8bf0-0e721248b1c0 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:53.161923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-22b96f08-029d-4c08-8bf0-0e721248b1c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:53.178728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b96f08-029d-4c08-8bf0-0e721248b1c0 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:53.186434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f306f-3ea3-4f7e-b22f-5c6387efa264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:53.187506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f306f-3ea3-4f7e-b22f-5c6387efa264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:53.187795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f306f-3ea3-4f7e-b22f-5c6387efa264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:53.188052 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f306f-3ea3-4f7e-b22f-5c6387efa264 admin admin] PATH_INFO: `/v3/users/cef7ac127d2f4284a1808c580148c9e0` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:53.189395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f306f-3ea3-4f7e-b22f-5c6387efa264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef7ac127d2f4284a1808c580148c9e0)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:53.191405 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f306f-3ea3-4f7e-b22f-5c6387efa264 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:53.253488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-789f306f-3ea3-4f7e-b22f-5c6387efa264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef7ac127d2f4284a1808c580148c9e0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:31:53.254205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-789f306f-3ea3-4f7e-b22f-5c6387efa264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef7ac127d2f4284a1808c580148c9e0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:31:53.263517 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-789f306f-3ea3-4f7e-b22f-5c6387efa264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef7ac127d2f4284a1808c580148c9e0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:31:53.277355 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-789f306f-3ea3-4f7e-b22f-5c6387efa264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef7ac127d2f4284a1808c580148c9e0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:31:53.278110 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-789f306f-3ea3-4f7e-b22f-5c6387efa264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef7ac127d2f4284a1808c580148c9e0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:31:53.301844 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1204/2434] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:31:53 2022] DELETE /identity/v3/users/cef7ac127d2f4284a1808c580148c9e0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:31:53.498635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc695f1a-ede6-44f3-818d-4b04fa48feba service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:53.521593 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc695f1a-ede6-44f3-818d-4b04fa48feba service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:53.595888 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b370f1b-9ebf-46cd-b6ce-65b3910d84d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:53.596716 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b370f1b-9ebf-46cd-b6ce-65b3910d84d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:53.596991 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b370f1b-9ebf-46cd-b6ce-65b3910d84d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:53.597256 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b370f1b-9ebf-46cd-b6ce-65b3910d84d9 admin admin] PATH_INFO: `/v3/projects/a23ef70d937643f8a1c8597a8cfac596` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:53.598537 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b370f1b-9ebf-46cd-b6ce-65b3910d84d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23ef70d937643f8a1c8597a8cfac596)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:53.600463 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b370f1b-9ebf-46cd-b6ce-65b3910d84d9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:53.650604 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1b370f1b-9ebf-46cd-b6ce-65b3910d84d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23ef70d937643f8a1c8597a8cfac596', 'request_id': 'req-1b370f1b-9ebf-46cd-b6ce-65b3910d84d9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:31:53.653350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:31:53.660272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1b370f1b-9ebf-46cd-b6ce-65b3910d84d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23ef70d937643f8a1c8597a8cfac596', 'request_id': 'req-1b370f1b-9ebf-46cd-b6ce-65b3910d84d9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:31:53.668072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1b370f1b-9ebf-46cd-b6ce-65b3910d84d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23ef70d937643f8a1c8597a8cfac596', 'request_id': 'req-1b370f1b-9ebf-46cd-b6ce-65b3910d84d9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:31:53.682638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1b370f1b-9ebf-46cd-b6ce-65b3910d84d9 admin admin] The token cache is being invalidate because project a23ef70d937643f8a1c8597a8cfac596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:31:53.682638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1b370f1b-9ebf-46cd-b6ce-65b3910d84d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:31:53.682638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1b370f1b-9ebf-46cd-b6ce-65b3910d84d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:31:53.684823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1231/2435] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:31:53 2022] DELETE /identity/v3/projects/a23ef70d937643f8a1c8597a8cfac596 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:31:53.690697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5de11-c746-4a84-86f7-d9ad97f5b1fe None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:53.691057 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5de11-c746-4a84-86f7-d9ad97f5b1fe None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:53.691324 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5de11-c746-4a84-86f7-d9ad97f5b1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:53.713365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:31:53.761373 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-07e5de11-c746-4a84-86f7-d9ad97f5b1fe None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:31:53.762648 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-07e5de11-c746-4a84-86f7-d9ad97f5b1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:53.826785 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1205/2436] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:31:53.838484 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907aab8-f495-4da4-afb2-b90062fd6445 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:53.838853 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907aab8-f495-4da4-afb2-b90062fd6445 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:53.839021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907aab8-f495-4da4-afb2-b90062fd6445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:53.862894 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-2907aab8-f495-4da4-afb2-b90062fd6445 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:31:53.864003 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2907aab8-f495-4da4-afb2-b90062fd6445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:53.874716 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1232/2437] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:31:53.879228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5de11-c746-4a84-86f7-d9ad97f5b1fe None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:53.891297 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5de11-c746-4a84-86f7-d9ad97f5b1fe None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:53.897136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83e462-d71a-4ebf-8fe4-d517bdca3820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:53.897886 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83e462-d71a-4ebf-8fe4-d517bdca3820 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:53.898297 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83e462-d71a-4ebf-8fe4-d517bdca3820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:53.898669 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83e462-d71a-4ebf-8fe4-d517bdca3820 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:53.899507 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83e462-d71a-4ebf-8fe4-d517bdca3820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:31:53.899951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83e462-d71a-4ebf-8fe4-d517bdca3820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:53.901720 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83e462-d71a-4ebf-8fe4-d517bdca3820 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:53.917210 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1206/2438] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:31:53.922298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907aab8-f495-4da4-afb2-b90062fd6445 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:53.934705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907aab8-f495-4da4-afb2-b90062fd6445 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:53.940691 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272858e1-3e73-4f5e-8e81-f90807faf4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:53.941368 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272858e1-3e73-4f5e-8e81-f90807faf4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:53.941646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272858e1-3e73-4f5e-8e81-f90807faf4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:53.941949 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272858e1-3e73-4f5e-8e81-f90807faf4e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:53.942648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272858e1-3e73-4f5e-8e81-f90807faf4e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:53.944580 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272858e1-3e73-4f5e-8e81-f90807faf4e7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:53.993437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1233/2439] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:31:53 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:31:53.997828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83e462-d71a-4ebf-8fe4-d517bdca3820 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:54.017242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83e462-d71a-4ebf-8fe4-d517bdca3820 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:54.083449 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0a069-f3d9-4d15-9058-d04809e66f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:54.084138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0a069-f3d9-4d15-9058-d04809e66f9c admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:54.084422 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0a069-f3d9-4d15-9058-d04809e66f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:54.084974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0a069-f3d9-4d15-9058-d04809e66f9c admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:54.085688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0a069-f3d9-4d15-9058-d04809e66f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:54.087678 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0a069-f3d9-4d15-9058-d04809e66f9c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:54.110591 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1207/2440] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:31:53 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:31:54.115075 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272858e1-3e73-4f5e-8e81-f90807faf4e7 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:54.128826 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272858e1-3e73-4f5e-8e81-f90807faf4e7 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:54.135066 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09742b86-f496-432a-9727-fd15757012cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:54.136045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09742b86-f496-432a-9727-fd15757012cf admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:54.136326 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09742b86-f496-432a-9727-fd15757012cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:54.136648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09742b86-f496-432a-9727-fd15757012cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:54.137761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09742b86-f496-432a-9727-fd15757012cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:54.139899 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09742b86-f496-432a-9727-fd15757012cf admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:54.158657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1234/2441] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:31:54.163157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0a069-f3d9-4d15-9058-d04809e66f9c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:54.173915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0a069-f3d9-4d15-9058-d04809e66f9c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:54.178599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2788624-2cd6-4af7-a8fe-574c411b3fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:54.179278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2788624-2cd6-4af7-a8fe-574c411b3fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:54.179559 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2788624-2cd6-4af7-a8fe-574c411b3fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:54.179833 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2788624-2cd6-4af7-a8fe-574c411b3fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:54.180559 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2788624-2cd6-4af7-a8fe-574c411b3fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:54.182579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2788624-2cd6-4af7-a8fe-574c411b3fc6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:54.193625 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1208/2442] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:31:54.198068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09742b86-f496-432a-9727-fd15757012cf admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:54.209095 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09742b86-f496-432a-9727-fd15757012cf admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:54.214566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ad575-3c24-4a30-a9a2-17fd13b31ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:54.215463 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ad575-3c24-4a30-a9a2-17fd13b31ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:54.215741 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ad575-3c24-4a30-a9a2-17fd13b31ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:54.216013 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ad575-3c24-4a30-a9a2-17fd13b31ec1 admin admin] PATH_INFO: `/v3/projects/bb2b3fd3c2a547539c6566001d54b993/users/2d13ad6375894af5b44db578f41f19df/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:54.234995 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ad575-3c24-4a30-a9a2-17fd13b31ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2b3fd3c2a547539c6566001d54b993, user_id=2d13ad6375894af5b44db578f41f19df, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:54.237730 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ad575-3c24-4a30-a9a2-17fd13b31ec1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:54.255823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1235/2443] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:31:54 2022] PUT /identity/v3/projects/bb2b3fd3c2a547539c6566001d54b993/users/2d13ad6375894af5b44db578f41f19df/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:31:54.266826 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fda4a-aabd-4939-98d5-c399d1fb06f3 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:54.267091 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fda4a-aabd-4939-98d5-c399d1fb06f3 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:54.267372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fda4a-aabd-4939-98d5-c399d1fb06f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:54.300714 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0d8fda4a-aabd-4939-98d5-c399d1fb06f3 None None] MFA Rules not processed for user `2d13ad6375894af5b44db578f41f19df`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:31:54.302072 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0d8fda4a-aabd-4939-98d5-c399d1fb06f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:54.347800 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:31:54.377744 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1209/2444] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:31:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:31:54.383431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ad575-3c24-4a30-a9a2-17fd13b31ec1 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:54.452527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ad575-3c24-4a30-a9a2-17fd13b31ec1 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:54.459294 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72f05a-90d9-4858-98ce-05a698d591b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:54.459964 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72f05a-90d9-4858-98ce-05a698d591b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:54.460242 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72f05a-90d9-4858-98ce-05a698d591b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:54.460545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72f05a-90d9-4858-98ce-05a698d591b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:54.461241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72f05a-90d9-4858-98ce-05a698d591b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:54.463207 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72f05a-90d9-4858-98ce-05a698d591b4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:54.493620 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1236/2445] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:31:54 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:31:54.497755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fda4a-aabd-4939-98d5-c399d1fb06f3 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:54.510399 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fda4a-aabd-4939-98d5-c399d1fb06f3 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:54.580428 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce9b12-2db3-4dd6-a08e-902d81755f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:54.580946 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce9b12-2db3-4dd6-a08e-902d81755f1b admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:54.581226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce9b12-2db3-4dd6-a08e-902d81755f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:54.581495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce9b12-2db3-4dd6-a08e-902d81755f1b admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:54.582237 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce9b12-2db3-4dd6-a08e-902d81755f1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:54.584304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce9b12-2db3-4dd6-a08e-902d81755f1b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:54.606023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1210/2446] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:31:54 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:31:54.611251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72f05a-90d9-4858-98ce-05a698d591b4 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:54.627209 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72f05a-90d9-4858-98ce-05a698d591b4 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:54.632324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ba8bb-65ae-4130-959c-a6f304415ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:54.633003 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ba8bb-65ae-4130-959c-a6f304415ffa admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:54.633283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ba8bb-65ae-4130-959c-a6f304415ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:54.633693 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ba8bb-65ae-4130-959c-a6f304415ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:54.634464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ba8bb-65ae-4130-959c-a6f304415ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:54.636107 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ba8bb-65ae-4130-959c-a6f304415ffa admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:54.649603 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1237/2447] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:31:54.654163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce9b12-2db3-4dd6-a08e-902d81755f1b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:54.665617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce9b12-2db3-4dd6-a08e-902d81755f1b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:54.670784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc0db9-f099-451b-ade3-39f751b34be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:54.671795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc0db9-f099-451b-ade3-39f751b34be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:54.672103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc0db9-f099-451b-ade3-39f751b34be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:54.672459 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc0db9-f099-451b-ade3-39f751b34be6 admin admin] PATH_INFO: `/v3/projects/cc22961646cc474e98e15e0669ddb85b/users/915d9aa1c31247a9b8cdf0e627546aa0/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:54.689243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc0db9-f099-451b-ade3-39f751b34be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc22961646cc474e98e15e0669ddb85b, user_id=915d9aa1c31247a9b8cdf0e627546aa0, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:54.691998 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc0db9-f099-451b-ade3-39f751b34be6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:54.709812 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1211/2448] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:31:54 2022] PUT /identity/v3/projects/cc22961646cc474e98e15e0669ddb85b/users/915d9aa1c31247a9b8cdf0e627546aa0/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:31:54.714168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ba8bb-65ae-4130-959c-a6f304415ffa admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:54.726490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ba8bb-65ae-4130-959c-a6f304415ffa admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:54.770665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:31:54.789781 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acf9e7-21a9-4e68-9297-d2df0e308c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:54.790503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acf9e7-21a9-4e68-9297-d2df0e308c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:54.790780 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acf9e7-21a9-4e68-9297-d2df0e308c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:54.791054 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acf9e7-21a9-4e68-9297-d2df0e308c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:54.791789 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acf9e7-21a9-4e68-9297-d2df0e308c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:54.793465 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acf9e7-21a9-4e68-9297-d2df0e308c68 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:54.804601 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1238/2449] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:31:54.809452 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc0db9-f099-451b-ade3-39f751b34be6 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:31:54.821503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc0db9-f099-451b-ade3-39f751b34be6 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:31:54.827138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52570a70-9c38-49f2-b735-a1bc50ce2ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:31:54.828307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52570a70-9c38-49f2-b735-a1bc50ce2ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:54.828622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52570a70-9c38-49f2-b735-a1bc50ce2ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:54.829057 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52570a70-9c38-49f2-b735-a1bc50ce2ff7 admin admin] PATH_INFO: `/v3/projects/cc22961646cc474e98e15e0669ddb85b/users/915d9aa1c31247a9b8cdf0e627546aa0/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:54.831136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52570a70-9c38-49f2-b735-a1bc50ce2ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc22961646cc474e98e15e0669ddb85b, user_id=915d9aa1c31247a9b8cdf0e627546aa0, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:31:54.833856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52570a70-9c38-49f2-b735-a1bc50ce2ff7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:31:54.846783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1212/2450] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:31:54 2022] PUT /identity/v3/projects/cc22961646cc474e98e15e0669ddb85b/users/915d9aa1c31247a9b8cdf0e627546aa0/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:31:54.857469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e89ca-2f91-481d-94fa-8f413056f9b7 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:31:54.857745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e89ca-2f91-481d-94fa-8f413056f9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:31:54.858136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e89ca-2f91-481d-94fa-8f413056f9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:31:54.892757 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c08e89ca-2f91-481d-94fa-8f413056f9b7 None None] MFA Rules not processed for user `915d9aa1c31247a9b8cdf0e627546aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:31:54.893931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c08e89ca-2f91-481d-94fa-8f413056f9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:31:54.970038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1239/2451] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:31:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:04.842148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=53,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:04.965211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=44 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:55.028008 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52570a70-9c38-49f2-b735-a1bc50ce2ff7 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:55.094413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52570a70-9c38-49f2-b735-a1bc50ce2ff7 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:55.099637 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04531547-1a10-4425-b481-b4aa423a614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:55.100516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04531547-1a10-4425-b481-b4aa423a614e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:55.100784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04531547-1a10-4425-b481-b4aa423a614e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:55.101071 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04531547-1a10-4425-b481-b4aa423a614e admin admin] PATH_INFO: `/v3/users/2d13ad6375894af5b44db578f41f19df` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:55.102320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04531547-1a10-4425-b481-b4aa423a614e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d13ad6375894af5b44db578f41f19df)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:55.104329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04531547-1a10-4425-b481-b4aa423a614e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:55.153447 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-04531547-1a10-4425-b481-b4aa423a614e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d13ad6375894af5b44db578f41f19df'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:55.154114 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-04531547-1a10-4425-b481-b4aa423a614e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d13ad6375894af5b44db578f41f19df'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:55.161478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-04531547-1a10-4425-b481-b4aa423a614e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d13ad6375894af5b44db578f41f19df'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:55.174999 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-04531547-1a10-4425-b481-b4aa423a614e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d13ad6375894af5b44db578f41f19df'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:55.175745 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-04531547-1a10-4425-b481-b4aa423a614e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d13ad6375894af5b44db578f41f19df'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:55.191288 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1213/2452] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:32:55 2022] DELETE /identity/v3/users/2d13ad6375894af5b44db578f41f19df => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:55.196036 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999b4ac-e588-44ca-9af9-5a1be99d1da8 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:55.196586 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999b4ac-e588-44ca-9af9-5a1be99d1da8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:55.196709 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999b4ac-e588-44ca-9af9-5a1be99d1da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:55.215080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a999b4ac-e588-44ca-9af9-5a1be99d1da8 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:55.216298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a999b4ac-e588-44ca-9af9-5a1be99d1da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:55.279395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1240/2453] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:55.289492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04531547-1a10-4425-b481-b4aa423a614e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:55.291182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-04531547-1a10-4425-b481-b4aa423a614e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:55.350743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04531547-1a10-4425-b481-b4aa423a614e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:55.354527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137e53c-766a-4677-9521-aafb5bcccadb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:55.355186 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137e53c-766a-4677-9521-aafb5bcccadb service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:55.355493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137e53c-766a-4677-9521-aafb5bcccadb service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:55.355768 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137e53c-766a-4677-9521-aafb5bcccadb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:55.365740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137e53c-766a-4677-9521-aafb5bcccadb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:55.367219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137e53c-766a-4677-9521-aafb5bcccadb service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:55.376964 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1214/2454] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:32:55.680858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999b4ac-e588-44ca-9af9-5a1be99d1da8 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:55.682422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a999b4ac-e588-44ca-9af9-5a1be99d1da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:55.695789 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999b4ac-e588-44ca-9af9-5a1be99d1da8 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:55.701610 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20989ec8-d3d6-4962-aa43-70ed399b3957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:55.702526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20989ec8-d3d6-4962-aa43-70ed399b3957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:55.702803 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20989ec8-d3d6-4962-aa43-70ed399b3957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:55.703085 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20989ec8-d3d6-4962-aa43-70ed399b3957 admin admin] PATH_INFO: `/v3/projects/bb2b3fd3c2a547539c6566001d54b993` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:55.704427 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20989ec8-d3d6-4962-aa43-70ed399b3957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb2b3fd3c2a547539c6566001d54b993)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:55.706633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20989ec8-d3d6-4962-aa43-70ed399b3957 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:55.764656 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-20989ec8-d3d6-4962-aa43-70ed399b3957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb2b3fd3c2a547539c6566001d54b993', 'request_id': 'req-20989ec8-d3d6-4962-aa43-70ed399b3957'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:55.774435 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-20989ec8-d3d6-4962-aa43-70ed399b3957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb2b3fd3c2a547539c6566001d54b993', 'request_id': 'req-20989ec8-d3d6-4962-aa43-70ed399b3957'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:55.784794 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-20989ec8-d3d6-4962-aa43-70ed399b3957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb2b3fd3c2a547539c6566001d54b993', 'request_id': 'req-20989ec8-d3d6-4962-aa43-70ed399b3957'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:55.796622 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-20989ec8-d3d6-4962-aa43-70ed399b3957 admin admin] The token cache is being invalidate because project bb2b3fd3c2a547539c6566001d54b993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:32:55.796852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-20989ec8-d3d6-4962-aa43-70ed399b3957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:55.797481 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-20989ec8-d3d6-4962-aa43-70ed399b3957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:55.799140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1241/2455] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:32:55 2022] DELETE /identity/v3/projects/bb2b3fd3c2a547539c6566001d54b993 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:55.803257 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137e53c-766a-4677-9521-aafb5bcccadb service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:55.813963 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137e53c-766a-4677-9521-aafb5bcccadb service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:55.836235 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:55.878818 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c827da-a066-4482-9e3e-650ded56efe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:55.879714 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c827da-a066-4482-9e3e-650ded56efe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:55.879994 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c827da-a066-4482-9e3e-650ded56efe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:55.880266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c827da-a066-4482-9e3e-650ded56efe5 admin admin] PATH_INFO: `/v3/users/915d9aa1c31247a9b8cdf0e627546aa0` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:55.881525 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c827da-a066-4482-9e3e-650ded56efe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=915d9aa1c31247a9b8cdf0e627546aa0)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:55.883537 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c827da-a066-4482-9e3e-650ded56efe5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:55.938080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-47c827da-a066-4482-9e3e-650ded56efe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '915d9aa1c31247a9b8cdf0e627546aa0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:55.938727 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-47c827da-a066-4482-9e3e-650ded56efe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '915d9aa1c31247a9b8cdf0e627546aa0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:55.946314 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-47c827da-a066-4482-9e3e-650ded56efe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '915d9aa1c31247a9b8cdf0e627546aa0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:55.959291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-47c827da-a066-4482-9e3e-650ded56efe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '915d9aa1c31247a9b8cdf0e627546aa0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:55.959978 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-47c827da-a066-4482-9e3e-650ded56efe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '915d9aa1c31247a9b8cdf0e627546aa0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:55.974617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1215/2456] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:32:55 2022] DELETE /identity/v3/users/915d9aa1c31247a9b8cdf0e627546aa0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:56.277932 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20989ec8-d3d6-4962-aa43-70ed399b3957 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:56.279814 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-20989ec8-d3d6-4962-aa43-70ed399b3957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:56.299757 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20989ec8-d3d6-4962-aa43-70ed399b3957 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:56.374802 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d9f12-b37f-4eb1-8136-7a3ae489a24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:56.375769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d9f12-b37f-4eb1-8136-7a3ae489a24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:56.376123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d9f12-b37f-4eb1-8136-7a3ae489a24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:56.376477 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d9f12-b37f-4eb1-8136-7a3ae489a24e admin admin] PATH_INFO: `/v3/projects/cc22961646cc474e98e15e0669ddb85b` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:56.378250 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d9f12-b37f-4eb1-8136-7a3ae489a24e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc22961646cc474e98e15e0669ddb85b)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:56.380941 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d9f12-b37f-4eb1-8136-7a3ae489a24e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:56.416359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:56.441069 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-853d9f12-b37f-4eb1-8136-7a3ae489a24e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc22961646cc474e98e15e0669ddb85b', 'request_id': 'req-853d9f12-b37f-4eb1-8136-7a3ae489a24e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:56.452820 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-853d9f12-b37f-4eb1-8136-7a3ae489a24e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc22961646cc474e98e15e0669ddb85b', 'request_id': 'req-853d9f12-b37f-4eb1-8136-7a3ae489a24e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:56.460425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-853d9f12-b37f-4eb1-8136-7a3ae489a24e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc22961646cc474e98e15e0669ddb85b', 'request_id': 'req-853d9f12-b37f-4eb1-8136-7a3ae489a24e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:56.472571 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-853d9f12-b37f-4eb1-8136-7a3ae489a24e admin admin] The token cache is being invalidate because project cc22961646cc474e98e15e0669ddb85b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:32:56.472855 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-853d9f12-b37f-4eb1-8136-7a3ae489a24e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:56.473593 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-853d9f12-b37f-4eb1-8136-7a3ae489a24e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:32:56.475274 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1242/2457] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:32:56 2022] DELETE /identity/v3/projects/cc22961646cc474e98e15e0669ddb85b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:56.480961 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa8896-872b-4860-8de8-73dd1e3620c5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:56.481494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa8896-872b-4860-8de8-73dd1e3620c5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:56.481494 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa8896-872b-4860-8de8-73dd1e3620c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:56.500226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0afa8896-872b-4860-8de8-73dd1e3620c5 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:56.501419 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0afa8896-872b-4860-8de8-73dd1e3620c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:56.562436 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1216/2458] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:56.572306 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdddc38-daf1-4b8d-b475-2a90f7291277 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:56.572593 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdddc38-daf1-4b8d-b475-2a90f7291277 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:56.572868 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdddc38-daf1-4b8d-b475-2a90f7291277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:56.593855 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-0cdddc38-daf1-4b8d-b475-2a90f7291277 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:56.595106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-0cdddc38-daf1-4b8d-b475-2a90f7291277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:56.603839 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1243/2459] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:32:56.608336 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa8896-872b-4860-8de8-73dd1e3620c5 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:56.618452 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa8896-872b-4860-8de8-73dd1e3620c5 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:56.623479 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633e6f6-b0f8-410f-b4a8-d64c476ff056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:56.624131 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633e6f6-b0f8-410f-b4a8-d64c476ff056 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:56.624414 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633e6f6-b0f8-410f-b4a8-d64c476ff056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:56.624783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633e6f6-b0f8-410f-b4a8-d64c476ff056 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:56.625585 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633e6f6-b0f8-410f-b4a8-d64c476ff056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:32:56.625870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633e6f6-b0f8-410f-b4a8-d64c476ff056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:56.627559 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633e6f6-b0f8-410f-b4a8-d64c476ff056 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:56.639420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1217/2460] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:32:56.643992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdddc38-daf1-4b8d-b475-2a90f7291277 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:56.654905 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdddc38-daf1-4b8d-b475-2a90f7291277 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:56.661395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab92501-c97e-4978-8379-1a929bdf50df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:56.662210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab92501-c97e-4978-8379-1a929bdf50df admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:56.662504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab92501-c97e-4978-8379-1a929bdf50df admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:56.662816 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab92501-c97e-4978-8379-1a929bdf50df admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:56.663636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab92501-c97e-4978-8379-1a929bdf50df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:56.665983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab92501-c97e-4978-8379-1a929bdf50df admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:56.697890 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1244/2461] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:32:56 2022] POST /identity/v3/projects => generated 355 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:56.702551 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633e6f6-b0f8-410f-b4a8-d64c476ff056 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:56.721532 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633e6f6-b0f8-410f-b4a8-d64c476ff056 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:56.756915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:56.792786 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a9a39-0c5d-4918-96a0-7cb50ed59596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:56.793466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a9a39-0c5d-4918-96a0-7cb50ed59596 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:56.793744 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a9a39-0c5d-4918-96a0-7cb50ed59596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:56.794047 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a9a39-0c5d-4918-96a0-7cb50ed59596 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:56.794747 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a9a39-0c5d-4918-96a0-7cb50ed59596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:56.796681 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a9a39-0c5d-4918-96a0-7cb50ed59596 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:56.818690 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1218/2462] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:32:56 2022] POST /identity/v3/users => generated 278 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:56.823455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab92501-c97e-4978-8379-1a929bdf50df admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:56.838199 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab92501-c97e-4978-8379-1a929bdf50df admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:56.844323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d38ab-8d5d-4052-902c-e211da3feae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:56.845110 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d38ab-8d5d-4052-902c-e211da3feae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:56.845412 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d38ab-8d5d-4052-902c-e211da3feae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:56.845895 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d38ab-8d5d-4052-902c-e211da3feae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:56.846941 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d38ab-8d5d-4052-902c-e211da3feae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:56.849039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d38ab-8d5d-4052-902c-e211da3feae2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:56.863273 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1245/2463] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:56.867520 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a9a39-0c5d-4918-96a0-7cb50ed59596 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:56.879385 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a9a39-0c5d-4918-96a0-7cb50ed59596 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:56.885383 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb811bb-fddb-454e-8f48-6fe0e266f2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:56.886093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb811bb-fddb-454e-8f48-6fe0e266f2ef admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:56.886371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb811bb-fddb-454e-8f48-6fe0e266f2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:56.886643 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb811bb-fddb-454e-8f48-6fe0e266f2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:56.887362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb811bb-fddb-454e-8f48-6fe0e266f2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:56.889010 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb811bb-fddb-454e-8f48-6fe0e266f2ef admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:56.900242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1219/2464] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:56.904792 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d38ab-8d5d-4052-902c-e211da3feae2 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:56.915218 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d38ab-8d5d-4052-902c-e211da3feae2 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:56.920573 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6c546-281e-4bd9-9dcc-8dfb71ad8e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:56.921461 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6c546-281e-4bd9-9dcc-8dfb71ad8e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:56.921739 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6c546-281e-4bd9-9dcc-8dfb71ad8e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:56.922045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6c546-281e-4bd9-9dcc-8dfb71ad8e20 admin admin] PATH_INFO: `/v3/projects/d5420da5230c4c3b8b0789ea3d205012/users/cd7260099aed4f1bb126dcf9f01fe2a9/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:56.938372 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6c546-281e-4bd9-9dcc-8dfb71ad8e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5420da5230c4c3b8b0789ea3d205012, user_id=cd7260099aed4f1bb126dcf9f01fe2a9, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:56.941116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6c546-281e-4bd9-9dcc-8dfb71ad8e20 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:56.957111 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1246/2465] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:56 2022] PUT /identity/v3/projects/d5420da5230c4c3b8b0789ea3d205012/users/cd7260099aed4f1bb126dcf9f01fe2a9/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:32:56.967951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b78dd8-5c09-41eb-97f4-6587e2f170f9 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:56.968597 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b78dd8-5c09-41eb-97f4-6587e2f170f9 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:56.968976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b78dd8-5c09-41eb-97f4-6587e2f170f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:56.996451 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a4b78dd8-5c09-41eb-97f4-6587e2f170f9 None None] MFA Rules not processed for user `cd7260099aed4f1bb126dcf9f01fe2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:56.997657 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a4b78dd8-5c09-41eb-97f4-6587e2f170f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:57.065411 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1220/2466] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:32:56 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:32:57.070278 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6c546-281e-4bd9-9dcc-8dfb71ad8e20 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:57.143328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6c546-281e-4bd9-9dcc-8dfb71ad8e20 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:57.149337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de4d70-428e-4689-bccb-dac48737f395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:57.150156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de4d70-428e-4689-bccb-dac48737f395 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:57.150503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de4d70-428e-4689-bccb-dac48737f395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:57.150828 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de4d70-428e-4689-bccb-dac48737f395 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:57.151668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de4d70-428e-4689-bccb-dac48737f395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:57.154047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de4d70-428e-4689-bccb-dac48737f395 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:57.186789 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1247/2467] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:32:57 2022] POST /identity/v3/projects => generated 355 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:57.192532 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b78dd8-5c09-41eb-97f4-6587e2f170f9 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:57.204035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b78dd8-5c09-41eb-97f4-6587e2f170f9 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:57.267171 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b80402-4457-43fb-b03b-90470deb5f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:57.267995 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b80402-4457-43fb-b03b-90470deb5f4d admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:57.268355 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b80402-4457-43fb-b03b-90470deb5f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:57.268684 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b80402-4457-43fb-b03b-90470deb5f4d admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:57.269488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b80402-4457-43fb-b03b-90470deb5f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:57.271623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b80402-4457-43fb-b03b-90470deb5f4d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:57.297170 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1221/2468] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:32:57 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:32:57.301823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de4d70-428e-4689-bccb-dac48737f395 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:57.313170 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de4d70-428e-4689-bccb-dac48737f395 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:57.318814 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bce98-bbf2-4c35-bb16-cb5a2c0a7b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:57.319512 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bce98-bbf2-4c35-bb16-cb5a2c0a7b7e admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:57.319760 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bce98-bbf2-4c35-bb16-cb5a2c0a7b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:57.320034 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bce98-bbf2-4c35-bb16-cb5a2c0a7b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:57.320764 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bce98-bbf2-4c35-bb16-cb5a2c0a7b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:57.322405 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bce98-bbf2-4c35-bb16-cb5a2c0a7b7e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:57.334485 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1248/2469] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:32:57.339033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b80402-4457-43fb-b03b-90470deb5f4d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:57.350278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b80402-4457-43fb-b03b-90470deb5f4d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:57.355426 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390231b1-c36c-46a0-a5a2-8cf11deba15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:57.356353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390231b1-c36c-46a0-a5a2-8cf11deba15c admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:57.356631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390231b1-c36c-46a0-a5a2-8cf11deba15c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:57.356905 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390231b1-c36c-46a0-a5a2-8cf11deba15c admin admin] PATH_INFO: `/v3/projects/449d8872c1fc4b9495d979ea2fe931ec/users/e52a8bb8b9a64b3097ba2d361d3f30d3/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:57.372556 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390231b1-c36c-46a0-a5a2-8cf11deba15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=449d8872c1fc4b9495d979ea2fe931ec, user_id=e52a8bb8b9a64b3097ba2d361d3f30d3, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:57.375271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390231b1-c36c-46a0-a5a2-8cf11deba15c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:57.389619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1222/2470] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:57 2022] PUT /identity/v3/projects/449d8872c1fc4b9495d979ea2fe931ec/users/e52a8bb8b9a64b3097ba2d361d3f30d3/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:57.393880 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bce98-bbf2-4c35-bb16-cb5a2c0a7b7e admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:57.405849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bce98-bbf2-4c35-bb16-cb5a2c0a7b7e admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:57.427083 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:57.471003 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f827198-b49d-4981-84ec-9d2ee90d97ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:57.471731 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f827198-b49d-4981-84ec-9d2ee90d97ea admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:57.471982 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f827198-b49d-4981-84ec-9d2ee90d97ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:57.472258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f827198-b49d-4981-84ec-9d2ee90d97ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:57.472982 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f827198-b49d-4981-84ec-9d2ee90d97ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:57.474636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f827198-b49d-4981-84ec-9d2ee90d97ea admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:57.486030 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1249/2471] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:32:57.490618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390231b1-c36c-46a0-a5a2-8cf11deba15c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:32:57.496468 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:32:57.503449 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390231b1-c36c-46a0-a5a2-8cf11deba15c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:32:57.509521 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d7512-9c5a-43aa-b12f-a6460f317fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:32:57.510819 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d7512-9c5a-43aa-b12f-a6460f317fda admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:57.511100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d7512-9c5a-43aa-b12f-a6460f317fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:57.511373 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d7512-9c5a-43aa-b12f-a6460f317fda admin admin] PATH_INFO: `/v3/projects/449d8872c1fc4b9495d979ea2fe931ec/users/e52a8bb8b9a64b3097ba2d361d3f30d3/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:57.513396 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d7512-9c5a-43aa-b12f-a6460f317fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=449d8872c1fc4b9495d979ea2fe931ec, user_id=e52a8bb8b9a64b3097ba2d361d3f30d3, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:32:57.516143 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d7512-9c5a-43aa-b12f-a6460f317fda admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:32:57.527239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1223/2472] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:32:57 2022] PUT /identity/v3/projects/449d8872c1fc4b9495d979ea2fe931ec/users/e52a8bb8b9a64b3097ba2d361d3f30d3/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:32:57.539546 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1554a9-0ef9-49c1-a72e-3bde8ed2116c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:32:57.539978 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1554a9-0ef9-49c1-a72e-3bde8ed2116c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:32:57.540370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1554a9-0ef9-49c1-a72e-3bde8ed2116c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:32:57.582466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-eb1554a9-0ef9-49c1-a72e-3bde8ed2116c None None] MFA Rules not processed for user `e52a8bb8b9a64b3097ba2d361d3f30d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:32:57.583734 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-eb1554a9-0ef9-49c1-a72e-3bde8ed2116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:32:57.660664 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1250/2473] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:32:57 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:07.523381 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=4,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:07.657377 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=52 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:40.792404 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d7512-9c5a-43aa-b12f-a6460f317fda admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:40.794216 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e17d7512-9c5a-43aa-b12f-a6460f317fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:40.872821 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d7512-9c5a-43aa-b12f-a6460f317fda admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:40.876692 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9c4e1-b901-4c0c-804e-b22e27b324fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:40.877352 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9c4e1-b901-4c0c-804e-b22e27b324fc service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:40.877637 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9c4e1-b901-4c0c-804e-b22e27b324fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:40.877987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9c4e1-b901-4c0c-804e-b22e27b324fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:40.879965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-79c9c4e1-b901-4c0c-804e-b22e27b324fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:40.890642 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9c4e1-b901-4c0c-804e-b22e27b324fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:40.892102 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9c4e1-b901-4c0c-804e-b22e27b324fc service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:40.901473 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1224/2474] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:33:49.575659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1554a9-0ef9-49c1-a72e-3bde8ed2116c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:49.577197 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-eb1554a9-0ef9-49c1-a72e-3bde8ed2116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:49.642839 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1554a9-0ef9-49c1-a72e-3bde8ed2116c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:49.648784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60444f4-b9ed-489c-99c5-51a42d8a3891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:49.649700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60444f4-b9ed-489c-99c5-51a42d8a3891 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:49.650123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60444f4-b9ed-489c-99c5-51a42d8a3891 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:49.650503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60444f4-b9ed-489c-99c5-51a42d8a3891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:49.653202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f60444f4-b9ed-489c-99c5-51a42d8a3891 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:49.686408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-f60444f4-b9ed-489c-99c5-51a42d8a3891 service cinder] Could not find project: cc22961646cc474e98e15e0669ddb85b.: keystone.exception.ProjectNotFound: Could not find project: cc22961646cc474e98e15e0669ddb85b. Jun 02 19:33:49.686408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:33:49.686408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:33:49.686408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:33:49.686408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:33:49.686408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:33:49.686408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:33:49.686408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:33:49.686408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:33:49.686408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:33:49.686408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:33:49.686408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:33:49.686408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jun 02 19:33:49.686408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jun 02 19:33:49.686408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 02 19:33:49.687615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 02 19:33:49.687615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 02 19:33:49.687615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 02 19:33:49.687615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:33:49.687615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:33:49.687615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jun 02 19:33:49.687615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jun 02 19:33:49.687615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:33:49.687615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:33:49.687615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:33:49.687615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:33:49.687615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:33:49.687615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 19:33:49.687615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:33:49.687615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:33:49.687615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:33:49.687615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:33:49.689123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:33:49.689123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:33:49.689123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:33:49.689123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:33:49.689123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jun 02 19:33:49.689123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jun 02 19:33:49.689123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jun 02 19:33:49.689123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._validate_token_resources() Jun 02 19:33:49.689123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jun 02 19:33:49.689123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jun 02 19:33:49.689123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jun 02 19:33:49.689123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jun 02 19:33:49.689123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:33:49.689123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:33:49.689123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:33:49.689123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:33:49.689123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:33:49.691062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:33:49.691062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:33:49.691062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 19:33:49.691062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:33:49.691062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:33:49.691062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:33:49.691062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:33:49.691062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:33:49.691062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:33:49.691062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:33:49.691062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:33:49.691062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:33:49.691062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:33:49.691062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:33:49.691062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:33:49.691062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:33:49.691062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:33:49.693026 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: cc22961646cc474e98e15e0669ddb85b. Jun 02 19:33:49.693026 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 19:33:49.693026 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1251/2475] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:49 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 02 19:33:49.723994 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9c4e1-b901-4c0c-804e-b22e27b324fc service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:49.745070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9c4e1-b901-4c0c-804e-b22e27b324fc service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:49.749245 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c66fb-cc9b-4874-b339-df0a88c15b22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:49.750140 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c66fb-cc9b-4874-b339-df0a88c15b22 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:49.750530 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c66fb-cc9b-4874-b339-df0a88c15b22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:49.750969 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c66fb-cc9b-4874-b339-df0a88c15b22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:49.792143 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c66fb-cc9b-4874-b339-df0a88c15b22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:49.792143 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c66fb-cc9b-4874-b339-df0a88c15b22 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:49.793954 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60444f4-b9ed-489c-99c5-51a42d8a3891 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:49.795429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f60444f4-b9ed-489c-99c5-51a42d8a3891 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:49.804586 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1225/2476] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:49 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:33:49.808263 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60444f4-b9ed-489c-99c5-51a42d8a3891 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:49.812114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7bd52-5839-48fd-83a7-3386fcd8e36c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:49.812775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7bd52-5839-48fd-83a7-3386fcd8e36c service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:49.813058 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7bd52-5839-48fd-83a7-3386fcd8e36c service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:49.813428 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7bd52-5839-48fd-83a7-3386fcd8e36c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:49.815476 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e6a7bd52-5839-48fd-83a7-3386fcd8e36c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:49.916999 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7bd52-5839-48fd-83a7-3386fcd8e36c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:49.918512 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7bd52-5839-48fd-83a7-3386fcd8e36c service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:49.941551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1252/2477] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:33:53.427869 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c66fb-cc9b-4874-b339-df0a88c15b22 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:53.429741 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-fa6c66fb-cc9b-4874-b339-df0a88c15b22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:53.443902 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c66fb-cc9b-4874-b339-df0a88c15b22 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:53.448782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c875c5e-909d-41e1-bb44-87f3864728a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:53.449671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c875c5e-909d-41e1-bb44-87f3864728a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:53.450012 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c875c5e-909d-41e1-bb44-87f3864728a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:53.450289 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c875c5e-909d-41e1-bb44-87f3864728a3 admin admin] PATH_INFO: `/v3/users/4a660a47927140d6b4d0543de5e281a1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:53.451493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c875c5e-909d-41e1-bb44-87f3864728a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a660a47927140d6b4d0543de5e281a1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:53.453469 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c875c5e-909d-41e1-bb44-87f3864728a3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:53.502282 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1c875c5e-909d-41e1-bb44-87f3864728a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a660a47927140d6b4d0543de5e281a1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:53.502967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1c875c5e-909d-41e1-bb44-87f3864728a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a660a47927140d6b4d0543de5e281a1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:53.510545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1c875c5e-909d-41e1-bb44-87f3864728a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a660a47927140d6b4d0543de5e281a1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:53.525839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1c875c5e-909d-41e1-bb44-87f3864728a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a660a47927140d6b4d0543de5e281a1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:53.526613 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1c875c5e-909d-41e1-bb44-87f3864728a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a660a47927140d6b4d0543de5e281a1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:53.541543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1226/2478] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:33:53 2022] DELETE /identity/v3/users/4a660a47927140d6b4d0543de5e281a1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:53.732831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7bd52-5839-48fd-83a7-3386fcd8e36c service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:53.746213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7bd52-5839-48fd-83a7-3386fcd8e36c service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:53.806785 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ab923-f3da-49e7-a990-fda90f7402b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:53.807667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ab923-f3da-49e7-a990-fda90f7402b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:53.807945 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ab923-f3da-49e7-a990-fda90f7402b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:53.808222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ab923-f3da-49e7-a990-fda90f7402b2 admin admin] PATH_INFO: `/v3/projects/5a66e7666ca24a079738eea09c470cdd` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:53.819861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ab923-f3da-49e7-a990-fda90f7402b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a66e7666ca24a079738eea09c470cdd)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:53.821931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ab923-f3da-49e7-a990-fda90f7402b2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:53.823474 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:53.870260 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-431ab923-f3da-49e7-a990-fda90f7402b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a66e7666ca24a079738eea09c470cdd', 'request_id': 'req-431ab923-f3da-49e7-a990-fda90f7402b2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:53.879922 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-431ab923-f3da-49e7-a990-fda90f7402b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a66e7666ca24a079738eea09c470cdd', 'request_id': 'req-431ab923-f3da-49e7-a990-fda90f7402b2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:53.887467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-431ab923-f3da-49e7-a990-fda90f7402b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a66e7666ca24a079738eea09c470cdd', 'request_id': 'req-431ab923-f3da-49e7-a990-fda90f7402b2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:53.899360 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-431ab923-f3da-49e7-a990-fda90f7402b2 admin admin] The token cache is being invalidate because project 5a66e7666ca24a079738eea09c470cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:33:53.899753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-431ab923-f3da-49e7-a990-fda90f7402b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:53.900397 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-431ab923-f3da-49e7-a990-fda90f7402b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:33:53.902113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1253/2479] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:33:53 2022] DELETE /identity/v3/projects/5a66e7666ca24a079738eea09c470cdd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:53.908676 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b4656-d31f-4ce3-b0d2-a36974961574 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:53.908965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b4656-d31f-4ce3-b0d2-a36974961574 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:53.909242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b4656-d31f-4ce3-b0d2-a36974961574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:53.927474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e29b4656-d31f-4ce3-b0d2-a36974961574 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:53.928721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e29b4656-d31f-4ce3-b0d2-a36974961574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:53.957032 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:53.994591 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1227/2480] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:54.004213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66659b-e036-4765-a778-e1728d29d332 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.004498 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66659b-e036-4765-a778-e1728d29d332 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.004771 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66659b-e036-4765-a778-e1728d29d332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.028380 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-3a66659b-e036-4765-a778-e1728d29d332 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:54.029661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3a66659b-e036-4765-a778-e1728d29d332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:54.039805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1254/2481] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:54.044499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b4656-d31f-4ce3-b0d2-a36974961574 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:54.055655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b4656-d31f-4ce3-b0d2-a36974961574 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:54.060875 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9d7b1-d12c-44b9-81de-47b4c08d47a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:54.061565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9d7b1-d12c-44b9-81de-47b4c08d47a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.061872 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9d7b1-d12c-44b9-81de-47b4c08d47a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.062146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9d7b1-d12c-44b9-81de-47b4c08d47a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.062874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9d7b1-d12c-44b9-81de-47b4c08d47a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:33:54.063176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9d7b1-d12c-44b9-81de-47b4c08d47a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:54.064881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9d7b1-d12c-44b9-81de-47b4c08d47a4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:54.077917 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1228/2482] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:33:54.083415 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66659b-e036-4765-a778-e1728d29d332 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:54.093060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66659b-e036-4765-a778-e1728d29d332 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:54.098131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa98798-1b25-43ef-b468-4d75de1b8827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:54.098781 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa98798-1b25-43ef-b468-4d75de1b8827 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.099057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa98798-1b25-43ef-b468-4d75de1b8827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.099323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa98798-1b25-43ef-b468-4d75de1b8827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.100234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa98798-1b25-43ef-b468-4d75de1b8827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:54.102194 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa98798-1b25-43ef-b468-4d75de1b8827 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:54.131163 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1255/2483] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:54 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:54.135899 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9d7b1-d12c-44b9-81de-47b4c08d47a4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:54.146304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9d7b1-d12c-44b9-81de-47b4c08d47a4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:54.207263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba289e-a081-4c40-9eef-c35a770382ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:54.207938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba289e-a081-4c40-9eef-c35a770382ba admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.208218 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba289e-a081-4c40-9eef-c35a770382ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.208486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba289e-a081-4c40-9eef-c35a770382ba admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.209773 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba289e-a081-4c40-9eef-c35a770382ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:54.211407 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba289e-a081-4c40-9eef-c35a770382ba admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:54.233063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1229/2484] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:33:54 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:54.237637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa98798-1b25-43ef-b468-4d75de1b8827 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:54.248929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa98798-1b25-43ef-b468-4d75de1b8827 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:54.254376 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30553eda-5d33-4ce8-ae1a-ec4b3386a92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:54.255055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30553eda-5d33-4ce8-ae1a-ec4b3386a92d admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.255334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30553eda-5d33-4ce8-ae1a-ec4b3386a92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.255602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30553eda-5d33-4ce8-ae1a-ec4b3386a92d admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.256541 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30553eda-5d33-4ce8-ae1a-ec4b3386a92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:54.258082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30553eda-5d33-4ce8-ae1a-ec4b3386a92d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:54.269213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1256/2485] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:54.273697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba289e-a081-4c40-9eef-c35a770382ba admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:54.284632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba289e-a081-4c40-9eef-c35a770382ba admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:54.290669 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafbc53-998c-433a-b8bb-56d7b052d402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:54.291335 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafbc53-998c-433a-b8bb-56d7b052d402 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.291613 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafbc53-998c-433a-b8bb-56d7b052d402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.291886 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafbc53-998c-433a-b8bb-56d7b052d402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.292605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafbc53-998c-433a-b8bb-56d7b052d402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:54.294250 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafbc53-998c-433a-b8bb-56d7b052d402 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:54.306028 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1230/2486] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:54.310810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30553eda-5d33-4ce8-ae1a-ec4b3386a92d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:54.321625 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30553eda-5d33-4ce8-ae1a-ec4b3386a92d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:54.326675 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01a480-1b81-44ac-b979-45367b86882f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:54.327569 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01a480-1b81-44ac-b979-45367b86882f admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.327848 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01a480-1b81-44ac-b979-45367b86882f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.328174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01a480-1b81-44ac-b979-45367b86882f admin admin] PATH_INFO: `/v3/projects/41a54981f96e45ec8e6cfd95392ca97e/users/e08a17a1b4cc42e4863711201a0a724e/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.344525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01a480-1b81-44ac-b979-45367b86882f admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a54981f96e45ec8e6cfd95392ca97e, user_id=e08a17a1b4cc42e4863711201a0a724e, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:54.347293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01a480-1b81-44ac-b979-45367b86882f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:54.362211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1257/2487] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:54 2022] PUT /identity/v3/projects/41a54981f96e45ec8e6cfd95392ca97e/users/e08a17a1b4cc42e4863711201a0a724e/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:54.373384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c2e98-537d-48a1-995d-b71ceaa0b14c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.373643 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c2e98-537d-48a1-995d-b71ceaa0b14c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.373982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c2e98-537d-48a1-995d-b71ceaa0b14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.410159 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-5a7c2e98-537d-48a1-995d-b71ceaa0b14c None None] MFA Rules not processed for user `e08a17a1b4cc42e4863711201a0a724e`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:54.411379 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5a7c2e98-537d-48a1-995d-b71ceaa0b14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:54.476882 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1231/2488] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:33:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:33:54.481588 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01a480-1b81-44ac-b979-45367b86882f admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:54.545490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01a480-1b81-44ac-b979-45367b86882f admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:54.551255 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37784b17-2430-4db9-974a-cdb040030d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:54.551931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37784b17-2430-4db9-974a-cdb040030d60 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.552203 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37784b17-2430-4db9-974a-cdb040030d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.552456 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37784b17-2430-4db9-974a-cdb040030d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.553344 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37784b17-2430-4db9-974a-cdb040030d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:54.555630 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37784b17-2430-4db9-974a-cdb040030d60 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:54.587740 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1258/2489] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:33:54 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:33:54.593631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c2e98-537d-48a1-995d-b71ceaa0b14c None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:54.606598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c2e98-537d-48a1-995d-b71ceaa0b14c None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:54.632819 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:54.667703 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5518b3f-2fd7-49a5-8d88-8229c670dd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:54.668389 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5518b3f-2fd7-49a5-8d88-8229c670dd6f admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.668668 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5518b3f-2fd7-49a5-8d88-8229c670dd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.668940 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5518b3f-2fd7-49a5-8d88-8229c670dd6f admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.669631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5518b3f-2fd7-49a5-8d88-8229c670dd6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:54.671605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5518b3f-2fd7-49a5-8d88-8229c670dd6f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:54.695351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1232/2490] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:33:54 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:33:54.699880 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37784b17-2430-4db9-974a-cdb040030d60 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:54.711221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37784b17-2430-4db9-974a-cdb040030d60 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:54.716208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295d14c-b9c8-4194-bab8-7a9f4ad8c7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:54.716876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295d14c-b9c8-4194-bab8-7a9f4ad8c7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.717156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295d14c-b9c8-4194-bab8-7a9f4ad8c7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.717427 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295d14c-b9c8-4194-bab8-7a9f4ad8c7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.718201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295d14c-b9c8-4194-bab8-7a9f4ad8c7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:54.719799 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295d14c-b9c8-4194-bab8-7a9f4ad8c7b2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:54.725707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:33:54.732279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1259/2491] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:54.743419 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5518b3f-2fd7-49a5-8d88-8229c670dd6f admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:54.754560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5518b3f-2fd7-49a5-8d88-8229c670dd6f admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:54.759893 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693752b0-61d7-4c91-b81b-2f20086ff0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:54.760797 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693752b0-61d7-4c91-b81b-2f20086ff0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.761083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693752b0-61d7-4c91-b81b-2f20086ff0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.761362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693752b0-61d7-4c91-b81b-2f20086ff0d4 admin admin] PATH_INFO: `/v3/projects/122127cd43364d339b88eeb574b436ed/users/225a86e7c0194fb887c6c09b2b11aa99/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.778805 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693752b0-61d7-4c91-b81b-2f20086ff0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=122127cd43364d339b88eeb574b436ed, user_id=225a86e7c0194fb887c6c09b2b11aa99, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:54.781677 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693752b0-61d7-4c91-b81b-2f20086ff0d4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:54.798988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1233/2492] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:54 2022] PUT /identity/v3/projects/122127cd43364d339b88eeb574b436ed/users/225a86e7c0194fb887c6c09b2b11aa99/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:33:54.803384 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295d14c-b9c8-4194-bab8-7a9f4ad8c7b2 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:54.814582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295d14c-b9c8-4194-bab8-7a9f4ad8c7b2 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:54.875253 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c80a69-ed2a-4c0b-b369-2d3b180a64b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:54.875807 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c80a69-ed2a-4c0b-b369-2d3b180a64b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.876102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c80a69-ed2a-4c0b-b369-2d3b180a64b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.876369 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c80a69-ed2a-4c0b-b369-2d3b180a64b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.877089 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c80a69-ed2a-4c0b-b369-2d3b180a64b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:54.878745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c80a69-ed2a-4c0b-b369-2d3b180a64b8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:54.890029 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1260/2493] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:33:54.895093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693752b0-61d7-4c91-b81b-2f20086ff0d4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:33:54.906060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693752b0-61d7-4c91-b81b-2f20086ff0d4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:33:54.911560 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d443719-df63-4ab6-8625-9f2d1c57f2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:33:54.912514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d443719-df63-4ab6-8625-9f2d1c57f2fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.912787 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d443719-df63-4ab6-8625-9f2d1c57f2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.913060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d443719-df63-4ab6-8625-9f2d1c57f2fc admin admin] PATH_INFO: `/v3/projects/122127cd43364d339b88eeb574b436ed/users/225a86e7c0194fb887c6c09b2b11aa99/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.915076 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d443719-df63-4ab6-8625-9f2d1c57f2fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=122127cd43364d339b88eeb574b436ed, user_id=225a86e7c0194fb887c6c09b2b11aa99, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:33:54.917736 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d443719-df63-4ab6-8625-9f2d1c57f2fc admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:33:54.928496 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1234/2494] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:33:54 2022] PUT /identity/v3/projects/122127cd43364d339b88eeb574b436ed/users/225a86e7c0194fb887c6c09b2b11aa99/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:33:54.939359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3bdb2-3f1b-4bc8-bc84-4bac084cf32c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:33:54.939648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3bdb2-3f1b-4bc8-bc84-4bac084cf32c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:33:54.939925 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3bdb2-3f1b-4bc8-bc84-4bac084cf32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:33:54.975818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6fd3bdb2-3f1b-4bc8-bc84-4bac084cf32c None None] MFA Rules not processed for user `225a86e7c0194fb887c6c09b2b11aa99`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:33:54.977061 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6fd3bdb2-3f1b-4bc8-bc84-4bac084cf32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:33:55.059443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1261/2495] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:33:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:34:04.924595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=32,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:34:05.056077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=63 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:49.850087 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d443719-df63-4ab6-8625-9f2d1c57f2fc admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:49.852470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7d443719-df63-4ab6-8625-9f2d1c57f2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:49.879459 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3bdb2-3f1b-4bc8-bc84-4bac084cf32c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:49.880919 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6fd3bdb2-3f1b-4bc8-bc84-4bac084cf32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:49.933029 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d443719-df63-4ab6-8625-9f2d1c57f2fc admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:49.936954 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36236e1-f8ef-4daa-9562-3617e6c126fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:49.937653 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36236e1-f8ef-4daa-9562-3617e6c126fb service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:49.937969 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36236e1-f8ef-4daa-9562-3617e6c126fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:49.938250 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36236e1-f8ef-4daa-9562-3617e6c126fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:49.940582 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c36236e1-f8ef-4daa-9562-3617e6c126fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:49.948072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3bdb2-3f1b-4bc8-bc84-4bac084cf32c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:49.952509 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca5d56-2c09-4ce8-b2b1-9c7f97c21b60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:49.953230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca5d56-2c09-4ce8-b2b1-9c7f97c21b60 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:49.953513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca5d56-2c09-4ce8-b2b1-9c7f97c21b60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:49.953789 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca5d56-2c09-4ce8-b2b1-9c7f97c21b60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:49.963430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca5d56-2c09-4ce8-b2b1-9c7f97c21b60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:49.964874 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca5d56-2c09-4ce8-b2b1-9c7f97c21b60 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:49.974690 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1262/2496] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:35:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:35:50.019401 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36236e1-f8ef-4daa-9562-3617e6c126fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:50.020839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36236e1-f8ef-4daa-9562-3617e6c126fb service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:50.042248 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1235/2497] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:35:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:35:50.124379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca5d56-2c09-4ce8-b2b1-9c7f97c21b60 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:50.128309 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca5d56-2c09-4ce8-b2b1-9c7f97c21b60 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:50.134134 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15df9b-60b4-485e-89d3-a705bea4f0ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:50.135170 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15df9b-60b4-485e-89d3-a705bea4f0ad service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:50.135521 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15df9b-60b4-485e-89d3-a705bea4f0ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:50.136098 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15df9b-60b4-485e-89d3-a705bea4f0ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:50.138201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8e15df9b-60b4-485e-89d3-a705bea4f0ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:50.152565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-8e15df9b-60b4-485e-89d3-a705bea4f0ad service cinder] Could not find project: 3cefe0d5fbae4b6ca7578bf08f275bac.: keystone.exception.ProjectNotFound: Could not find project: 3cefe0d5fbae4b6ca7578bf08f275bac. Jun 02 19:35:50.152565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 19:35:50.152565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 19:35:50.152565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 19:35:50.152565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 19:35:50.152565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 19:35:50.152565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 19:35:50.152565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 19:35:50.152565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 19:35:50.152565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 19:35:50.152565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 19:35:50.152565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 19:35:50.152565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jun 02 19:35:50.152565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jun 02 19:35:50.152565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 02 19:35:50.154000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 02 19:35:50.154000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 02 19:35:50.154000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 02 19:35:50.154000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:35:50.154000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:35:50.154000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jun 02 19:35:50.154000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jun 02 19:35:50.154000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:35:50.154000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:35:50.154000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:35:50.154000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:35:50.154000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:35:50.154000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 19:35:50.154000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:35:50.154000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:35:50.154000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:35:50.154000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:35:50.155419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:35:50.155419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:35:50.155419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:35:50.155419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:35:50.155419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jun 02 19:35:50.155419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jun 02 19:35:50.155419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jun 02 19:35:50.155419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._validate_token_resources() Jun 02 19:35:50.155419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jun 02 19:35:50.155419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jun 02 19:35:50.155419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jun 02 19:35:50.155419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jun 02 19:35:50.155419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 19:35:50.155419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 19:35:50.155419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 19:35:50.155419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 19:35:50.155419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 19:35:50.156805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 19:35:50.156805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 19:35:50.156805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 02 19:35:50.156805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 19:35:50.156805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 02 19:35:50.156805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 19:35:50.156805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 19:35:50.156805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 19:35:50.156805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 02 19:35:50.156805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 19:35:50.156805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 02 19:35:50.156805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 19:35:50.156805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 19:35:50.156805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 19:35:50.156805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 19:35:50.156805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 19:35:50.156805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 19:35:50.158811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3cefe0d5fbae4b6ca7578bf08f275bac. Jun 02 19:35:50.158811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 02 19:35:50.158811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1263/2498] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:35:50 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 02 19:35:50.272306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36236e1-f8ef-4daa-9562-3617e6c126fb service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:50.274542 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c36236e1-f8ef-4daa-9562-3617e6c126fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:50.338124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15df9b-60b4-485e-89d3-a705bea4f0ad service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:50.339632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8e15df9b-60b4-485e-89d3-a705bea4f0ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:50.366118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36236e1-f8ef-4daa-9562-3617e6c126fb service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:50.371052 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7032649-0f72-4086-834c-639d4b2a3d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:50.372106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7032649-0f72-4086-834c-639d4b2a3d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:50.372455 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7032649-0f72-4086-834c-639d4b2a3d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:50.372654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7032649-0f72-4086-834c-639d4b2a3d45 admin admin] PATH_INFO: `/v3/users/cd7260099aed4f1bb126dcf9f01fe2a9` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:50.373864 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7032649-0f72-4086-834c-639d4b2a3d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd7260099aed4f1bb126dcf9f01fe2a9)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:50.376094 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7032649-0f72-4086-834c-639d4b2a3d45 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:50.416246 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15df9b-60b4-485e-89d3-a705bea4f0ad service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:50.418103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:50.420823 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a127d-b033-47b5-b3e2-b01b993e1391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:50.421496 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a127d-b033-47b5-b3e2-b01b993e1391 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:50.421785 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a127d-b033-47b5-b3e2-b01b993e1391 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:50.422124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a127d-b033-47b5-b3e2-b01b993e1391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:50.424035 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a79a127d-b033-47b5-b3e2-b01b993e1391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:50.451603 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b7032649-0f72-4086-834c-639d4b2a3d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd7260099aed4f1bb126dcf9f01fe2a9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:50.452258 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b7032649-0f72-4086-834c-639d4b2a3d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd7260099aed4f1bb126dcf9f01fe2a9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:50.459814 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b7032649-0f72-4086-834c-639d4b2a3d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd7260099aed4f1bb126dcf9f01fe2a9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:50.474747 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b7032649-0f72-4086-834c-639d4b2a3d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd7260099aed4f1bb126dcf9f01fe2a9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:50.475465 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b7032649-0f72-4086-834c-639d4b2a3d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd7260099aed4f1bb126dcf9f01fe2a9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:50.488529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1236/2499] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:35:50 2022] DELETE /identity/v3/users/cd7260099aed4f1bb126dcf9f01fe2a9 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:35:50.489453 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7032649-0f72-4086-834c-639d4b2a3d45 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:50.490926 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b7032649-0f72-4086-834c-639d4b2a3d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:50.513456 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a127d-b033-47b5-b3e2-b01b993e1391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:50.515036 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a127d-b033-47b5-b3e2-b01b993e1391 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:50.527064 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1264/2500] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:35:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:35:50.528613 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625df00-0f79-44ea-b09e-d394a4e52673 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:50.529053 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625df00-0f79-44ea-b09e-d394a4e52673 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:50.529477 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625df00-0f79-44ea-b09e-d394a4e52673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:50.548924 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-3625df00-0f79-44ea-b09e-d394a4e52673 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:35:50.550172 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3625df00-0f79-44ea-b09e-d394a4e52673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:50.558285 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1265/2501] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:35:50.562588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7032649-0f72-4086-834c-639d4b2a3d45 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:50.567719 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1701c3-d323-4a49-be66-d673155d1c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:50.568494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625df00-0f79-44ea-b09e-d394a4e52673 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:50.568626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1701c3-d323-4a49-be66-d673155d1c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:50.568862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1701c3-d323-4a49-be66-d673155d1c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:50.569132 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1701c3-d323-4a49-be66-d673155d1c4d admin admin] PATH_INFO: `/v3/users/e08a17a1b4cc42e4863711201a0a724e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:50.570026 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3625df00-0f79-44ea-b09e-d394a4e52673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:50.570632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1701c3-d323-4a49-be66-d673155d1c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e08a17a1b4cc42e4863711201a0a724e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:50.572679 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1701c3-d323-4a49-be66-d673155d1c4d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:50.597734 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:50.636639 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6b1701c3-d323-4a49-be66-d673155d1c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e08a17a1b4cc42e4863711201a0a724e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:50.637443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6b1701c3-d323-4a49-be66-d673155d1c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e08a17a1b4cc42e4863711201a0a724e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:50.640179 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625df00-0f79-44ea-b09e-d394a4e52673 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:50.644340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266ad42-dd79-45d1-abac-4396004cf5b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:50.645012 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266ad42-dd79-45d1-abac-4396004cf5b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:50.645295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266ad42-dd79-45d1-abac-4396004cf5b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:50.645572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266ad42-dd79-45d1-abac-4396004cf5b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:50.647815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6b1701c3-d323-4a49-be66-d673155d1c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e08a17a1b4cc42e4863711201a0a724e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:50.656251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266ad42-dd79-45d1-abac-4396004cf5b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:50.657692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266ad42-dd79-45d1-abac-4396004cf5b5 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:50.668542 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1266/2502] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:35:50.670922 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6b1701c3-d323-4a49-be66-d673155d1c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e08a17a1b4cc42e4863711201a0a724e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:50.672015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6b1701c3-d323-4a49-be66-d673155d1c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e08a17a1b4cc42e4863711201a0a724e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:50.678920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266ad42-dd79-45d1-abac-4396004cf5b5 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:50.680618 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a266ad42-dd79-45d1-abac-4396004cf5b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:50.689406 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1237/2503] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:35:50 2022] DELETE /identity/v3/users/e08a17a1b4cc42e4863711201a0a724e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:35:50.693433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c1e14-e8db-4534-8a65-3c4c54c87726 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:50.693767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c1e14-e8db-4534-8a65-3c4c54c87726 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:50.694083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c1e14-e8db-4534-8a65-3c4c54c87726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:50.712907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-190c1e14-e8db-4534-8a65-3c4c54c87726 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:35:50.714170 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-190c1e14-e8db-4534-8a65-3c4c54c87726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:50.730271 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:50.787616 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1238/2504] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:35:50.803354 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266ad42-dd79-45d1-abac-4396004cf5b5 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:50.836429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c1e14-e8db-4534-8a65-3c4c54c87726 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:50.838104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-190c1e14-e8db-4534-8a65-3c4c54c87726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:50.885142 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ccedd-f77d-46a9-b351-a572b0cadee9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:50.886099 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ccedd-f77d-46a9-b351-a572b0cadee9 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:50.886592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ccedd-f77d-46a9-b351-a572b0cadee9 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:50.886940 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ccedd-f77d-46a9-b351-a572b0cadee9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:50.889588 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b11ccedd-f77d-46a9-b351-a572b0cadee9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:50.903755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ccedd-f77d-46a9-b351-a572b0cadee9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:50.905903 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ccedd-f77d-46a9-b351-a572b0cadee9 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:50.918535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c1e14-e8db-4534-8a65-3c4c54c87726 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:50.922625 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e7837-fab2-49d5-9376-027a8356d025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:50.923236 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1267/2505] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:35:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:35:50.923544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e7837-fab2-49d5-9376-027a8356d025 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:50.923895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e7837-fab2-49d5-9376-027a8356d025 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:50.924417 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e7837-fab2-49d5-9376-027a8356d025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:50.935773 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e7837-fab2-49d5-9376-027a8356d025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:50.937366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e7837-fab2-49d5-9376-027a8356d025 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:50.948894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1239/2506] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:35:51.016748 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ccedd-f77d-46a9-b351-a572b0cadee9 service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:51.019272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b11ccedd-f77d-46a9-b351-a572b0cadee9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:51.052920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ccedd-f77d-46a9-b351-a572b0cadee9 service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:51.058497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774110c-8df1-45cb-9258-229d2f9674a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:51.059557 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774110c-8df1-45cb-9258-229d2f9674a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:51.059844 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774110c-8df1-45cb-9258-229d2f9674a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:51.060163 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774110c-8df1-45cb-9258-229d2f9674a0 admin admin] PATH_INFO: `/v3/projects/d5420da5230c4c3b8b0789ea3d205012` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:51.061306 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774110c-8df1-45cb-9258-229d2f9674a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5420da5230c4c3b8b0789ea3d205012)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:51.063292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774110c-8df1-45cb-9258-229d2f9674a0 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:51.103977 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:51.122497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2774110c-8df1-45cb-9258-229d2f9674a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5420da5230c4c3b8b0789ea3d205012', 'request_id': 'req-2774110c-8df1-45cb-9258-229d2f9674a0'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.138226 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2774110c-8df1-45cb-9258-229d2f9674a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5420da5230c4c3b8b0789ea3d205012', 'request_id': 'req-2774110c-8df1-45cb-9258-229d2f9674a0'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.141575 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2774110c-8df1-45cb-9258-229d2f9674a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5420da5230c4c3b8b0789ea3d205012', 'request_id': 'req-2774110c-8df1-45cb-9258-229d2f9674a0'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.152659 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2774110c-8df1-45cb-9258-229d2f9674a0 admin admin] The token cache is being invalidate because project d5420da5230c4c3b8b0789ea3d205012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:35:51.153181 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2774110c-8df1-45cb-9258-229d2f9674a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.154056 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2774110c-8df1-45cb-9258-229d2f9674a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.155890 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1268/2507] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:35:51 2022] DELETE /identity/v3/projects/d5420da5230c4c3b8b0789ea3d205012 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:35:51.160176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e7837-fab2-49d5-9376-027a8356d025 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:51.170831 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e7837-fab2-49d5-9376-027a8356d025 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:51.235649 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97168b7-18a2-4c7a-a427-1f988170e022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:51.236581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97168b7-18a2-4c7a-a427-1f988170e022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:51.236866 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97168b7-18a2-4c7a-a427-1f988170e022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:51.237496 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97168b7-18a2-4c7a-a427-1f988170e022 admin admin] PATH_INFO: `/v3/users/e52a8bb8b9a64b3097ba2d361d3f30d3` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:51.238690 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97168b7-18a2-4c7a-a427-1f988170e022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e52a8bb8b9a64b3097ba2d361d3f30d3)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:51.241231 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97168b7-18a2-4c7a-a427-1f988170e022 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:51.292877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b97168b7-18a2-4c7a-a427-1f988170e022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e52a8bb8b9a64b3097ba2d361d3f30d3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.293696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b97168b7-18a2-4c7a-a427-1f988170e022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e52a8bb8b9a64b3097ba2d361d3f30d3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.301643 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b97168b7-18a2-4c7a-a427-1f988170e022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e52a8bb8b9a64b3097ba2d361d3f30d3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.308107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:51.316671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b97168b7-18a2-4c7a-a427-1f988170e022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e52a8bb8b9a64b3097ba2d361d3f30d3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.317405 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b97168b7-18a2-4c7a-a427-1f988170e022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e52a8bb8b9a64b3097ba2d361d3f30d3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.334814 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1240/2508] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:35:51 2022] DELETE /identity/v3/users/e52a8bb8b9a64b3097ba2d361d3f30d3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:35:51.473759 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774110c-8df1-45cb-9258-229d2f9674a0 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:51.475148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2774110c-8df1-45cb-9258-229d2f9674a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:51.588479 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774110c-8df1-45cb-9258-229d2f9674a0 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:51.671086 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97168b7-18a2-4c7a-a427-1f988170e022 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:51.673054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b97168b7-18a2-4c7a-a427-1f988170e022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:51.707929 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ad72f-056d-4033-8878-0586119d2486 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:51.708646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ad72f-056d-4033-8878-0586119d2486 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:51.708888 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ad72f-056d-4033-8878-0586119d2486 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:51.709192 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ad72f-056d-4033-8878-0586119d2486 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:51.715370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-163ad72f-056d-4033-8878-0586119d2486 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:51.740822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ad72f-056d-4033-8878-0586119d2486 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:51.743013 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ad72f-056d-4033-8878-0586119d2486 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:51.756926 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1269/2509] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:35:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:35:51.813185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97168b7-18a2-4c7a-a427-1f988170e022 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:51.820209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b5c9f-9815-4894-b31d-a20eb3986c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:51.821203 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b5c9f-9815-4894-b31d-a20eb3986c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:51.821483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b5c9f-9815-4894-b31d-a20eb3986c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:51.821754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b5c9f-9815-4894-b31d-a20eb3986c6c admin admin] PATH_INFO: `/v3/projects/41a54981f96e45ec8e6cfd95392ca97e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:51.824138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b5c9f-9815-4894-b31d-a20eb3986c6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a54981f96e45ec8e6cfd95392ca97e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:51.826844 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b5c9f-9815-4894-b31d-a20eb3986c6c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:51.848514 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ad72f-056d-4033-8878-0586119d2486 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:51.849962 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-163ad72f-056d-4033-8878-0586119d2486 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:51.865534 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ad72f-056d-4033-8878-0586119d2486 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:51.884462 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5140ed9-b690-4596-ba72-5450c6bb8683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:51.886771 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5140ed9-b690-4596-ba72-5450c6bb8683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:51.887359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5140ed9-b690-4596-ba72-5450c6bb8683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:51.887451 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5140ed9-b690-4596-ba72-5450c6bb8683 admin admin] PATH_INFO: `/v3/projects/449d8872c1fc4b9495d979ea2fe931ec` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:51.890481 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5140ed9-b690-4596-ba72-5450c6bb8683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=449d8872c1fc4b9495d979ea2fe931ec)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:51.892753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5140ed9-b690-4596-ba72-5450c6bb8683 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:51.908150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-369b5c9f-9815-4894-b31d-a20eb3986c6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a54981f96e45ec8e6cfd95392ca97e', 'request_id': 'req-369b5c9f-9815-4894-b31d-a20eb3986c6c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.914570 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-369b5c9f-9815-4894-b31d-a20eb3986c6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a54981f96e45ec8e6cfd95392ca97e', 'request_id': 'req-369b5c9f-9815-4894-b31d-a20eb3986c6c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.927924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-369b5c9f-9815-4894-b31d-a20eb3986c6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a54981f96e45ec8e6cfd95392ca97e', 'request_id': 'req-369b5c9f-9815-4894-b31d-a20eb3986c6c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.943937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-369b5c9f-9815-4894-b31d-a20eb3986c6c admin admin] The token cache is being invalidate because project 41a54981f96e45ec8e6cfd95392ca97e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:35:51.944227 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-369b5c9f-9815-4894-b31d-a20eb3986c6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.945057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:51.945252 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-369b5c9f-9815-4894-b31d-a20eb3986c6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.947125 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1241/2510] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:35:51 2022] DELETE /identity/v3/projects/41a54981f96e45ec8e6cfd95392ca97e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:35:51.952275 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b5c9f-9815-4894-b31d-a20eb3986c6c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:51.956943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-369b5c9f-9815-4894-b31d-a20eb3986c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:51.962359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b5140ed9-b690-4596-ba72-5450c6bb8683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '449d8872c1fc4b9495d979ea2fe931ec', 'request_id': 'req-b5140ed9-b690-4596-ba72-5450c6bb8683'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.973326 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b5140ed9-b690-4596-ba72-5450c6bb8683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '449d8872c1fc4b9495d979ea2fe931ec', 'request_id': 'req-b5140ed9-b690-4596-ba72-5450c6bb8683'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.982468 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b5140ed9-b690-4596-ba72-5450c6bb8683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '449d8872c1fc4b9495d979ea2fe931ec', 'request_id': 'req-b5140ed9-b690-4596-ba72-5450c6bb8683'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.998084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b5140ed9-b690-4596-ba72-5450c6bb8683 admin admin] The token cache is being invalidate because project 449d8872c1fc4b9495d979ea2fe931ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:35:51.998370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b5140ed9-b690-4596-ba72-5450c6bb8683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:51.999051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b5140ed9-b690-4596-ba72-5450c6bb8683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:52.000696 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1270/2511] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:35:51 2022] DELETE /identity/v3/projects/449d8872c1fc4b9495d979ea2fe931ec => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:35:52.005480 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383169f9-b351-4d32-b20d-f8f76bec4d02 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:52.005789 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383169f9-b351-4d32-b20d-f8f76bec4d02 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:52.006086 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383169f9-b351-4d32-b20d-f8f76bec4d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:52.029239 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-383169f9-b351-4d32-b20d-f8f76bec4d02 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:35:52.030488 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-383169f9-b351-4d32-b20d-f8f76bec4d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:52.039249 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b5c9f-9815-4894-b31d-a20eb3986c6c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:52.054445 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:52.102585 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1271/2512] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:35:52.110509 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abb017-5149-4ffb-b32c-97ccef0172ec None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:52.110842 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abb017-5149-4ffb-b32c-97ccef0172ec None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:52.111124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abb017-5149-4ffb-b32c-97ccef0172ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:52.113449 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e8186-3361-4a15-b345-6eace1d08c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:52.114559 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e8186-3361-4a15-b345-6eace1d08c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:52.114838 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e8186-3361-4a15-b345-6eace1d08c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:52.115116 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e8186-3361-4a15-b345-6eace1d08c3d admin admin] PATH_INFO: `/v3/users/225a86e7c0194fb887c6c09b2b11aa99` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:52.116351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e8186-3361-4a15-b345-6eace1d08c3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=225a86e7c0194fb887c6c09b2b11aa99)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:52.119035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e8186-3361-4a15-b345-6eace1d08c3d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:52.140072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e2abb017-5149-4ffb-b32c-97ccef0172ec None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:35:52.140872 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e2abb017-5149-4ffb-b32c-97ccef0172ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:52.154931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1272/2513] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:35:52.159938 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abb017-5149-4ffb-b32c-97ccef0172ec None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:52.172082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abb017-5149-4ffb-b32c-97ccef0172ec None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:52.179208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03493aa0-33fe-4e1e-96d5-71072033edbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:52.180147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03493aa0-33fe-4e1e-96d5-71072033edbd admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:52.180494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03493aa0-33fe-4e1e-96d5-71072033edbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:52.180847 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03493aa0-33fe-4e1e-96d5-71072033edbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:52.182219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03493aa0-33fe-4e1e-96d5-71072033edbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:35:52.182626 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03493aa0-33fe-4e1e-96d5-71072033edbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:52.184493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03493aa0-33fe-4e1e-96d5-71072033edbd admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:52.186509 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-517e8186-3361-4a15-b345-6eace1d08c3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225a86e7c0194fb887c6c09b2b11aa99'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:52.187574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-517e8186-3361-4a15-b345-6eace1d08c3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225a86e7c0194fb887c6c09b2b11aa99'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:52.199739 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1273/2514] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:35:52.203647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-517e8186-3361-4a15-b345-6eace1d08c3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225a86e7c0194fb887c6c09b2b11aa99'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:52.206571 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03493aa0-33fe-4e1e-96d5-71072033edbd admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:52.219353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-517e8186-3361-4a15-b345-6eace1d08c3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225a86e7c0194fb887c6c09b2b11aa99'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:52.219989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03493aa0-33fe-4e1e-96d5-71072033edbd admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:52.220117 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-517e8186-3361-4a15-b345-6eace1d08c3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225a86e7c0194fb887c6c09b2b11aa99'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:52.224981 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22966f-8d24-472e-8334-72e92318bd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:52.225744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22966f-8d24-472e-8334-72e92318bd7a admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:52.226065 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22966f-8d24-472e-8334-72e92318bd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:52.226447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22966f-8d24-472e-8334-72e92318bd7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:52.227094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22966f-8d24-472e-8334-72e92318bd7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:52.229157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22966f-8d24-472e-8334-72e92318bd7a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:52.237673 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1242/2515] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:35:51 2022] DELETE /identity/v3/users/225a86e7c0194fb887c6c09b2b11aa99 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:35:52.260848 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1274/2516] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:35:52 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:35:52.262054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e8186-3361-4a15-b345-6eace1d08c3d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:52.263488 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-517e8186-3361-4a15-b345-6eace1d08c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:52.339706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e8186-3361-4a15-b345-6eace1d08c3d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:52.383239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:52.405264 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3792e-09e0-4589-8d01-e42f7ad85636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:52.405992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3792e-09e0-4589-8d01-e42f7ad85636 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:52.406345 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3792e-09e0-4589-8d01-e42f7ad85636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:52.406541 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3792e-09e0-4589-8d01-e42f7ad85636 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:52.407254 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3792e-09e0-4589-8d01-e42f7ad85636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:52.409250 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3792e-09e0-4589-8d01-e42f7ad85636 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:52.433078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1243/2517] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:35:52 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:35:52.437396 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22966f-8d24-472e-8334-72e92318bd7a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:52.447824 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22966f-8d24-472e-8334-72e92318bd7a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:52.452655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4367ec-fbe2-460d-8337-b44bd66cfab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:52.453326 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4367ec-fbe2-460d-8337-b44bd66cfab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:52.453609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4367ec-fbe2-460d-8337-b44bd66cfab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:52.453923 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4367ec-fbe2-460d-8337-b44bd66cfab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:52.454660 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4367ec-fbe2-460d-8337-b44bd66cfab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:52.456365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4367ec-fbe2-460d-8337-b44bd66cfab4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:52.467373 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1275/2518] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:35:52.471723 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3792e-09e0-4589-8d01-e42f7ad85636 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:52.482321 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3792e-09e0-4589-8d01-e42f7ad85636 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:52.487021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48bd1d-a1ae-4e2b-9afa-5f02e9ab087e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:52.487693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48bd1d-a1ae-4e2b-9afa-5f02e9ab087e admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:52.487976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48bd1d-a1ae-4e2b-9afa-5f02e9ab087e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:52.488253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48bd1d-a1ae-4e2b-9afa-5f02e9ab087e admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:52.488992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48bd1d-a1ae-4e2b-9afa-5f02e9ab087e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:52.490718 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48bd1d-a1ae-4e2b-9afa-5f02e9ab087e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:52.501997 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1244/2519] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:35:52.505991 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4367ec-fbe2-460d-8337-b44bd66cfab4 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:52.516957 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4367ec-fbe2-460d-8337-b44bd66cfab4 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:52.525213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26985156-a0b9-47ed-beae-a3bc1de73c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:52.526189 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26985156-a0b9-47ed-beae-a3bc1de73c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:52.526458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26985156-a0b9-47ed-beae-a3bc1de73c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:52.526736 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26985156-a0b9-47ed-beae-a3bc1de73c21 admin admin] PATH_INFO: `/v3/projects/396a4a64d80c436d80ab7a4bcc0c7efd/users/1de6ac96f5ad453f9428d903cbd3d20d/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:52.535543 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48bd1d-a1ae-4e2b-9afa-5f02e9ab087e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:52.537656 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ab48bd1d-a1ae-4e2b-9afa-5f02e9ab087e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:52.552612 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48bd1d-a1ae-4e2b-9afa-5f02e9ab087e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:52.554336 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26985156-a0b9-47ed-beae-a3bc1de73c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=396a4a64d80c436d80ab7a4bcc0c7efd, user_id=1de6ac96f5ad453f9428d903cbd3d20d, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:52.557122 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26985156-a0b9-47ed-beae-a3bc1de73c21 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:52.558531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139c298-61c7-4f1f-b00b-7ba9d7868ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:52.559170 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139c298-61c7-4f1f-b00b-7ba9d7868ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:52.559419 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139c298-61c7-4f1f-b00b-7ba9d7868ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:52.559718 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139c298-61c7-4f1f-b00b-7ba9d7868ef7 admin admin] PATH_INFO: `/v3/projects/122127cd43364d339b88eeb574b436ed` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:52.561019 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139c298-61c7-4f1f-b00b-7ba9d7868ef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=122127cd43364d339b88eeb574b436ed)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:52.562945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139c298-61c7-4f1f-b00b-7ba9d7868ef7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:52.573843 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1276/2520] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:35:52 2022] PUT /identity/v3/projects/396a4a64d80c436d80ab7a4bcc0c7efd/users/1de6ac96f5ad453f9428d903cbd3d20d/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:35:52.584097 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f5c75-b43d-4201-a9ad-19125f89467a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:52.584442 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f5c75-b43d-4201-a9ad-19125f89467a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:52.584637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f5c75-b43d-4201-a9ad-19125f89467a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:52.613154 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-813f5c75-b43d-4201-a9ad-19125f89467a None None] MFA Rules not processed for user `1de6ac96f5ad453f9428d903cbd3d20d`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:35:52.614443 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-813f5c75-b43d-4201-a9ad-19125f89467a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:52.618759 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8139c298-61c7-4f1f-b00b-7ba9d7868ef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '122127cd43364d339b88eeb574b436ed', 'request_id': 'req-8139c298-61c7-4f1f-b00b-7ba9d7868ef7'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:52.624952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8139c298-61c7-4f1f-b00b-7ba9d7868ef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '122127cd43364d339b88eeb574b436ed', 'request_id': 'req-8139c298-61c7-4f1f-b00b-7ba9d7868ef7'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:52.634088 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8139c298-61c7-4f1f-b00b-7ba9d7868ef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '122127cd43364d339b88eeb574b436ed', 'request_id': 'req-8139c298-61c7-4f1f-b00b-7ba9d7868ef7'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:52.646218 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8139c298-61c7-4f1f-b00b-7ba9d7868ef7 admin admin] The token cache is being invalidate because project 122127cd43364d339b88eeb574b436ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:35:52.646506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8139c298-61c7-4f1f-b00b-7ba9d7868ef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:52.647166 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8139c298-61c7-4f1f-b00b-7ba9d7868ef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:52.648776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1245/2521] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:35:52 2022] DELETE /identity/v3/projects/122127cd43364d339b88eeb574b436ed => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:35:52.653696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adc4ca-5130-48b9-a548-4dc7d80632be None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:52.654081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adc4ca-5130-48b9-a548-4dc7d80632be None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:52.654366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adc4ca-5130-48b9-a548-4dc7d80632be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:52.656688 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:52.673165 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-78adc4ca-5130-48b9-a548-4dc7d80632be None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:35:52.674413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-78adc4ca-5130-48b9-a548-4dc7d80632be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:52.686359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1277/2522] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:35:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:35:52.690769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f5c75-b43d-4201-a9ad-19125f89467a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:52.692124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-813f5c75-b43d-4201-a9ad-19125f89467a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:52.737380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1246/2523] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:35:52.746650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c40c1-4afe-4eaa-a564-7bd7dced31f2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:52.746941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c40c1-4afe-4eaa-a564-7bd7dced31f2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:52.747224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c40c1-4afe-4eaa-a564-7bd7dced31f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:52.761297 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f5c75-b43d-4201-a9ad-19125f89467a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:52.765990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-bb0c40c1-4afe-4eaa-a564-7bd7dced31f2 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:35:52.766447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98350600-78ca-4895-9c97-05c181461745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:52.767144 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98350600-78ca-4895-9c97-05c181461745 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:52.767279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-bb0c40c1-4afe-4eaa-a564-7bd7dced31f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:52.767422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98350600-78ca-4895-9c97-05c181461745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:52.767692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98350600-78ca-4895-9c97-05c181461745 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:52.768383 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98350600-78ca-4895-9c97-05c181461745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:52.770339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98350600-78ca-4895-9c97-05c181461745 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:52.775107 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1247/2524] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:35:52.779233 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c40c1-4afe-4eaa-a564-7bd7dced31f2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:52.789423 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c40c1-4afe-4eaa-a564-7bd7dced31f2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:52.794890 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff630e66-d9d1-43a7-9dd9-d3ce8b6a89b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:52.795545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff630e66-d9d1-43a7-9dd9-d3ce8b6a89b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:52.795827 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff630e66-d9d1-43a7-9dd9-d3ce8b6a89b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:52.796102 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff630e66-d9d1-43a7-9dd9-d3ce8b6a89b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:52.796829 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff630e66-d9d1-43a7-9dd9-d3ce8b6a89b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:35:52.797813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff630e66-d9d1-43a7-9dd9-d3ce8b6a89b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:52.802460 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1278/2525] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:35:52 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:35:52.802618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff630e66-d9d1-43a7-9dd9-d3ce8b6a89b5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:52.803493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98350600-78ca-4895-9c97-05c181461745 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:52.812975 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1248/2526] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:35:52.816797 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff630e66-d9d1-43a7-9dd9-d3ce8b6a89b5 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:52.826575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff630e66-d9d1-43a7-9dd9-d3ce8b6a89b5 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:52.851771 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:52.873867 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98350600-78ca-4895-9c97-05c181461745 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:52.881326 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3c86f-d5a2-413a-9a55-e38c8148ef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:52.881326 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3c86f-d5a2-413a-9a55-e38c8148ef38 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:52.881326 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3c86f-d5a2-413a-9a55-e38c8148ef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:52.881326 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3c86f-d5a2-413a-9a55-e38c8148ef38 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:52.883078 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3c86f-d5a2-413a-9a55-e38c8148ef38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:52.883595 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3c86f-d5a2-413a-9a55-e38c8148ef38 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:52.887011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b7ba0-6963-443d-b822-d9aca7f12f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:52.887679 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b7ba0-6963-443d-b822-d9aca7f12f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:52.887957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b7ba0-6963-443d-b822-d9aca7f12f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:52.888225 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b7ba0-6963-443d-b822-d9aca7f12f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:52.888918 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b7ba0-6963-443d-b822-d9aca7f12f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:52.890867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b7ba0-6963-443d-b822-d9aca7f12f40 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:52.910828 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1279/2527] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:35:52 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:35:52.912002 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3c86f-d5a2-413a-9a55-e38c8148ef38 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:52.924472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1249/2528] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:35:52 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:35:52.924723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3c86f-d5a2-413a-9a55-e38c8148ef38 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:52.926414 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b7ba0-6963-443d-b822-d9aca7f12f40 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:52.998599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:53.003873 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b7ba0-6963-443d-b822-d9aca7f12f40 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:53.011483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e00e6-5527-43f8-8db1-3881559abdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:53.011939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ac554-252d-4dcf-92b2-095a14c4e9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:53.012724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ac554-252d-4dcf-92b2-095a14c4e9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.013348 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ac554-252d-4dcf-92b2-095a14c4e9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.013991 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e00e6-5527-43f8-8db1-3881559abdb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.014151 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ac554-252d-4dcf-92b2-095a14c4e9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.014580 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e00e6-5527-43f8-8db1-3881559abdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.014933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ac554-252d-4dcf-92b2-095a14c4e9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:53.015390 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e00e6-5527-43f8-8db1-3881559abdb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.016253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e00e6-5527-43f8-8db1-3881559abdb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:53.017180 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ac554-252d-4dcf-92b2-095a14c4e9a6 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:53.018951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e00e6-5527-43f8-8db1-3881559abdb2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:53.046848 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1280/2529] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:35:53.051440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ac554-252d-4dcf-92b2-095a14c4e9a6 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:53.054062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1250/2530] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:35:52 2022] POST /identity/v3/users => generated 282 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:35:53.058632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e00e6-5527-43f8-8db1-3881559abdb2 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:53.068132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ac554-252d-4dcf-92b2-095a14c4e9a6 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:53.069033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e00e6-5527-43f8-8db1-3881559abdb2 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:53.075118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2f9cc-2f31-4be5-9d90-30c86a0920b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:53.076061 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2f9cc-2f31-4be5-9d90-30c86a0920b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.076362 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2f9cc-2f31-4be5-9d90-30c86a0920b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.076658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2f9cc-2f31-4be5-9d90-30c86a0920b9 admin admin] PATH_INFO: `/v3/projects/2ebef2c42b82425789d9c7b8bd616e56/users/d2b358d4fb3b4b0b9d57b34c1df6a542/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.078783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42355fbf-1825-4072-8ef9-c61c4d30414e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:53.079571 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42355fbf-1825-4072-8ef9-c61c4d30414e admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.079952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42355fbf-1825-4072-8ef9-c61c4d30414e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.080223 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42355fbf-1825-4072-8ef9-c61c4d30414e admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.080939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42355fbf-1825-4072-8ef9-c61c4d30414e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:53.082581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42355fbf-1825-4072-8ef9-c61c4d30414e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:53.093355 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2f9cc-2f31-4be5-9d90-30c86a0920b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ebef2c42b82425789d9c7b8bd616e56, user_id=d2b358d4fb3b4b0b9d57b34c1df6a542, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:53.097171 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1251/2531] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:35:53.097309 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2f9cc-2f31-4be5-9d90-30c86a0920b9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:53.097416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42355fbf-1825-4072-8ef9-c61c4d30414e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:53.098739 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-42355fbf-1825-4072-8ef9-c61c4d30414e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:53.113988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1281/2532] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:35:53 2022] PUT /identity/v3/projects/2ebef2c42b82425789d9c7b8bd616e56/users/d2b358d4fb3b4b0b9d57b34c1df6a542/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:35:53.113988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2f9cc-2f31-4be5-9d90-30c86a0920b9 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:53.164285 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42355fbf-1825-4072-8ef9-c61c4d30414e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:53.182156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2f9cc-2f31-4be5-9d90-30c86a0920b9 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:53.186813 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3833b-ff26-4610-9564-e2caf63595a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:53.187485 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3833b-ff26-4610-9564-e2caf63595a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.187766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3833b-ff26-4610-9564-e2caf63595a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.188041 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3833b-ff26-4610-9564-e2caf63595a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.188767 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3833b-ff26-4610-9564-e2caf63595a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:53.190411 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3833b-ff26-4610-9564-e2caf63595a4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:53.200266 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1282/2533] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:35:53.202701 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3833b-ff26-4610-9564-e2caf63595a4 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:53.211464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:53.215126 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3833b-ff26-4610-9564-e2caf63595a4 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:53.220044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f69b18-39b5-4bff-82d1-416723e0e4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:53.220201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ba851-be93-4881-a408-1abb89b1d9bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:53.220709 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ba851-be93-4881-a408-1abb89b1d9bf service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.220834 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f69b18-39b5-4bff-82d1-416723e0e4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.220979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f69b18-39b5-4bff-82d1-416723e0e4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.221092 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ba851-be93-4881-a408-1abb89b1d9bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.221242 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f69b18-39b5-4bff-82d1-416723e0e4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.221358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ba851-be93-4881-a408-1abb89b1d9bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.222019 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f69b18-39b5-4bff-82d1-416723e0e4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:53.223119 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-945ba851-be93-4881-a408-1abb89b1d9bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:53.223614 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f69b18-39b5-4bff-82d1-416723e0e4b3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:53.235726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1283/2534] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:35:53.236431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f69b18-39b5-4bff-82d1-416723e0e4b3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:53.247242 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f69b18-39b5-4bff-82d1-416723e0e4b3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:53.252818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fef2f8-0ded-4f19-9bf4-d4ff844ec8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:53.253719 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fef2f8-0ded-4f19-9bf4-d4ff844ec8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.254033 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fef2f8-0ded-4f19-9bf4-d4ff844ec8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.254313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fef2f8-0ded-4f19-9bf4-d4ff844ec8e9 admin admin] PATH_INFO: `/v3/projects/e1db6d33b05b4d6783db4f01342db719/users/236b7ca9e81e46cfa29d7a88cc946336/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.271032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fef2f8-0ded-4f19-9bf4-d4ff844ec8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1db6d33b05b4d6783db4f01342db719, user_id=236b7ca9e81e46cfa29d7a88cc946336, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:53.273820 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fef2f8-0ded-4f19-9bf4-d4ff844ec8e9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:53.288995 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1284/2535] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:35:53 2022] PUT /identity/v3/projects/e1db6d33b05b4d6783db4f01342db719/users/236b7ca9e81e46cfa29d7a88cc946336/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:35:53.298049 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fef2f8-0ded-4f19-9bf4-d4ff844ec8e9 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:53.300608 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ba851-be93-4881-a408-1abb89b1d9bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:53.302450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ba851-be93-4881-a408-1abb89b1d9bf service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:53.314865 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1252/2536] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:35:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:35:53.316165 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c5e58-50aa-4a8c-a474-3dd1c196aa48 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.316457 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c5e58-50aa-4a8c-a474-3dd1c196aa48 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.316766 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c5e58-50aa-4a8c-a474-3dd1c196aa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.356700 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ab3c5e58-50aa-4a8c-a474-3dd1c196aa48 None None] MFA Rules not processed for user `236b7ca9e81e46cfa29d7a88cc946336`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:35:53.358615 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ab3c5e58-50aa-4a8c-a474-3dd1c196aa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:53.392902 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fef2f8-0ded-4f19-9bf4-d4ff844ec8e9 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:53.398447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086886e-1e2a-44e2-9e1f-e3b060d0cd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:53.399572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086886e-1e2a-44e2-9e1f-e3b060d0cd43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.399863 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086886e-1e2a-44e2-9e1f-e3b060d0cd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.400139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086886e-1e2a-44e2-9e1f-e3b060d0cd43 admin admin] PATH_INFO: `/v3/projects/2ebef2c42b82425789d9c7b8bd616e56/users/d2b358d4fb3b4b0b9d57b34c1df6a542/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.404016 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086886e-1e2a-44e2-9e1f-e3b060d0cd43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ebef2c42b82425789d9c7b8bd616e56, user_id=d2b358d4fb3b4b0b9d57b34c1df6a542, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:53.406471 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086886e-1e2a-44e2-9e1f-e3b060d0cd43 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:53.419429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1285/2537] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:35:53 2022] PUT /identity/v3/projects/2ebef2c42b82425789d9c7b8bd616e56/users/d2b358d4fb3b4b0b9d57b34c1df6a542/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:35:53.441572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1253/2538] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:35:53 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:35:53.446927 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086886e-1e2a-44e2-9e1f-e3b060d0cd43 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:53.473408 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:53.486765 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e96e7-0ac6-4acb-a021-280b8d787896 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.487080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e96e7-0ac6-4acb-a021-280b8d787896 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.487357 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e96e7-0ac6-4acb-a021-280b8d787896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.514988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-9b1e96e7-0ac6-4acb-a021-280b8d787896 None None] MFA Rules not processed for user `d2b358d4fb3b4b0b9d57b34c1df6a542`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:35:53.516238 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9b1e96e7-0ac6-4acb-a021-280b8d787896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:53.518125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086886e-1e2a-44e2-9e1f-e3b060d0cd43 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:53.523506 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a79b2-3c87-42e3-a64d-c54a89a94adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:53.524220 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a79b2-3c87-42e3-a64d-c54a89a94adb admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.524506 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a79b2-3c87-42e3-a64d-c54a89a94adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.524783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a79b2-3c87-42e3-a64d-c54a89a94adb admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.525487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a79b2-3c87-42e3-a64d-c54a89a94adb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:53.527508 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a79b2-3c87-42e3-a64d-c54a89a94adb admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:53.560770 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1286/2539] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:35:53 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:35:53.562816 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a79b2-3c87-42e3-a64d-c54a89a94adb admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:53.603349 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1254/2540] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:35:53 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:35:53.614722 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e96e7-0ac6-4acb-a021-280b8d787896 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:53.617900 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9b1e96e7-0ac6-4acb-a021-280b8d787896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:53.623136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:53.641230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a79b2-3c87-42e3-a64d-c54a89a94adb admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:53.647556 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd04bca-f344-4e07-b68b-9ecbc6e523f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:53.648834 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd04bca-f344-4e07-b68b-9ecbc6e523f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.649174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd04bca-f344-4e07-b68b-9ecbc6e523f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.649454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd04bca-f344-4e07-b68b-9ecbc6e523f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.650187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd04bca-f344-4e07-b68b-9ecbc6e523f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:53.652150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd04bca-f344-4e07-b68b-9ecbc6e523f4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:53.679105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1287/2541] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:35:53 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:35:53.680737 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd04bca-f344-4e07-b68b-9ecbc6e523f4 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:53.687422 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e96e7-0ac6-4acb-a021-280b8d787896 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:53.690673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd04bca-f344-4e07-b68b-9ecbc6e523f4 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:53.696572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222ed52-1f8e-4b3f-936b-560706d319f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:53.697248 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222ed52-1f8e-4b3f-936b-560706d319f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.697527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222ed52-1f8e-4b3f-936b-560706d319f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.697826 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222ed52-1f8e-4b3f-936b-560706d319f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.698563 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222ed52-1f8e-4b3f-936b-560706d319f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:53.700186 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222ed52-1f8e-4b3f-936b-560706d319f8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:53.711915 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1288/2542] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:35:53.716297 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222ed52-1f8e-4b3f-936b-560706d319f8 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:53.731604 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222ed52-1f8e-4b3f-936b-560706d319f8 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:53.738652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66841e-8bc8-4750-9b7c-54384a6adb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:53.739572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66841e-8bc8-4750-9b7c-54384a6adb14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.739847 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66841e-8bc8-4750-9b7c-54384a6adb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.740113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66841e-8bc8-4750-9b7c-54384a6adb14 admin admin] PATH_INFO: `/v3/projects/cd2dc455f72141d8a056f9d96d97cca0/users/ab57b11d9a70452a980f0fb5ae790513/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.744314 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f9de3-532a-4786-bc13-c102a6c80587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:53.744909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f9de3-532a-4786-bc13-c102a6c80587 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.745192 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f9de3-532a-4786-bc13-c102a6c80587 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.745467 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f9de3-532a-4786-bc13-c102a6c80587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.757777 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66841e-8bc8-4750-9b7c-54384a6adb14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2dc455f72141d8a056f9d96d97cca0, user_id=ab57b11d9a70452a980f0fb5ae790513, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:53.761602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66841e-8bc8-4750-9b7c-54384a6adb14 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:53.780221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1289/2543] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:35:53 2022] PUT /identity/v3/projects/cd2dc455f72141d8a056f9d96d97cca0/users/ab57b11d9a70452a980f0fb5ae790513/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:35:53.784168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66841e-8bc8-4750-9b7c-54384a6adb14 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:53.818717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f9de3-532a-4786-bc13-c102a6c80587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:53.820348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f9de3-532a-4786-bc13-c102a6c80587 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:53.831247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1255/2544] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:35:53 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:35:53.858432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66841e-8bc8-4750-9b7c-54384a6adb14 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:53.863479 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306bca1-12d9-40fa-872d-1bda89663d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:53.864210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306bca1-12d9-40fa-872d-1bda89663d36 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.864858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306bca1-12d9-40fa-872d-1bda89663d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.864996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306bca1-12d9-40fa-872d-1bda89663d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.865744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306bca1-12d9-40fa-872d-1bda89663d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:53.867973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306bca1-12d9-40fa-872d-1bda89663d36 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:53.869902 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:53.883818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1290/2545] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:35:53.888122 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f9de3-532a-4786-bc13-c102a6c80587 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:53.903214 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f9de3-532a-4786-bc13-c102a6c80587 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:53.915599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed03b7-f313-4c2c-990a-a2051f2b3ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:53.916590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed03b7-f313-4c2c-990a-a2051f2b3ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.916954 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed03b7-f313-4c2c-990a-a2051f2b3ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.917289 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed03b7-f313-4c2c-990a-a2051f2b3ce4 admin admin] PATH_INFO: `/v3/projects/cd2dc455f72141d8a056f9d96d97cca0/users/ab57b11d9a70452a980f0fb5ae790513/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.919907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed03b7-f313-4c2c-990a-a2051f2b3ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2dc455f72141d8a056f9d96d97cca0, user_id=ab57b11d9a70452a980f0fb5ae790513, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:53.921771 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306bca1-12d9-40fa-872d-1bda89663d36 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:53.923187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed03b7-f313-4c2c-990a-a2051f2b3ce4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:53.936575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1256/2546] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:35:53 2022] PUT /identity/v3/projects/cd2dc455f72141d8a056f9d96d97cca0/users/ab57b11d9a70452a980f0fb5ae790513/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:35:53.947882 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dce99-6aa7-4f8a-8543-578efbf2c7d8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:53.948176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dce99-6aa7-4f8a-8543-578efbf2c7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:53.948677 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dce99-6aa7-4f8a-8543-578efbf2c7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:53.983594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-181dce99-6aa7-4f8a-8543-578efbf2c7d8 None None] MFA Rules not processed for user `ab57b11d9a70452a980f0fb5ae790513`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:35:53.985003 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-181dce99-6aa7-4f8a-8543-578efbf2c7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:53.992370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306bca1-12d9-40fa-872d-1bda89663d36 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:54.051509 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:54.084437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb251fb-4b22-4998-981f-6d4edb206bec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:54.085830 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb251fb-4b22-4998-981f-6d4edb206bec service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:54.086283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb251fb-4b22-4998-981f-6d4edb206bec service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:54.086650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb251fb-4b22-4998-981f-6d4edb206bec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:54.090520 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1257/2547] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:35:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:35:54.161264 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb251fb-4b22-4998-981f-6d4edb206bec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:54.162869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb251fb-4b22-4998-981f-6d4edb206bec service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:54.173073 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1291/2548] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:35:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:35:54.279139 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dce99-6aa7-4f8a-8543-578efbf2c7d8 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:54.290565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dce99-6aa7-4f8a-8543-578efbf2c7d8 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:54.294139 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b959df3-2c89-4345-8b2c-a25c442ef830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:54.294796 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b959df3-2c89-4345-8b2c-a25c442ef830 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:54.295074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b959df3-2c89-4345-8b2c-a25c442ef830 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:54.295345 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b959df3-2c89-4345-8b2c-a25c442ef830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:54.306197 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b959df3-2c89-4345-8b2c-a25c442ef830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:54.307684 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b959df3-2c89-4345-8b2c-a25c442ef830 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:54.318124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1258/2549] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:35:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:35:54.801379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb251fb-4b22-4998-981f-6d4edb206bec service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:54.808948 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb251fb-4b22-4998-981f-6d4edb206bec service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:54.812886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9848803-81a9-4b64-8220-91ab37665f58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:54.813537 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9848803-81a9-4b64-8220-91ab37665f58 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:54.813830 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9848803-81a9-4b64-8220-91ab37665f58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:54.814107 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9848803-81a9-4b64-8220-91ab37665f58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:54.876933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9848803-81a9-4b64-8220-91ab37665f58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:54.878439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9848803-81a9-4b64-8220-91ab37665f58 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:54.887756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1292/2550] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:35:54 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:35:55.675043 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b959df3-2c89-4345-8b2c-a25c442ef830 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:55.677027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4b959df3-2c89-4345-8b2c-a25c442ef830 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:55.736384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b959df3-2c89-4345-8b2c-a25c442ef830 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:55.740907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12d606-c7a1-404b-b839-3a46e8082a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:55.741596 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12d606-c7a1-404b-b839-3a46e8082a62 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:55.741916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12d606-c7a1-404b-b839-3a46e8082a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:55.742189 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12d606-c7a1-404b-b839-3a46e8082a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:55.744068 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ff12d606-c7a1-404b-b839-3a46e8082a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:55.824577 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12d606-c7a1-404b-b839-3a46e8082a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:55.825957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12d606-c7a1-404b-b839-3a46e8082a62 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:55.835867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1259/2551] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:35:56.692333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9848803-81a9-4b64-8220-91ab37665f58 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:56.700371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:56.705670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9848803-81a9-4b64-8220-91ab37665f58 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:56.711145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6f012-207e-4195-a42d-2b5f00741c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:56.712107 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6f012-207e-4195-a42d-2b5f00741c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:56.712455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6f012-207e-4195-a42d-2b5f00741c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:56.712798 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6f012-207e-4195-a42d-2b5f00741c3f admin admin] PATH_INFO: `/v3/users/236b7ca9e81e46cfa29d7a88cc946336` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:56.714116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6f012-207e-4195-a42d-2b5f00741c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=236b7ca9e81e46cfa29d7a88cc946336)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:56.716237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6f012-207e-4195-a42d-2b5f00741c3f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:56.787070 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2eb6f012-207e-4195-a42d-2b5f00741c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236b7ca9e81e46cfa29d7a88cc946336'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:56.787727 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2eb6f012-207e-4195-a42d-2b5f00741c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236b7ca9e81e46cfa29d7a88cc946336'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:56.797760 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2eb6f012-207e-4195-a42d-2b5f00741c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236b7ca9e81e46cfa29d7a88cc946336'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:56.808814 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2eb6f012-207e-4195-a42d-2b5f00741c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236b7ca9e81e46cfa29d7a88cc946336'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:56.810103 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2eb6f012-207e-4195-a42d-2b5f00741c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236b7ca9e81e46cfa29d7a88cc946336'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:56.833040 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1293/2552] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:35:56 2022] DELETE /identity/v3/users/236b7ca9e81e46cfa29d7a88cc946336 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:35:56.835442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8485b-98ed-4abb-b9a2-52b6064dea76 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:56.835947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8485b-98ed-4abb-b9a2-52b6064dea76 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:56.836160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8485b-98ed-4abb-b9a2-52b6064dea76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:56.853688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b1d8485b-98ed-4abb-b9a2-52b6064dea76 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:35:56.855736 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b1d8485b-98ed-4abb-b9a2-52b6064dea76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:56.923735 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1260/2553] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:35:56.936760 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6f012-207e-4195-a42d-2b5f00741c3f admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:56.938219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2eb6f012-207e-4195-a42d-2b5f00741c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:56.996954 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6f012-207e-4195-a42d-2b5f00741c3f admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:57.000607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc34ba-03c4-4a97-9da8-4a4b9a03b5c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:57.001265 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc34ba-03c4-4a97-9da8-4a4b9a03b5c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:57.001896 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc34ba-03c4-4a97-9da8-4a4b9a03b5c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:57.002283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc34ba-03c4-4a97-9da8-4a4b9a03b5c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:57.012283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc34ba-03c4-4a97-9da8-4a4b9a03b5c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:57.013636 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc34ba-03c4-4a97-9da8-4a4b9a03b5c2 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:57.023273 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1294/2554] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:35:57.440392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8485b-98ed-4abb-b9a2-52b6064dea76 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:57.442210 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b1d8485b-98ed-4abb-b9a2-52b6064dea76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:57.465526 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8485b-98ed-4abb-b9a2-52b6064dea76 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:57.472336 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0889bc4-e521-4a61-806b-135a02b2d201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:57.473542 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0889bc4-e521-4a61-806b-135a02b2d201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:57.474031 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0889bc4-e521-4a61-806b-135a02b2d201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:57.474401 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0889bc4-e521-4a61-806b-135a02b2d201 admin admin] PATH_INFO: `/v3/projects/e1db6d33b05b4d6783db4f01342db719` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:57.476155 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0889bc4-e521-4a61-806b-135a02b2d201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1db6d33b05b4d6783db4f01342db719)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:57.478459 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0889bc4-e521-4a61-806b-135a02b2d201 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:57.494428 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:57.568053 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f0889bc4-e521-4a61-806b-135a02b2d201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1db6d33b05b4d6783db4f01342db719', 'request_id': 'req-f0889bc4-e521-4a61-806b-135a02b2d201'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:57.575323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f0889bc4-e521-4a61-806b-135a02b2d201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1db6d33b05b4d6783db4f01342db719', 'request_id': 'req-f0889bc4-e521-4a61-806b-135a02b2d201'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:57.594937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f0889bc4-e521-4a61-806b-135a02b2d201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1db6d33b05b4d6783db4f01342db719', 'request_id': 'req-f0889bc4-e521-4a61-806b-135a02b2d201'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:57.609146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f0889bc4-e521-4a61-806b-135a02b2d201 admin admin] The token cache is being invalidate because project e1db6d33b05b4d6783db4f01342db719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:35:57.609548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f0889bc4-e521-4a61-806b-135a02b2d201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:57.610255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f0889bc4-e521-4a61-806b-135a02b2d201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:57.612245 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1261/2555] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:35:57 2022] DELETE /identity/v3/projects/e1db6d33b05b4d6783db4f01342db719 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:35:57.616251 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc34ba-03c4-4a97-9da8-4a4b9a03b5c2 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:57.626793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc34ba-03c4-4a97-9da8-4a4b9a03b5c2 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:57.693130 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6672f-296f-43cd-8900-ff0731d7c1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:57.695676 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6672f-296f-43cd-8900-ff0731d7c1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:57.696174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6672f-296f-43cd-8900-ff0731d7c1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:57.696642 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6672f-296f-43cd-8900-ff0731d7c1a3 admin admin] PATH_INFO: `/v3/users/ab57b11d9a70452a980f0fb5ae790513` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:57.698157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6672f-296f-43cd-8900-ff0731d7c1a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab57b11d9a70452a980f0fb5ae790513)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:57.700380 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6672f-296f-43cd-8900-ff0731d7c1a3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:57.728067 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:57.770770 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-abe6672f-296f-43cd-8900-ff0731d7c1a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab57b11d9a70452a980f0fb5ae790513'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:57.771508 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-abe6672f-296f-43cd-8900-ff0731d7c1a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab57b11d9a70452a980f0fb5ae790513'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:57.780137 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-abe6672f-296f-43cd-8900-ff0731d7c1a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab57b11d9a70452a980f0fb5ae790513'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:57.791478 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-abe6672f-296f-43cd-8900-ff0731d7c1a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab57b11d9a70452a980f0fb5ae790513'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:57.792272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-abe6672f-296f-43cd-8900-ff0731d7c1a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab57b11d9a70452a980f0fb5ae790513'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:57.817478 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1295/2556] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:35:57 2022] DELETE /identity/v3/users/ab57b11d9a70452a980f0fb5ae790513 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:35:58.110293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0889bc4-e521-4a61-806b-135a02b2d201 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:58.112539 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f0889bc4-e521-4a61-806b-135a02b2d201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:58.144989 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0889bc4-e521-4a61-806b-135a02b2d201 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:58.219954 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d30ca6-b4a7-477e-b7b3-5801275448cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:58.220842 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d30ca6-b4a7-477e-b7b3-5801275448cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:58.221125 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d30ca6-b4a7-477e-b7b3-5801275448cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:58.221399 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d30ca6-b4a7-477e-b7b3-5801275448cb admin admin] PATH_INFO: `/v3/projects/cd2dc455f72141d8a056f9d96d97cca0` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:58.222632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d30ca6-b4a7-477e-b7b3-5801275448cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd2dc455f72141d8a056f9d96d97cca0)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:58.224636 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d30ca6-b4a7-477e-b7b3-5801275448cb admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:58.285017 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-58d30ca6-b4a7-477e-b7b3-5801275448cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd2dc455f72141d8a056f9d96d97cca0', 'request_id': 'req-58d30ca6-b4a7-477e-b7b3-5801275448cb'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:58.291204 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-58d30ca6-b4a7-477e-b7b3-5801275448cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd2dc455f72141d8a056f9d96d97cca0', 'request_id': 'req-58d30ca6-b4a7-477e-b7b3-5801275448cb'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:58.306791 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-58d30ca6-b4a7-477e-b7b3-5801275448cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd2dc455f72141d8a056f9d96d97cca0', 'request_id': 'req-58d30ca6-b4a7-477e-b7b3-5801275448cb'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:58.322140 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-58d30ca6-b4a7-477e-b7b3-5801275448cb admin admin] The token cache is being invalidate because project cd2dc455f72141d8a056f9d96d97cca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:35:58.323073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-58d30ca6-b4a7-477e-b7b3-5801275448cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:58.323871 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-58d30ca6-b4a7-477e-b7b3-5801275448cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:58.326655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1262/2557] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:35:58 2022] DELETE /identity/v3/projects/cd2dc455f72141d8a056f9d96d97cca0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:35:58.331396 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5ee79-0103-42cb-a2fc-90109261200c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:58.331756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5ee79-0103-42cb-a2fc-90109261200c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:58.332370 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5ee79-0103-42cb-a2fc-90109261200c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:58.352832 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-14c5ee79-0103-42cb-a2fc-90109261200c None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:35:58.354164 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-14c5ee79-0103-42cb-a2fc-90109261200c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:58.431804 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1296/2558] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:35:58.439857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e366b03-215b-4857-a725-df7d97cc61d2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:58.440132 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e366b03-215b-4857-a725-df7d97cc61d2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:58.440438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e366b03-215b-4857-a725-df7d97cc61d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:58.459967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-1e366b03-215b-4857-a725-df7d97cc61d2 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:35:58.461246 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1e366b03-215b-4857-a725-df7d97cc61d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:58.472739 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1263/2559] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:35:58.477602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5ee79-0103-42cb-a2fc-90109261200c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:58.488999 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5ee79-0103-42cb-a2fc-90109261200c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:58.494407 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d73f9-acee-45fd-9bd8-e245f787765c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:58.495092 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d73f9-acee-45fd-9bd8-e245f787765c admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:58.495376 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d73f9-acee-45fd-9bd8-e245f787765c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:58.495652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d73f9-acee-45fd-9bd8-e245f787765c admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:58.496454 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d73f9-acee-45fd-9bd8-e245f787765c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:35:58.496872 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d73f9-acee-45fd-9bd8-e245f787765c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:58.498652 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d73f9-acee-45fd-9bd8-e245f787765c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:58.515057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1297/2560] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:35:58.519623 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e366b03-215b-4857-a725-df7d97cc61d2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:58.541332 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e366b03-215b-4857-a725-df7d97cc61d2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:58.546196 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae9234-5d74-4391-84f5-398a7912b34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:58.546875 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae9234-5d74-4391-84f5-398a7912b34b admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:58.547159 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae9234-5d74-4391-84f5-398a7912b34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:58.547437 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae9234-5d74-4391-84f5-398a7912b34b admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:58.548140 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae9234-5d74-4391-84f5-398a7912b34b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:58.550110 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae9234-5d74-4391-84f5-398a7912b34b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:58.579438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1264/2561] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:35:58 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:35:58.583905 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d73f9-acee-45fd-9bd8-e245f787765c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:58.595338 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d73f9-acee-45fd-9bd8-e245f787765c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:58.696120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77300443-312e-4ca3-8fb3-402ebd04c3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:58.696832 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77300443-312e-4ca3-8fb3-402ebd04c3ad admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:58.697226 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77300443-312e-4ca3-8fb3-402ebd04c3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:58.697667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77300443-312e-4ca3-8fb3-402ebd04c3ad admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:58.698753 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77300443-312e-4ca3-8fb3-402ebd04c3ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:58.700969 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77300443-312e-4ca3-8fb3-402ebd04c3ad admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:58.724458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1298/2562] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:35:58 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:35:58.728842 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae9234-5d74-4391-84f5-398a7912b34b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:58.739204 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:58.746187 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae9234-5d74-4391-84f5-398a7912b34b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:58.754909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369f3d2-5d62-43b5-a22c-252db7c0ac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:58.755740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369f3d2-5d62-43b5-a22c-252db7c0ac4c admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:58.756121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369f3d2-5d62-43b5-a22c-252db7c0ac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:58.756504 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369f3d2-5d62-43b5-a22c-252db7c0ac4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:58.758368 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369f3d2-5d62-43b5-a22c-252db7c0ac4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:58.760270 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369f3d2-5d62-43b5-a22c-252db7c0ac4c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:58.777909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1265/2563] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:35:58.778546 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77300443-312e-4ca3-8fb3-402ebd04c3ad admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:58.791449 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77300443-312e-4ca3-8fb3-402ebd04c3ad admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:58.805739 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753d4f3-35ea-4d40-ac65-450fe9d1443d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:58.806829 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753d4f3-35ea-4d40-ac65-450fe9d1443d admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:58.811910 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753d4f3-35ea-4d40-ac65-450fe9d1443d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:58.813211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753d4f3-35ea-4d40-ac65-450fe9d1443d admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:58.813211 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753d4f3-35ea-4d40-ac65-450fe9d1443d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:58.814736 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753d4f3-35ea-4d40-ac65-450fe9d1443d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:58.832824 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1299/2564] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:35:58.835263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369f3d2-5d62-43b5-a22c-252db7c0ac4c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:58.858085 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369f3d2-5d62-43b5-a22c-252db7c0ac4c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:58.864104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5471559-9313-4ce2-9d06-d584141cdde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:58.865069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5471559-9313-4ce2-9d06-d584141cdde8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:58.865345 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5471559-9313-4ce2-9d06-d584141cdde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:58.866300 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5471559-9313-4ce2-9d06-d584141cdde8 admin admin] PATH_INFO: `/v3/projects/765495ac677d4ce786e8f630ae7453ec/users/0b809deb522c44a8b3b559375cddc79e/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:58.881859 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5471559-9313-4ce2-9d06-d584141cdde8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=765495ac677d4ce786e8f630ae7453ec, user_id=0b809deb522c44a8b3b559375cddc79e, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:58.885446 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5471559-9313-4ce2-9d06-d584141cdde8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:58.902857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1266/2565] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:35:58 2022] PUT /identity/v3/projects/765495ac677d4ce786e8f630ae7453ec/users/0b809deb522c44a8b3b559375cddc79e/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:35:58.907953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753d4f3-35ea-4d40-ac65-450fe9d1443d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:58.909919 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a753d4f3-35ea-4d40-ac65-450fe9d1443d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:58.914536 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a3563-53c6-4bca-9804-282467b2f49b None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:58.915126 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a3563-53c6-4bca-9804-282467b2f49b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:58.915788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a3563-53c6-4bca-9804-282467b2f49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:58.917437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:58.953735 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-746a3563-53c6-4bca-9804-282467b2f49b None None] MFA Rules not processed for user `0b809deb522c44a8b3b559375cddc79e`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:35:58.955285 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-746a3563-53c6-4bca-9804-282467b2f49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:59.008426 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753d4f3-35ea-4d40-ac65-450fe9d1443d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:59.051237 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1267/2566] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:35:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:35:59.056843 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a3563-53c6-4bca-9804-282467b2f49b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:59.102391 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52104a2a-d9f0-4d5f-9c75-94fb2ea04155 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:59.103706 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52104a2a-d9f0-4d5f-9c75-94fb2ea04155 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:59.104155 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52104a2a-d9f0-4d5f-9c75-94fb2ea04155 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:59.104609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52104a2a-d9f0-4d5f-9c75-94fb2ea04155 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:59.107686 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-52104a2a-d9f0-4d5f-9c75-94fb2ea04155 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:59.121731 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52104a2a-d9f0-4d5f-9c75-94fb2ea04155 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:59.123394 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52104a2a-d9f0-4d5f-9c75-94fb2ea04155 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:59.124121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a3563-53c6-4bca-9804-282467b2f49b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:59.129433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf0e4a-e758-4d4e-b372-13cbb78f192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:59.130153 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf0e4a-e758-4d4e-b372-13cbb78f192c admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:59.130437 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf0e4a-e758-4d4e-b372-13cbb78f192c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:59.130713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf0e4a-e758-4d4e-b372-13cbb78f192c admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:59.131426 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf0e4a-e758-4d4e-b372-13cbb78f192c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:59.133425 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf0e4a-e758-4d4e-b372-13cbb78f192c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:59.135301 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1300/2567] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:35:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:35:59.170769 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1268/2568] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:35:59 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:35:59.175160 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52104a2a-d9f0-4d5f-9c75-94fb2ea04155 service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:59.186749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52104a2a-d9f0-4d5f-9c75-94fb2ea04155 service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:59.255161 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43965f8e-bcef-411f-9adf-f92d9c23a979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:59.256008 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43965f8e-bcef-411f-9adf-f92d9c23a979 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:59.256368 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43965f8e-bcef-411f-9adf-f92d9c23a979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:59.256733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43965f8e-bcef-411f-9adf-f92d9c23a979 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:59.258955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43965f8e-bcef-411f-9adf-f92d9c23a979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:59.260350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43965f8e-bcef-411f-9adf-f92d9c23a979 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:59.263934 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf0e4a-e758-4d4e-b372-13cbb78f192c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:59.265860 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-52bf0e4a-e758-4d4e-b372-13cbb78f192c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:59.280704 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf0e4a-e758-4d4e-b372-13cbb78f192c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:59.286008 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a601e9-4688-4e1a-a79e-2017631dee5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:59.287056 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1301/2569] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:35:59 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:35:59.287218 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a601e9-4688-4e1a-a79e-2017631dee5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:59.287218 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a601e9-4688-4e1a-a79e-2017631dee5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:59.287565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a601e9-4688-4e1a-a79e-2017631dee5d admin admin] PATH_INFO: `/v3/users/4eda4b85484844ab8b424a1a42a97704` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:59.289021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a601e9-4688-4e1a-a79e-2017631dee5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eda4b85484844ab8b424a1a42a97704)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:59.291060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43965f8e-bcef-411f-9adf-f92d9c23a979 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:59.291192 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a601e9-4688-4e1a-a79e-2017631dee5d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:59.300776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43965f8e-bcef-411f-9adf-f92d9c23a979 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:59.306269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73fc14-e42e-4280-8437-98cfb997ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:59.306936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73fc14-e42e-4280-8437-98cfb997ce57 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:59.307493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73fc14-e42e-4280-8437-98cfb997ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:59.308134 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73fc14-e42e-4280-8437-98cfb997ce57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:59.308883 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73fc14-e42e-4280-8437-98cfb997ce57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:59.310519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73fc14-e42e-4280-8437-98cfb997ce57 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:59.325627 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1302/2570] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:35:59.326770 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73fc14-e42e-4280-8437-98cfb997ce57 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:59.337647 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73fc14-e42e-4280-8437-98cfb997ce57 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:59.341073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:59.343484 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7fdea-9e48-4e2a-80e9-0aad057833d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:59.344502 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7fdea-9e48-4e2a-80e9-0aad057833d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:59.344842 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7fdea-9e48-4e2a-80e9-0aad057833d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:59.345171 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7fdea-9e48-4e2a-80e9-0aad057833d8 admin admin] PATH_INFO: `/v3/projects/adf52870da964a5d8da72efd3cd4e364/users/5e13815ae43042b08690b6eb1cc67509/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:59.362310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:59.363290 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c7a601e9-4688-4e1a-a79e-2017631dee5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eda4b85484844ab8b424a1a42a97704'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:59.364438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c7a601e9-4688-4e1a-a79e-2017631dee5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eda4b85484844ab8b424a1a42a97704'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:59.370158 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7fdea-9e48-4e2a-80e9-0aad057833d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf52870da964a5d8da72efd3cd4e364, user_id=5e13815ae43042b08690b6eb1cc67509, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:59.373289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7fdea-9e48-4e2a-80e9-0aad057833d8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:59.374595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c7a601e9-4688-4e1a-a79e-2017631dee5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eda4b85484844ab8b424a1a42a97704'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:59.392575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c7a601e9-4688-4e1a-a79e-2017631dee5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eda4b85484844ab8b424a1a42a97704'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:59.394960 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c7a601e9-4688-4e1a-a79e-2017631dee5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eda4b85484844ab8b424a1a42a97704'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:59.404197 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1303/2571] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:35:59 2022] PUT /identity/v3/projects/adf52870da964a5d8da72efd3cd4e364/users/5e13815ae43042b08690b6eb1cc67509/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:35:59.408288 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7fdea-9e48-4e2a-80e9-0aad057833d8 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:59.410161 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5da7fdea-9e48-4e2a-80e9-0aad057833d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:59.411358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1269/2572] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:35:59 2022] DELETE /identity/v3/users/4eda4b85484844ab8b424a1a42a97704 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:35:59.484679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7fdea-9e48-4e2a-80e9-0aad057833d8 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:59.552387 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085625a1-834b-47c0-972f-83b31f5d365e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:59.553047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085625a1-834b-47c0-972f-83b31f5d365e admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:59.553324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085625a1-834b-47c0-972f-83b31f5d365e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:59.553634 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085625a1-834b-47c0-972f-83b31f5d365e admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:59.555014 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085625a1-834b-47c0-972f-83b31f5d365e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:59.556629 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085625a1-834b-47c0-972f-83b31f5d365e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:59.567329 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1304/2573] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:35:59.572140 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a601e9-4688-4e1a-a79e-2017631dee5d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:59.582712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a601e9-4688-4e1a-a79e-2017631dee5d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:59.587679 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce3160-1491-49f3-917f-5f25e4da24ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:59.588578 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce3160-1491-49f3-917f-5f25e4da24ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:59.588868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce3160-1491-49f3-917f-5f25e4da24ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:59.589148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce3160-1491-49f3-917f-5f25e4da24ff admin admin] PATH_INFO: `/v3/projects/adf52870da964a5d8da72efd3cd4e364/users/5e13815ae43042b08690b6eb1cc67509/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:59.591211 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce3160-1491-49f3-917f-5f25e4da24ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf52870da964a5d8da72efd3cd4e364, user_id=5e13815ae43042b08690b6eb1cc67509, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:59.593903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce3160-1491-49f3-917f-5f25e4da24ff admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:59.605182 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1270/2574] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:35:59 2022] PUT /identity/v3/projects/adf52870da964a5d8da72efd3cd4e364/users/5e13815ae43042b08690b6eb1cc67509/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:35:59.615718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085625a1-834b-47c0-972f-83b31f5d365e admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:59.617829 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-085625a1-834b-47c0-972f-83b31f5d365e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:59.618464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1c49f-7bf9-4e8a-b343-5da5d953228e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:59.618760 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1c49f-7bf9-4e8a-b343-5da5d953228e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:59.619041 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1c49f-7bf9-4e8a-b343-5da5d953228e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:59.631368 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085625a1-834b-47c0-972f-83b31f5d365e admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:59.648384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2bf1c49f-7bf9-4e8a-b343-5da5d953228e None None] MFA Rules not processed for user `5e13815ae43042b08690b6eb1cc67509`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:35:59.649625 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2bf1c49f-7bf9-4e8a-b343-5da5d953228e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:59.695425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519de1ac-ecc0-4718-9151-cdf3f34b4099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:59.696356 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519de1ac-ecc0-4718-9151-cdf3f34b4099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:59.696983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519de1ac-ecc0-4718-9151-cdf3f34b4099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:59.696983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519de1ac-ecc0-4718-9151-cdf3f34b4099 admin admin] PATH_INFO: `/v3/projects/e2d79077c0654e55973512bc6d36a9e8` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:59.698140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519de1ac-ecc0-4718-9151-cdf3f34b4099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d79077c0654e55973512bc6d36a9e8)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:59.700102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519de1ac-ecc0-4718-9151-cdf3f34b4099 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:59.728625 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1271/2575] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:35:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:35:59.740680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1c49f-7bf9-4e8a-b343-5da5d953228e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:59.741234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:59.742528 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2bf1c49f-7bf9-4e8a-b343-5da5d953228e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:59.751712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-519de1ac-ecc0-4718-9151-cdf3f34b4099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d79077c0654e55973512bc6d36a9e8', 'request_id': 'req-519de1ac-ecc0-4718-9151-cdf3f34b4099'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:59.762045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-519de1ac-ecc0-4718-9151-cdf3f34b4099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d79077c0654e55973512bc6d36a9e8', 'request_id': 'req-519de1ac-ecc0-4718-9151-cdf3f34b4099'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:59.768672 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-519de1ac-ecc0-4718-9151-cdf3f34b4099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d79077c0654e55973512bc6d36a9e8', 'request_id': 'req-519de1ac-ecc0-4718-9151-cdf3f34b4099'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:59.779528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-519de1ac-ecc0-4718-9151-cdf3f34b4099 admin admin] The token cache is being invalidate because project e2d79077c0654e55973512bc6d36a9e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:35:59.779819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-519de1ac-ecc0-4718-9151-cdf3f34b4099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:59.780478 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-519de1ac-ecc0-4718-9151-cdf3f34b4099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:35:59.782117 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1305/2576] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:35:59 2022] DELETE /identity/v3/projects/e2d79077c0654e55973512bc6d36a9e8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:35:59.788056 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b64f5-1834-4dd6-add3-e6002d0859c0 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:59.788347 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b64f5-1834-4dd6-add3-e6002d0859c0 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:59.788622 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b64f5-1834-4dd6-add3-e6002d0859c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:59.807816 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1c49f-7bf9-4e8a-b343-5da5d953228e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:59.808230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-7d5b64f5-1834-4dd6-add3-e6002d0859c0 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:35:59.809462 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7d5b64f5-1834-4dd6-add3-e6002d0859c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:59.851646 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:35:59.862387 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63819a-02bc-4f03-b29a-752a03eeab39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:59.863120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63819a-02bc-4f03-b29a-752a03eeab39 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:59.863735 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63819a-02bc-4f03-b29a-752a03eeab39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:59.864266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63819a-02bc-4f03-b29a-752a03eeab39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:59.866699 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-fe63819a-02bc-4f03-b29a-752a03eeab39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:59.870765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1306/2577] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:35:59.878819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1f05a-820e-432b-a9f7-6b3fbcc134e2 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:59.879104 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1f05a-820e-432b-a9f7-6b3fbcc134e2 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:59.879375 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1f05a-820e-432b-a9f7-6b3fbcc134e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:59.906315 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a3f1f05a-820e-432b-a9f7-6b3fbcc134e2 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:35:59.907525 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a3f1f05a-820e-432b-a9f7-6b3fbcc134e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:35:59.916044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1307/2578] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:35:59.920479 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1f05a-820e-432b-a9f7-6b3fbcc134e2 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:59.930912 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1f05a-820e-432b-a9f7-6b3fbcc134e2 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:59.935757 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8c7b9-db2b-40ee-ab03-172fa7394999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:59.936411 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8c7b9-db2b-40ee-ab03-172fa7394999 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:59.936690 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8c7b9-db2b-40ee-ab03-172fa7394999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:59.936964 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8c7b9-db2b-40ee-ab03-172fa7394999 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:59.937687 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8c7b9-db2b-40ee-ab03-172fa7394999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:35:59.938026 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8c7b9-db2b-40ee-ab03-172fa7394999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:59.938783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63819a-02bc-4f03-b29a-752a03eeab39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:59.939628 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8c7b9-db2b-40ee-ab03-172fa7394999 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:59.940272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63819a-02bc-4f03-b29a-752a03eeab39 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:35:59.949947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1272/2579] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:35:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:35:59.952173 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1308/2580] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 19:35:59.956524 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63819a-02bc-4f03-b29a-752a03eeab39 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:35:59.968336 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63819a-02bc-4f03-b29a-752a03eeab39 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:35:59.973759 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846c507-7835-489a-bbf4-add01e05172c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:35:59.974811 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846c507-7835-489a-bbf4-add01e05172c admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:35:59.975087 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846c507-7835-489a-bbf4-add01e05172c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:35:59.975414 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846c507-7835-489a-bbf4-add01e05172c admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:35:59.976113 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846c507-7835-489a-bbf4-add01e05172c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:35:59.978209 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846c507-7835-489a-bbf4-add01e05172c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:00.008861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1273/2581] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:35:59 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:36:00.013714 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8c7b9-db2b-40ee-ab03-172fa7394999 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:00.016473 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846c507-7835-489a-bbf4-add01e05172c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:00.018200 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a846c507-7835-489a-bbf4-add01e05172c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:00.024689 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8c7b9-db2b-40ee-ab03-172fa7394999 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:00.084513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f66d5-57ac-4fbb-b766-db22f453f066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:00.085570 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f66d5-57ac-4fbb-b766-db22f453f066 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:00.085712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846c507-7835-489a-bbf4-add01e05172c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:00.085898 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f66d5-57ac-4fbb-b766-db22f453f066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:00.086157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f66d5-57ac-4fbb-b766-db22f453f066 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:00.086845 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f66d5-57ac-4fbb-b766-db22f453f066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:00.088775 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f66d5-57ac-4fbb-b766-db22f453f066 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:00.090795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086f3f6-8177-41cd-b5b1-0b2f3cb899d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:00.091693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086f3f6-8177-41cd-b5b1-0b2f3cb899d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:00.091957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086f3f6-8177-41cd-b5b1-0b2f3cb899d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:00.092233 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086f3f6-8177-41cd-b5b1-0b2f3cb899d5 admin admin] PATH_INFO: `/v3/users/0b809deb522c44a8b3b559375cddc79e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:00.093462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086f3f6-8177-41cd-b5b1-0b2f3cb899d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b809deb522c44a8b3b559375cddc79e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:00.095433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086f3f6-8177-41cd-b5b1-0b2f3cb899d5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:00.113474 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1309/2582] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:36:00 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:36:00.114865 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f66d5-57ac-4fbb-b766-db22f453f066 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:00.125532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f66d5-57ac-4fbb-b766-db22f453f066 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:00.131220 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d4f34-a93e-49f8-bc25-320dd5a8097d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:00.132347 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d4f34-a93e-49f8-bc25-320dd5a8097d admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:00.132675 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d4f34-a93e-49f8-bc25-320dd5a8097d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:00.132932 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d4f34-a93e-49f8-bc25-320dd5a8097d admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:00.133669 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d4f34-a93e-49f8-bc25-320dd5a8097d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:00.135572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d4f34-a93e-49f8-bc25-320dd5a8097d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:00.144754 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7086f3f6-8177-41cd-b5b1-0b2f3cb899d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b809deb522c44a8b3b559375cddc79e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:00.145405 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7086f3f6-8177-41cd-b5b1-0b2f3cb899d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b809deb522c44a8b3b559375cddc79e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:00.146729 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1310/2583] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:36:00.151561 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d4f34-a93e-49f8-bc25-320dd5a8097d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:00.156216 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7086f3f6-8177-41cd-b5b1-0b2f3cb899d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b809deb522c44a8b3b559375cddc79e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:00.161612 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d4f34-a93e-49f8-bc25-320dd5a8097d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:00.167979 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:00.169587 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4f962-8793-4c9f-bf04-c501fe39ab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:00.170091 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7086f3f6-8177-41cd-b5b1-0b2f3cb899d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b809deb522c44a8b3b559375cddc79e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:00.170780 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4f962-8793-4c9f-bf04-c501fe39ab94 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:00.171008 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7086f3f6-8177-41cd-b5b1-0b2f3cb899d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b809deb522c44a8b3b559375cddc79e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:00.171231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4f962-8793-4c9f-bf04-c501fe39ab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:00.171607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4f962-8793-4c9f-bf04-c501fe39ab94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:00.172519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4f962-8793-4c9f-bf04-c501fe39ab94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:00.174422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4f962-8793-4c9f-bf04-c501fe39ab94 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:00.187086 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1311/2584] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:36:00.187627 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1274/2585] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:36:00 2022] DELETE /identity/v3/users/0b809deb522c44a8b3b559375cddc79e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:36:00.191655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086f3f6-8177-41cd-b5b1-0b2f3cb899d5 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:00.191875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae658445-e4d5-4289-9ec2-9478ae0192cb None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:00.192195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae658445-e4d5-4289-9ec2-9478ae0192cb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:00.192470 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae658445-e4d5-4289-9ec2-9478ae0192cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:00.193078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7086f3f6-8177-41cd-b5b1-0b2f3cb899d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:00.209911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ae658445-e4d5-4289-9ec2-9478ae0192cb None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:00.211120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ae658445-e4d5-4289-9ec2-9478ae0192cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:00.219743 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:00.264245 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086f3f6-8177-41cd-b5b1-0b2f3cb899d5 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:00.268970 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080b5f9-899b-4ab9-9e13-3fbbec552df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:00.269975 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080b5f9-899b-4ab9-9e13-3fbbec552df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:00.270256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080b5f9-899b-4ab9-9e13-3fbbec552df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:00.270531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080b5f9-899b-4ab9-9e13-3fbbec552df3 admin admin] PATH_INFO: `/v3/projects/119263b9683e44eba604fc24eca20061/users/d160ccef27104953beadc68e74b2d49e/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:00.274886 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1312/2586] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:00.284570 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae658445-e4d5-4289-9ec2-9478ae0192cb None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:00.285926 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ae658445-e4d5-4289-9ec2-9478ae0192cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:00.286111 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080b5f9-899b-4ab9-9e13-3fbbec552df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=119263b9683e44eba604fc24eca20061, user_id=d160ccef27104953beadc68e74b2d49e, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:00.288976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080b5f9-899b-4ab9-9e13-3fbbec552df3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:00.304029 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1275/2587] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:36:00 2022] PUT /identity/v3/projects/119263b9683e44eba604fc24eca20061/users/d160ccef27104953beadc68e74b2d49e/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:36:00.309205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0190e4-969d-4865-af3c-e15790f5a79e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:00.309509 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0190e4-969d-4865-af3c-e15790f5a79e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:00.309776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0190e4-969d-4865-af3c-e15790f5a79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:00.327920 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-1c0190e4-969d-4865-af3c-e15790f5a79e None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:00.329147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1c0190e4-969d-4865-af3c-e15790f5a79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:00.346796 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae658445-e4d5-4289-9ec2-9478ae0192cb None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:00.387145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1276/2588] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:36:00.397385 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0190e4-969d-4865-af3c-e15790f5a79e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:00.398651 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392a68f-8c0a-4434-abdd-6d59423a6ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:00.399315 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392a68f-8c0a-4434-abdd-6d59423a6ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:00.399564 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392a68f-8c0a-4434-abdd-6d59423a6ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:00.399840 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392a68f-8c0a-4434-abdd-6d59423a6ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:00.407750 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0190e4-969d-4865-af3c-e15790f5a79e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:00.410633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392a68f-8c0a-4434-abdd-6d59423a6ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:00.412069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deccbce-c57d-4d34-a242-ae6284df3018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:00.412227 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392a68f-8c0a-4434-abdd-6d59423a6ec7 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:00.412721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deccbce-c57d-4d34-a242-ae6284df3018 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:00.413347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deccbce-c57d-4d34-a242-ae6284df3018 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:00.413347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deccbce-c57d-4d34-a242-ae6284df3018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:00.423095 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deccbce-c57d-4d34-a242-ae6284df3018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:00.423270 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1313/2589] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:36:00.424596 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deccbce-c57d-4d34-a242-ae6284df3018 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:00.436506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1277/2590] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:36:00.835955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392a68f-8c0a-4434-abdd-6d59423a6ec7 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:00.838538 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2392a68f-8c0a-4434-abdd-6d59423a6ec7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:00.852877 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392a68f-8c0a-4434-abdd-6d59423a6ec7 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:00.858584 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e454b-b13d-4966-957e-7d249fe8efd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:00.859605 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e454b-b13d-4966-957e-7d249fe8efd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:00.860014 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e454b-b13d-4966-957e-7d249fe8efd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:00.860400 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e454b-b13d-4966-957e-7d249fe8efd5 admin admin] PATH_INFO: `/v3/projects/765495ac677d4ce786e8f630ae7453ec` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:00.861939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e454b-b13d-4966-957e-7d249fe8efd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=765495ac677d4ce786e8f630ae7453ec)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:00.864136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e454b-b13d-4966-957e-7d249fe8efd5 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:00.932745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-be3e454b-b13d-4966-957e-7d249fe8efd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765495ac677d4ce786e8f630ae7453ec', 'request_id': 'req-be3e454b-b13d-4966-957e-7d249fe8efd5'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:00.943785 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-be3e454b-b13d-4966-957e-7d249fe8efd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765495ac677d4ce786e8f630ae7453ec', 'request_id': 'req-be3e454b-b13d-4966-957e-7d249fe8efd5'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:00.952519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-be3e454b-b13d-4966-957e-7d249fe8efd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765495ac677d4ce786e8f630ae7453ec', 'request_id': 'req-be3e454b-b13d-4966-957e-7d249fe8efd5'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:00.960510 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:00.968732 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-be3e454b-b13d-4966-957e-7d249fe8efd5 admin admin] The token cache is being invalidate because project 765495ac677d4ce786e8f630ae7453ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:36:00.969088 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-be3e454b-b13d-4966-957e-7d249fe8efd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:00.970197 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-be3e454b-b13d-4966-957e-7d249fe8efd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:00.971840 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1314/2591] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:36:00 2022] DELETE /identity/v3/projects/765495ac677d4ce786e8f630ae7453ec => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:36:00.976586 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deccbce-c57d-4d34-a242-ae6284df3018 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:00.986942 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deccbce-c57d-4d34-a242-ae6284df3018 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:01.061222 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ba725-a157-4926-9260-98aa6df2d7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:01.062057 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ba725-a157-4926-9260-98aa6df2d7db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:01.062334 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ba725-a157-4926-9260-98aa6df2d7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:01.062609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ba725-a157-4926-9260-98aa6df2d7db admin admin] PATH_INFO: `/v3/users/5e13815ae43042b08690b6eb1cc67509` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:01.063812 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ba725-a157-4926-9260-98aa6df2d7db admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e13815ae43042b08690b6eb1cc67509)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:01.066472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ba725-a157-4926-9260-98aa6df2d7db admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:01.068114 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:01.117192 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-969ba725-a157-4926-9260-98aa6df2d7db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e13815ae43042b08690b6eb1cc67509'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:01.118506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-969ba725-a157-4926-9260-98aa6df2d7db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e13815ae43042b08690b6eb1cc67509'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:01.125689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-969ba725-a157-4926-9260-98aa6df2d7db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e13815ae43042b08690b6eb1cc67509'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:01.138003 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-969ba725-a157-4926-9260-98aa6df2d7db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e13815ae43042b08690b6eb1cc67509'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:01.138768 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-969ba725-a157-4926-9260-98aa6df2d7db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e13815ae43042b08690b6eb1cc67509'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:01.154858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1278/2592] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:36:00 2022] DELETE /identity/v3/users/5e13815ae43042b08690b6eb1cc67509 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:01.451139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e454b-b13d-4966-957e-7d249fe8efd5 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:01.453339 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-be3e454b-b13d-4966-957e-7d249fe8efd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:01.487080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e454b-b13d-4966-957e-7d249fe8efd5 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:01.579995 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1c61b-9195-407e-9a4b-1d5e25546c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:01.580821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1c61b-9195-407e-9a4b-1d5e25546c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:01.581104 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1c61b-9195-407e-9a4b-1d5e25546c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:01.581380 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1c61b-9195-407e-9a4b-1d5e25546c44 admin admin] PATH_INFO: `/v3/projects/adf52870da964a5d8da72efd3cd4e364` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:01.582699 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1c61b-9195-407e-9a4b-1d5e25546c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf52870da964a5d8da72efd3cd4e364)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:01.584619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1c61b-9195-407e-9a4b-1d5e25546c44 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:01.648783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-bbe1c61b-9195-407e-9a4b-1d5e25546c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf52870da964a5d8da72efd3cd4e364', 'request_id': 'req-bbe1c61b-9195-407e-9a4b-1d5e25546c44'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:01.660603 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-bbe1c61b-9195-407e-9a4b-1d5e25546c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf52870da964a5d8da72efd3cd4e364', 'request_id': 'req-bbe1c61b-9195-407e-9a4b-1d5e25546c44'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:01.673578 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-bbe1c61b-9195-407e-9a4b-1d5e25546c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf52870da964a5d8da72efd3cd4e364', 'request_id': 'req-bbe1c61b-9195-407e-9a4b-1d5e25546c44'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:01.686869 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-bbe1c61b-9195-407e-9a4b-1d5e25546c44 admin admin] The token cache is being invalidate because project adf52870da964a5d8da72efd3cd4e364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:36:01.687486 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-bbe1c61b-9195-407e-9a4b-1d5e25546c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:01.688631 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-bbe1c61b-9195-407e-9a4b-1d5e25546c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:01.690616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1315/2593] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:36:01 2022] DELETE /identity/v3/projects/adf52870da964a5d8da72efd3cd4e364 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:01.697662 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f02926-9bcb-45bb-8603-188afee60655 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:01.698251 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f02926-9bcb-45bb-8603-188afee60655 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:01.699202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f02926-9bcb-45bb-8603-188afee60655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:01.731330 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-72f02926-9bcb-45bb-8603-188afee60655 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:01.733394 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-72f02926-9bcb-45bb-8603-188afee60655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:01.826855 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1279/2594] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:01.837764 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28527114-b5a3-4556-bde9-ba806d57a10a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:01.838304 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28527114-b5a3-4556-bde9-ba806d57a10a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:01.838406 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28527114-b5a3-4556-bde9-ba806d57a10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:01.858252 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-28527114-b5a3-4556-bde9-ba806d57a10a None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:01.859530 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-28527114-b5a3-4556-bde9-ba806d57a10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:01.870371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1316/2595] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:01.875718 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f02926-9bcb-45bb-8603-188afee60655 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:01.887238 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f02926-9bcb-45bb-8603-188afee60655 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:01.892235 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812a1ac-4c1e-4af8-a650-47633ee5d9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:01.893032 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812a1ac-4c1e-4af8-a650-47633ee5d9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:01.893417 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812a1ac-4c1e-4af8-a650-47633ee5d9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:01.893942 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812a1ac-4c1e-4af8-a650-47633ee5d9d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:01.894757 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812a1ac-4c1e-4af8-a650-47633ee5d9d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:36:01.895161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812a1ac-4c1e-4af8-a650-47633ee5d9d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:01.896894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812a1ac-4c1e-4af8-a650-47633ee5d9d4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:01.911167 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1280/2596] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:36:01.916152 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28527114-b5a3-4556-bde9-ba806d57a10a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:01.926863 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28527114-b5a3-4556-bde9-ba806d57a10a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:01.938977 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e50257-5cac-43ca-b5e1-db87dfa7f907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:01.940114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e50257-5cac-43ca-b5e1-db87dfa7f907 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:01.940114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e50257-5cac-43ca-b5e1-db87dfa7f907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:01.940356 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e50257-5cac-43ca-b5e1-db87dfa7f907 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:01.940910 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e50257-5cac-43ca-b5e1-db87dfa7f907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:01.943032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e50257-5cac-43ca-b5e1-db87dfa7f907 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:01.981895 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1317/2597] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:36:01 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:36:01.983504 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812a1ac-4c1e-4af8-a650-47633ee5d9d4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:01.995465 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812a1ac-4c1e-4af8-a650-47633ee5d9d4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:02.064477 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b030c92-3f88-47be-ad6a-00be332aa151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:02.065208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b030c92-3f88-47be-ad6a-00be332aa151 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:02.066241 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b030c92-3f88-47be-ad6a-00be332aa151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:02.066527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b030c92-3f88-47be-ad6a-00be332aa151 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:02.067249 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b030c92-3f88-47be-ad6a-00be332aa151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:02.069305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b030c92-3f88-47be-ad6a-00be332aa151 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:02.089313 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:02.107875 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1281/2598] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:36:01 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:36:02.109005 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e50257-5cac-43ca-b5e1-db87dfa7f907 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:02.138620 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e50257-5cac-43ca-b5e1-db87dfa7f907 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:02.155021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ff6db-4e07-4283-b626-ee8588988763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:02.155021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ff6db-4e07-4283-b626-ee8588988763 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:02.155904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ff6db-4e07-4283-b626-ee8588988763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:02.155904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ff6db-4e07-4283-b626-ee8588988763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:02.156735 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ff6db-4e07-4283-b626-ee8588988763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:02.158466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ff6db-4e07-4283-b626-ee8588988763 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:02.173030 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1318/2599] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:36:02.174541 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b030c92-3f88-47be-ad6a-00be332aa151 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:02.188000 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b030c92-3f88-47be-ad6a-00be332aa151 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:02.193242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a33b5e-b96c-41bb-a006-348415e837f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:02.193971 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a33b5e-b96c-41bb-a006-348415e837f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:02.194297 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a33b5e-b96c-41bb-a006-348415e837f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:02.194573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a33b5e-b96c-41bb-a006-348415e837f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:02.195312 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a33b5e-b96c-41bb-a006-348415e837f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:02.196938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a33b5e-b96c-41bb-a006-348415e837f5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:02.210368 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1282/2600] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:36:02.214893 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ff6db-4e07-4283-b626-ee8588988763 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:02.225859 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ff6db-4e07-4283-b626-ee8588988763 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:02.232282 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe2f71-d8b3-4267-8ce8-7c99e4ecf2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:02.233202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe2f71-d8b3-4267-8ce8-7c99e4ecf2bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:02.233473 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe2f71-d8b3-4267-8ce8-7c99e4ecf2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:02.233752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe2f71-d8b3-4267-8ce8-7c99e4ecf2bc admin admin] PATH_INFO: `/v3/projects/33a24c27f4c543278911c6bced7d887f/users/9e56893a0d194024a0af642389a7daa4/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:02.251654 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe2f71-d8b3-4267-8ce8-7c99e4ecf2bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a24c27f4c543278911c6bced7d887f, user_id=9e56893a0d194024a0af642389a7daa4, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:02.254760 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe2f71-d8b3-4267-8ce8-7c99e4ecf2bc admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:02.271426 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1319/2601] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:36:02 2022] PUT /identity/v3/projects/33a24c27f4c543278911c6bced7d887f/users/9e56893a0d194024a0af642389a7daa4/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:36:02.282533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ec2f3-8b04-46b2-a09e-47d09d87ae35 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:02.282952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ec2f3-8b04-46b2-a09e-47d09d87ae35 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:02.283195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ec2f3-8b04-46b2-a09e-47d09d87ae35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:02.311951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a26ec2f3-8b04-46b2-a09e-47d09d87ae35 None None] MFA Rules not processed for user `9e56893a0d194024a0af642389a7daa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:02.313502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a26ec2f3-8b04-46b2-a09e-47d09d87ae35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:02.383762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1283/2602] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:36:02.388748 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe2f71-d8b3-4267-8ce8-7c99e4ecf2bc admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:02.422434 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:02.468201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe2f71-d8b3-4267-8ce8-7c99e4ecf2bc admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:02.473004 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80582736-a958-40b1-a203-c894318a3f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:02.473702 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80582736-a958-40b1-a203-c894318a3f51 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:02.474021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80582736-a958-40b1-a203-c894318a3f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:02.474293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80582736-a958-40b1-a203-c894318a3f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:02.474990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80582736-a958-40b1-a203-c894318a3f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:02.477169 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80582736-a958-40b1-a203-c894318a3f51 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:02.504881 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1320/2603] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:36:02 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:36:02.509447 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ec2f3-8b04-46b2-a09e-47d09d87ae35 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:02.523865 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ec2f3-8b04-46b2-a09e-47d09d87ae35 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:02.596145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1b317-e81a-44d9-a00f-a5023758fe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:02.597349 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1b317-e81a-44d9-a00f-a5023758fe7e admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:02.597631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1b317-e81a-44d9-a00f-a5023758fe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:02.597944 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1b317-e81a-44d9-a00f-a5023758fe7e admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:02.604374 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1b317-e81a-44d9-a00f-a5023758fe7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:02.606721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1b317-e81a-44d9-a00f-a5023758fe7e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:02.638223 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1284/2604] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:36:02 2022] POST /identity/v3/users => generated 300 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:36:02.639436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80582736-a958-40b1-a203-c894318a3f51 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:02.658682 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80582736-a958-40b1-a203-c894318a3f51 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:02.668172 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bab606-56b8-47d4-b440-34a1357fc744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:02.669004 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bab606-56b8-47d4-b440-34a1357fc744 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:02.669282 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bab606-56b8-47d4-b440-34a1357fc744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:02.669554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bab606-56b8-47d4-b440-34a1357fc744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:02.670539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bab606-56b8-47d4-b440-34a1357fc744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:02.672213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bab606-56b8-47d4-b440-34a1357fc744 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:02.685438 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1321/2605] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:36:02.689989 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1b317-e81a-44d9-a00f-a5023758fe7e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:02.700916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1b317-e81a-44d9-a00f-a5023758fe7e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:02.706078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba553495-3e59-4c2d-868d-f6c63367acdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:02.707113 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba553495-3e59-4c2d-868d-f6c63367acdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:02.707484 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba553495-3e59-4c2d-868d-f6c63367acdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:02.707964 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba553495-3e59-4c2d-868d-f6c63367acdf admin admin] PATH_INFO: `/v3/projects/954e8fe2fad34c94beb49b60a0e06deb/users/efcd7291a04f4535ace58ee566db44e7/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:02.725095 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba553495-3e59-4c2d-868d-f6c63367acdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=954e8fe2fad34c94beb49b60a0e06deb, user_id=efcd7291a04f4535ace58ee566db44e7, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:02.728026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba553495-3e59-4c2d-868d-f6c63367acdf admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:02.746583 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1285/2606] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:36:02 2022] PUT /identity/v3/projects/954e8fe2fad34c94beb49b60a0e06deb/users/efcd7291a04f4535ace58ee566db44e7/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:02.750583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bab606-56b8-47d4-b440-34a1357fc744 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:02.762721 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bab606-56b8-47d4-b440-34a1357fc744 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:02.830893 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b46ea-41b1-4cad-9e2f-9e383f4118c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:02.831580 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b46ea-41b1-4cad-9e2f-9e383f4118c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:02.831858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b46ea-41b1-4cad-9e2f-9e383f4118c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:02.832130 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b46ea-41b1-4cad-9e2f-9e383f4118c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:02.832881 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b46ea-41b1-4cad-9e2f-9e383f4118c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:02.834530 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b46ea-41b1-4cad-9e2f-9e383f4118c9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:02.848245 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1322/2607] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:36:02.852219 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba553495-3e59-4c2d-868d-f6c63367acdf admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:02.864586 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba553495-3e59-4c2d-868d-f6c63367acdf admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:02.869601 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cd46a-2ef0-43e8-8f93-7ee94ecc99c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:02.870602 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cd46a-2ef0-43e8-8f93-7ee94ecc99c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:02.870884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cd46a-2ef0-43e8-8f93-7ee94ecc99c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:02.871159 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cd46a-2ef0-43e8-8f93-7ee94ecc99c0 admin admin] PATH_INFO: `/v3/projects/954e8fe2fad34c94beb49b60a0e06deb/users/efcd7291a04f4535ace58ee566db44e7/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:02.873312 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cd46a-2ef0-43e8-8f93-7ee94ecc99c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=954e8fe2fad34c94beb49b60a0e06deb, user_id=efcd7291a04f4535ace58ee566db44e7, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:02.876014 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cd46a-2ef0-43e8-8f93-7ee94ecc99c0 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:02.902084 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1286/2608] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:36:02 2022] PUT /identity/v3/projects/954e8fe2fad34c94beb49b60a0e06deb/users/efcd7291a04f4535ace58ee566db44e7/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:02.913392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b55ff2-e1ea-4b92-97fb-ce3d56d296e7 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:02.913684 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b55ff2-e1ea-4b92-97fb-ce3d56d296e7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:02.913986 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b55ff2-e1ea-4b92-97fb-ce3d56d296e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:02.946742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e2b55ff2-e1ea-4b92-97fb-ce3d56d296e7 None None] MFA Rules not processed for user `efcd7291a04f4535ace58ee566db44e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:02.948028 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e2b55ff2-e1ea-4b92-97fb-ce3d56d296e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:03.025632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1323/2609] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:03.037762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cd46a-2ef0-43e8-8f93-7ee94ecc99c0 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:03.042587 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-bc2cd46a-2ef0-43e8-8f93-7ee94ecc99c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:03.088864 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:03.121718 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cd46a-2ef0-43e8-8f93-7ee94ecc99c0 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:03.125858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5fae1-6f75-41ac-984d-43fb71977b40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:03.126598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5fae1-6f75-41ac-984d-43fb71977b40 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:03.127318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5fae1-6f75-41ac-984d-43fb71977b40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:03.127318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5fae1-6f75-41ac-984d-43fb71977b40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:03.138050 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5fae1-6f75-41ac-984d-43fb71977b40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:03.139847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5fae1-6f75-41ac-984d-43fb71977b40 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:03.154435 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1287/2610] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:36:04.008735 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b55ff2-e1ea-4b92-97fb-ce3d56d296e7 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:04.035936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:04.117188 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b55ff2-e1ea-4b92-97fb-ce3d56d296e7 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:04.126106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20352636-c077-4cec-a119-ab97360bf69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:04.127320 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20352636-c077-4cec-a119-ab97360bf69f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:04.127776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20352636-c077-4cec-a119-ab97360bf69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:04.128202 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20352636-c077-4cec-a119-ab97360bf69f admin admin] PATH_INFO: `/v3/users/9e56893a0d194024a0af642389a7daa4` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:04.129604 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20352636-c077-4cec-a119-ab97360bf69f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e56893a0d194024a0af642389a7daa4)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:04.133155 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20352636-c077-4cec-a119-ab97360bf69f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:04.210956 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-20352636-c077-4cec-a119-ab97360bf69f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e56893a0d194024a0af642389a7daa4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:04.213022 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-20352636-c077-4cec-a119-ab97360bf69f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e56893a0d194024a0af642389a7daa4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:04.222896 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-20352636-c077-4cec-a119-ab97360bf69f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e56893a0d194024a0af642389a7daa4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:04.237067 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-20352636-c077-4cec-a119-ab97360bf69f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e56893a0d194024a0af642389a7daa4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:04.237788 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-20352636-c077-4cec-a119-ab97360bf69f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e56893a0d194024a0af642389a7daa4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:04.268547 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1324/2611] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:36:04 2022] DELETE /identity/v3/users/9e56893a0d194024a0af642389a7daa4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:04.270885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904818d5-0255-485b-88ef-e7ea2f451f5d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:04.271361 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904818d5-0255-485b-88ef-e7ea2f451f5d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:04.272020 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904818d5-0255-485b-88ef-e7ea2f451f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:04.291370 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-904818d5-0255-485b-88ef-e7ea2f451f5d None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:04.292145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-904818d5-0255-485b-88ef-e7ea2f451f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:04.360231 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1288/2612] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:04.370596 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20352636-c077-4cec-a119-ab97360bf69f admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:04.371920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-20352636-c077-4cec-a119-ab97360bf69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:04.442178 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20352636-c077-4cec-a119-ab97360bf69f admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:04.445705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d6f09-7194-4860-add9-4ae2d0e4a3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:04.446488 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d6f09-7194-4860-add9-4ae2d0e4a3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:04.446864 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d6f09-7194-4860-add9-4ae2d0e4a3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:04.447286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d6f09-7194-4860-add9-4ae2d0e4a3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:04.457157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d6f09-7194-4860-add9-4ae2d0e4a3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:04.458761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d6f09-7194-4860-add9-4ae2d0e4a3c6 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:04.471677 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1325/2613] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:36:04.817527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904818d5-0255-485b-88ef-e7ea2f451f5d None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:04.821268 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-904818d5-0255-485b-88ef-e7ea2f451f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:04.851995 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904818d5-0255-485b-88ef-e7ea2f451f5d None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:04.858284 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d9a7c-0c33-4beb-9f79-015a8215f5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:04.859322 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d9a7c-0c33-4beb-9f79-015a8215f5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:04.859603 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d9a7c-0c33-4beb-9f79-015a8215f5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:04.859874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d9a7c-0c33-4beb-9f79-015a8215f5d4 admin admin] PATH_INFO: `/v3/projects/33a24c27f4c543278911c6bced7d887f` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:04.861596 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d9a7c-0c33-4beb-9f79-015a8215f5d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a24c27f4c543278911c6bced7d887f)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:04.864136 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d9a7c-0c33-4beb-9f79-015a8215f5d4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:04.936679 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1b9d9a7c-0c33-4beb-9f79-015a8215f5d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a24c27f4c543278911c6bced7d887f', 'request_id': 'req-1b9d9a7c-0c33-4beb-9f79-015a8215f5d4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:04.942422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106665d-d799-47e9-967a-0a63a58c0e10 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:04.942599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1b9d9a7c-0c33-4beb-9f79-015a8215f5d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a24c27f4c543278911c6bced7d887f', 'request_id': 'req-1b9d9a7c-0c33-4beb-9f79-015a8215f5d4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:04.942715 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106665d-d799-47e9-967a-0a63a58c0e10 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:04.942963 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106665d-d799-47e9-967a-0a63a58c0e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:04.958812 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1b9d9a7c-0c33-4beb-9f79-015a8215f5d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a24c27f4c543278911c6bced7d887f', 'request_id': 'req-1b9d9a7c-0c33-4beb-9f79-015a8215f5d4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:04.974841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f106665d-d799-47e9-967a-0a63a58c0e10 None None] MFA Rules not processed for user `d160ccef27104953beadc68e74b2d49e`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:04.976473 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1b9d9a7c-0c33-4beb-9f79-015a8215f5d4 admin admin] The token cache is being invalidate because project 33a24c27f4c543278911c6bced7d887f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:36:04.976473 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1b9d9a7c-0c33-4beb-9f79-015a8215f5d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:04.976725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f106665d-d799-47e9-967a-0a63a58c0e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:04.978239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1b9d9a7c-0c33-4beb-9f79-015a8215f5d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:04.980115 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1289/2614] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:36:04 2022] DELETE /identity/v3/projects/33a24c27f4c543278911c6bced7d887f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:04.984156 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d9a7c-0c33-4beb-9f79-015a8215f5d4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:04.985739 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1b9d9a7c-0c33-4beb-9f79-015a8215f5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:05.033310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:05.060573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:05.077298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d9a7c-0c33-4beb-9f79-015a8215f5d4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:05.082139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1326/2615] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:05.086721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b2e8a-d64c-4942-a511-76c4c6b3c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:05.087741 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b2e8a-d64c-4942-a511-76c4c6b3c90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:05.088120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b2e8a-d64c-4942-a511-76c4c6b3c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:05.088481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b2e8a-d64c-4942-a511-76c4c6b3c90e admin admin] PATH_INFO: `/v3/users/efcd7291a04f4535ace58ee566db44e7` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:05.089885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b2e8a-d64c-4942-a511-76c4c6b3c90e admin admin] RBAC: Authorizing `identity:delete_user(user_id=efcd7291a04f4535ace58ee566db44e7)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:05.091912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b2e8a-d64c-4942-a511-76c4c6b3c90e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:05.098366 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106665d-d799-47e9-967a-0a63a58c0e10 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:05.099992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f106665d-d799-47e9-967a-0a63a58c0e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:05.160670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e45b2e8a-d64c-4942-a511-76c4c6b3c90e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efcd7291a04f4535ace58ee566db44e7'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:05.161673 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e45b2e8a-d64c-4942-a511-76c4c6b3c90e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efcd7291a04f4535ace58ee566db44e7'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:05.182335 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e45b2e8a-d64c-4942-a511-76c4c6b3c90e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efcd7291a04f4535ace58ee566db44e7'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:05.204243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e45b2e8a-d64c-4942-a511-76c4c6b3c90e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efcd7291a04f4535ace58ee566db44e7'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:05.205016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e45b2e8a-d64c-4942-a511-76c4c6b3c90e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efcd7291a04f4535ace58ee566db44e7'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:05.208389 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106665d-d799-47e9-967a-0a63a58c0e10 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:05.214439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414bf6a-3be6-477b-b150-d0cfaa0accba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:05.215033 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414bf6a-3be6-477b-b150-d0cfaa0accba service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:05.215311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414bf6a-3be6-477b-b150-d0cfaa0accba service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:05.215614 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414bf6a-3be6-477b-b150-d0cfaa0accba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:05.217516 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6414bf6a-3be6-477b-b150-d0cfaa0accba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:05.228931 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1290/2616] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:36:04 2022] DELETE /identity/v3/users/efcd7291a04f4535ace58ee566db44e7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:36:05.230357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414bf6a-3be6-477b-b150-d0cfaa0accba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:05.232324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414bf6a-3be6-477b-b150-d0cfaa0accba service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:05.243010 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1327/2617] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:36:05.567668 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b2e8a-d64c-4942-a511-76c4c6b3c90e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:05.569396 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e45b2e8a-d64c-4942-a511-76c4c6b3c90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:05.662090 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b2e8a-d64c-4942-a511-76c4c6b3c90e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:05.669101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc9c81-f083-44b4-85e8-eefc8d5a608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:05.670089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc9c81-f083-44b4-85e8-eefc8d5a608c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:05.670408 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc9c81-f083-44b4-85e8-eefc8d5a608c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:05.670684 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc9c81-f083-44b4-85e8-eefc8d5a608c admin admin] PATH_INFO: `/v3/projects/954e8fe2fad34c94beb49b60a0e06deb` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:05.673342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc9c81-f083-44b4-85e8-eefc8d5a608c admin admin] RBAC: Authorizing `identity:delete_project(project_id=954e8fe2fad34c94beb49b60a0e06deb)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:05.676977 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc9c81-f083-44b4-85e8-eefc8d5a608c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:05.740325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-12fc9c81-f083-44b4-85e8-eefc8d5a608c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954e8fe2fad34c94beb49b60a0e06deb', 'request_id': 'req-12fc9c81-f083-44b4-85e8-eefc8d5a608c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:05.746896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-12fc9c81-f083-44b4-85e8-eefc8d5a608c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954e8fe2fad34c94beb49b60a0e06deb', 'request_id': 'req-12fc9c81-f083-44b4-85e8-eefc8d5a608c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:05.757877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-12fc9c81-f083-44b4-85e8-eefc8d5a608c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954e8fe2fad34c94beb49b60a0e06deb', 'request_id': 'req-12fc9c81-f083-44b4-85e8-eefc8d5a608c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:05.770087 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-12fc9c81-f083-44b4-85e8-eefc8d5a608c admin admin] The token cache is being invalidate because project 954e8fe2fad34c94beb49b60a0e06deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:36:05.770378 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-12fc9c81-f083-44b4-85e8-eefc8d5a608c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:05.771186 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-12fc9c81-f083-44b4-85e8-eefc8d5a608c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:05.773375 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1291/2618] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:36:05 2022] DELETE /identity/v3/projects/954e8fe2fad34c94beb49b60a0e06deb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:05.778968 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee34d41-dc61-434a-8578-093ff6f25fb7 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:05.779337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee34d41-dc61-434a-8578-093ff6f25fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:05.779780 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee34d41-dc61-434a-8578-093ff6f25fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:05.819104 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-8ee34d41-dc61-434a-8578-093ff6f25fb7 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:05.820472 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8ee34d41-dc61-434a-8578-093ff6f25fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:05.930990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1328/2619] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:05.933452 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9033cc2-31fb-478e-a65b-e14505bb6cf2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:05.933740 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9033cc2-31fb-478e-a65b-e14505bb6cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:05.934037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9033cc2-31fb-478e-a65b-e14505bb6cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:05.948054 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:05.963773 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-c9033cc2-31fb-478e-a65b-e14505bb6cf2 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:05.965874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c9033cc2-31fb-478e-a65b-e14505bb6cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:05.978407 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1292/2620] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:05.979695 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee34d41-dc61-434a-8578-093ff6f25fb7 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:05.990228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee34d41-dc61-434a-8578-093ff6f25fb7 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:05.995192 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e855f9-0731-442c-a776-b84392a85016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:05.996357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e855f9-0731-442c-a776-b84392a85016 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:05.996357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e855f9-0731-442c-a776-b84392a85016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:05.996683 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e855f9-0731-442c-a776-b84392a85016 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:05.997430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e855f9-0731-442c-a776-b84392a85016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:36:05.997742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e855f9-0731-442c-a776-b84392a85016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:05.999619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e855f9-0731-442c-a776-b84392a85016 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:06.013248 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1329/2621] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:36:06.018398 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9033cc2-31fb-478e-a65b-e14505bb6cf2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:06.028744 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9033cc2-31fb-478e-a65b-e14505bb6cf2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:06.034027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c585d9-f5b5-44d1-8a9e-5eff2ff113ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:06.034764 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c585d9-f5b5-44d1-8a9e-5eff2ff113ec admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:06.035129 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c585d9-f5b5-44d1-8a9e-5eff2ff113ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:06.035465 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c585d9-f5b5-44d1-8a9e-5eff2ff113ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:06.036244 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c585d9-f5b5-44d1-8a9e-5eff2ff113ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:06.038856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c585d9-f5b5-44d1-8a9e-5eff2ff113ec admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:06.077884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1293/2622] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:36:06 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:36:06.080322 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e855f9-0731-442c-a776-b84392a85016 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:06.093700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e855f9-0731-442c-a776-b84392a85016 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:06.146683 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:06.168097 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf8fe0-f886-49ca-8692-4c6724d9071c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:06.168904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf8fe0-f886-49ca-8692-4c6724d9071c admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:06.169253 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf8fe0-f886-49ca-8692-4c6724d9071c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:06.169592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf8fe0-f886-49ca-8692-4c6724d9071c admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:06.170528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf8fe0-f886-49ca-8692-4c6724d9071c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:06.172713 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf8fe0-f886-49ca-8692-4c6724d9071c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:06.200481 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1330/2623] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:36:06 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:36:06.204463 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c585d9-f5b5-44d1-8a9e-5eff2ff113ec admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:06.214989 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c585d9-f5b5-44d1-8a9e-5eff2ff113ec admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:06.220525 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc254e-a314-4909-aa85-763cb532ae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:06.221264 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc254e-a314-4909-aa85-763cb532ae83 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:06.221550 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc254e-a314-4909-aa85-763cb532ae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:06.221837 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc254e-a314-4909-aa85-763cb532ae83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:06.222579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc254e-a314-4909-aa85-763cb532ae83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:06.224386 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc254e-a314-4909-aa85-763cb532ae83 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:06.237350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1294/2624] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:36:06.241729 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf8fe0-f886-49ca-8692-4c6724d9071c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:06.252622 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf8fe0-f886-49ca-8692-4c6724d9071c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:06.257788 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685f5ed-9da6-4870-a712-4cb0d78ba6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:06.258504 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685f5ed-9da6-4870-a712-4cb0d78ba6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:06.258787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685f5ed-9da6-4870-a712-4cb0d78ba6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:06.259063 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685f5ed-9da6-4870-a712-4cb0d78ba6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:06.259802 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685f5ed-9da6-4870-a712-4cb0d78ba6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:06.261420 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685f5ed-9da6-4870-a712-4cb0d78ba6c6 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:06.277159 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1331/2625] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:36:06.278751 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc254e-a314-4909-aa85-763cb532ae83 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:06.290352 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc254e-a314-4909-aa85-763cb532ae83 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:06.295950 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cd317-320e-429d-a0f8-2beb971eb82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:06.296942 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cd317-320e-429d-a0f8-2beb971eb82b admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:06.297212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cd317-320e-429d-a0f8-2beb971eb82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:06.297534 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cd317-320e-429d-a0f8-2beb971eb82b admin admin] PATH_INFO: `/v3/projects/49291351324643eda4c6402b1eaedb04/users/f78dfc22e724485b8e981f7dfe82c1c6/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:06.317103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cd317-320e-429d-a0f8-2beb971eb82b admin admin] RBAC: Authorizing `identity:create_grant(project_id=49291351324643eda4c6402b1eaedb04, user_id=f78dfc22e724485b8e981f7dfe82c1c6, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:06.320184 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cd317-320e-429d-a0f8-2beb971eb82b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:06.338440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1295/2626] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:36:06 2022] PUT /identity/v3/projects/49291351324643eda4c6402b1eaedb04/users/f78dfc22e724485b8e981f7dfe82c1c6/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:06.343830 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a139d-0030-4731-9ea3-93e494bd3bc2 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:06.344524 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a139d-0030-4731-9ea3-93e494bd3bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:06.344964 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a139d-0030-4731-9ea3-93e494bd3bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:06.368916 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f20a139d-0030-4731-9ea3-93e494bd3bc2 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:06.370571 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f20a139d-0030-4731-9ea3-93e494bd3bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:06.444395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1332/2627] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:06.454217 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cd317-320e-429d-a0f8-2beb971eb82b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:06.456132 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-496cd317-320e-429d-a0f8-2beb971eb82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:06.527533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cd317-320e-429d-a0f8-2beb971eb82b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:06.536305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f8e0d-b203-4aa7-b34c-369d9371f7a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:06.537462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f8e0d-b203-4aa7-b34c-369d9371f7a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:06.537773 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f8e0d-b203-4aa7-b34c-369d9371f7a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:06.538080 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f8e0d-b203-4aa7-b34c-369d9371f7a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:06.552167 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f8e0d-b203-4aa7-b34c-369d9371f7a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:06.553870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f8e0d-b203-4aa7-b34c-369d9371f7a4 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:06.563836 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1296/2628] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:36:06.820653 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9db471-bfb6-43ce-b871-115a4a412c0b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:06.820939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9db471-bfb6-43ce-b871-115a4a412c0b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:06.821214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9db471-bfb6-43ce-b871-115a4a412c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:06.839469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4d9db471-bfb6-43ce-b871-115a4a412c0b None None] MFA Rules not processed for user `d160ccef27104953beadc68e74b2d49e`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:06.840688 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4d9db471-bfb6-43ce-b871-115a4a412c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:06.907285 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1333/2629] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:36:07.410773 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64478e06-74e3-4581-b28a-1b068090bd8d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:07.411667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64478e06-74e3-4581-b28a-1b068090bd8d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:07.412256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64478e06-74e3-4581-b28a-1b068090bd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:07.415284 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9db471-bfb6-43ce-b871-115a4a412c0b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:07.427707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9db471-bfb6-43ce-b871-115a4a412c0b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:07.432465 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8187e-77fe-441d-9272-1c90786cbd5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:07.434098 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8187e-77fe-441d-9272-1c90786cbd5a service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:07.434584 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8187e-77fe-441d-9272-1c90786cbd5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:07.435028 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8187e-77fe-441d-9272-1c90786cbd5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:07.438453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-78f8187e-77fe-441d-9272-1c90786cbd5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:07.453648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8187e-77fe-441d-9272-1c90786cbd5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:07.460422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8187e-77fe-441d-9272-1c90786cbd5a service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:07.462591 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-64478e06-74e3-4581-b28a-1b068090bd8d None None] MFA Rules not processed for user `f78dfc22e724485b8e981f7dfe82c1c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:07.463953 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-64478e06-74e3-4581-b28a-1b068090bd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:07.472222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1334/2630] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:36:07.569507 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1297/2631] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:07.574145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8187e-77fe-441d-9272-1c90786cbd5a service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:07.586849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8187e-77fe-441d-9272-1c90786cbd5a service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:07.593291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf90db-21e0-4204-9074-ed24654acd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:07.593999 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf90db-21e0-4204-9074-ed24654acd0a admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:07.594279 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf90db-21e0-4204-9074-ed24654acd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:07.594553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf90db-21e0-4204-9074-ed24654acd0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:07.595774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf90db-21e0-4204-9074-ed24654acd0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:07.598168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf90db-21e0-4204-9074-ed24654acd0a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:07.640490 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1335/2632] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:36:07 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:36:07.644417 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64478e06-74e3-4581-b28a-1b068090bd8d None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:07.656907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64478e06-74e3-4581-b28a-1b068090bd8d None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:07.697669 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:07.734454 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47479187-7a38-4387-b83a-b163c8e3555a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:07.735310 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47479187-7a38-4387-b83a-b163c8e3555a admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:07.735681 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47479187-7a38-4387-b83a-b163c8e3555a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:07.736020 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47479187-7a38-4387-b83a-b163c8e3555a admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:07.737020 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47479187-7a38-4387-b83a-b163c8e3555a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:07.740385 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47479187-7a38-4387-b83a-b163c8e3555a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:07.771997 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1298/2633] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:36:07 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:36:07.773378 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf90db-21e0-4204-9074-ed24654acd0a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:07.786573 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf90db-21e0-4204-9074-ed24654acd0a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:07.794228 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a3437-5e28-4f3d-8c88-35f4c1ac9ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:07.795552 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a3437-5e28-4f3d-8c88-35f4c1ac9ada admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:07.795705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a3437-5e28-4f3d-8c88-35f4c1ac9ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:07.796270 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a3437-5e28-4f3d-8c88-35f4c1ac9ada admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:07.797319 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a3437-5e28-4f3d-8c88-35f4c1ac9ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:07.799277 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a3437-5e28-4f3d-8c88-35f4c1ac9ada admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:07.815026 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1336/2634] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:36:07.820002 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47479187-7a38-4387-b83a-b163c8e3555a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:07.835037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47479187-7a38-4387-b83a-b163c8e3555a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:07.840961 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fae7df-8d77-4ab4-8859-4858e7b2a8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:07.842153 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fae7df-8d77-4ab4-8859-4858e7b2a8d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:07.842578 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fae7df-8d77-4ab4-8859-4858e7b2a8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:07.843020 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fae7df-8d77-4ab4-8859-4858e7b2a8d5 admin admin] PATH_INFO: `/v3/projects/dad3fefc8fb64ba5a4e589afbe3790b7/users/e34f3673356c44a2b2dc471571454a38/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:07.862856 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fae7df-8d77-4ab4-8859-4858e7b2a8d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad3fefc8fb64ba5a4e589afbe3790b7, user_id=e34f3673356c44a2b2dc471571454a38, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:07.865980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fae7df-8d77-4ab4-8859-4858e7b2a8d5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:07.890492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1299/2635] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:36:07 2022] PUT /identity/v3/projects/dad3fefc8fb64ba5a4e589afbe3790b7/users/e34f3673356c44a2b2dc471571454a38/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:36:07.894276 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a3437-5e28-4f3d-8c88-35f4c1ac9ada admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:07.905995 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a3437-5e28-4f3d-8c88-35f4c1ac9ada admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:07.925179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fae7df-8d77-4ab4-8859-4858e7b2a8d5 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:07.928538 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-03fae7df-8d77-4ab4-8859-4858e7b2a8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:07.941994 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:08.040744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a1e1f-cadf-42d2-a0d8-5ce4720e865a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:08.042158 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a1e1f-cadf-42d2-a0d8-5ce4720e865a admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:08.042548 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a1e1f-cadf-42d2-a0d8-5ce4720e865a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:08.042947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a1e1f-cadf-42d2-a0d8-5ce4720e865a admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:08.044346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a1e1f-cadf-42d2-a0d8-5ce4720e865a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:08.046609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a1e1f-cadf-42d2-a0d8-5ce4720e865a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:08.059854 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fae7df-8d77-4ab4-8859-4858e7b2a8d5 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:08.067439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1337/2636] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:36:08.071134 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5aae62-84ef-4c23-90ed-b1442f2c1c89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:08.072042 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aae62-84ef-4c23-90ed-b1442f2c1c89 service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:08.072323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aae62-84ef-4c23-90ed-b1442f2c1c89 service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:08.072445 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a1e1f-cadf-42d2-a0d8-5ce4720e865a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:08.072669 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aae62-84ef-4c23-90ed-b1442f2c1c89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:08.075349 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ec5aae62-84ef-4c23-90ed-b1442f2c1c89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:08.088492 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5aae62-84ef-4c23-90ed-b1442f2c1c89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:08.088695 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a1e1f-cadf-42d2-a0d8-5ce4720e865a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:08.090722 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5aae62-84ef-4c23-90ed-b1442f2c1c89 service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:08.094654 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c40b2-27e6-45ba-9c03-f9186ce61a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:08.096120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c40b2-27e6-45ba-9c03-f9186ce61a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:08.096419 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c40b2-27e6-45ba-9c03-f9186ce61a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:08.096700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c40b2-27e6-45ba-9c03-f9186ce61a7d admin admin] PATH_INFO: `/v3/projects/dad3fefc8fb64ba5a4e589afbe3790b7/users/e34f3673356c44a2b2dc471571454a38/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:08.101870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c40b2-27e6-45ba-9c03-f9186ce61a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad3fefc8fb64ba5a4e589afbe3790b7, user_id=e34f3673356c44a2b2dc471571454a38, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:08.104654 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c40b2-27e6-45ba-9c03-f9186ce61a7d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:08.106348 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1300/2637] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:36:08.116617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1338/2638] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:36:08 2022] PUT /identity/v3/projects/dad3fefc8fb64ba5a4e589afbe3790b7/users/e34f3673356c44a2b2dc471571454a38/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:09.420104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66124f3-81fe-4d31-b638-642cd91ac592 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:09.420605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66124f3-81fe-4d31-b638-642cd91ac592 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:09.420698 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66124f3-81fe-4d31-b638-642cd91ac592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:09.478744 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b66124f3-81fe-4d31-b638-642cd91ac592 None None] MFA Rules not processed for user `e34f3673356c44a2b2dc471571454a38`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:09.481647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b66124f3-81fe-4d31-b638-642cd91ac592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:09.615111 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1301/2639] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:09.627341 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c40b2-27e6-45ba-9c03-f9186ce61a7d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:09.629457 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5a3c40b2-27e6-45ba-9c03-f9186ce61a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:09.705076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c40b2-27e6-45ba-9c03-f9186ce61a7d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:09.709193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c22d5-237e-49e2-af6b-f16f278ca082 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:09.710526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c22d5-237e-49e2-af6b-f16f278ca082 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:09.710849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c22d5-237e-49e2-af6b-f16f278ca082 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:09.711132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c22d5-237e-49e2-af6b-f16f278ca082 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:09.794876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c22d5-237e-49e2-af6b-f16f278ca082 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:09.796776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c22d5-237e-49e2-af6b-f16f278ca082 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:09.809573 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1339/2640] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:36:16.384939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66124f3-81fe-4d31-b638-642cd91ac592 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:16.386555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b66124f3-81fe-4d31-b638-642cd91ac592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:16.402149 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:16.473588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66124f3-81fe-4d31-b638-642cd91ac592 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:16.479582 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ec296-02c1-492a-ba56-1ee9a2b4c48a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:16.480241 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ec296-02c1-492a-ba56-1ee9a2b4c48a service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:16.480520 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ec296-02c1-492a-ba56-1ee9a2b4c48a service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:16.480792 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ec296-02c1-492a-ba56-1ee9a2b4c48a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:16.482715 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-650ec296-02c1-492a-ba56-1ee9a2b4c48a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:16.495137 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ec296-02c1-492a-ba56-1ee9a2b4c48a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:16.496731 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ec296-02c1-492a-ba56-1ee9a2b4c48a service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:16.507344 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1302/2641] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:36:19.745309 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c22d5-237e-49e2-af6b-f16f278ca082 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:19.759140 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c22d5-237e-49e2-af6b-f16f278ca082 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:19.764711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e18c3-2d53-40a6-a080-2334835f94be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:19.765364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e18c3-2d53-40a6-a080-2334835f94be service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:19.765638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e18c3-2d53-40a6-a080-2334835f94be service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:19.765933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e18c3-2d53-40a6-a080-2334835f94be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:19.767877 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c55e18c3-2d53-40a6-a080-2334835f94be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:19.780815 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e18c3-2d53-40a6-a080-2334835f94be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:19.782453 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e18c3-2d53-40a6-a080-2334835f94be service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:19.793651 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1340/2642] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:36:26.502812 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=29 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:29.788611 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=79,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:43.079177 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ec296-02c1-492a-ba56-1ee9a2b4c48a service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:43.080636 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-650ec296-02c1-492a-ba56-1ee9a2b4c48a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:43.093994 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ec296-02c1-492a-ba56-1ee9a2b4c48a service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:43.097750 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428cc02-f749-4f2b-99d9-4f3598f486dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:43.098424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428cc02-f749-4f2b-99d9-4f3598f486dd service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:43.098700 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428cc02-f749-4f2b-99d9-4f3598f486dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:43.098974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428cc02-f749-4f2b-99d9-4f3598f486dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:43.112024 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428cc02-f749-4f2b-99d9-4f3598f486dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:43.113910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428cc02-f749-4f2b-99d9-4f3598f486dd service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:43.126181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1303/2643] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:36:49.620178 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e18c3-2d53-40a6-a080-2334835f94be service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:49.630350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e18c3-2d53-40a6-a080-2334835f94be service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:49.634967 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c8d99-5e7c-409a-836e-59e83cb9132b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:49.635666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c8d99-5e7c-409a-836e-59e83cb9132b service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:49.635913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c8d99-5e7c-409a-836e-59e83cb9132b service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:49.636221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c8d99-5e7c-409a-836e-59e83cb9132b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:49.638707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a42c8d99-5e7c-409a-836e-59e83cb9132b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:49.717324 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c8d99-5e7c-409a-836e-59e83cb9132b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:49.718808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c8d99-5e7c-409a-836e-59e83cb9132b service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:49.740115 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1341/2644] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:36:52.839743 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428cc02-f749-4f2b-99d9-4f3598f486dd service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:52.841239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6428cc02-f749-4f2b-99d9-4f3598f486dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:52.910365 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428cc02-f749-4f2b-99d9-4f3598f486dd service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:52.915847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b495e3-f7d9-48ed-9ce5-bd4c74718d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:52.916726 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b495e3-f7d9-48ed-9ce5-bd4c74718d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:52.917008 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b495e3-f7d9-48ed-9ce5-bd4c74718d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:52.917305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b495e3-f7d9-48ed-9ce5-bd4c74718d09 admin admin] PATH_INFO: `/v3/users/1de6ac96f5ad453f9428d903cbd3d20d` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:52.918713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b495e3-f7d9-48ed-9ce5-bd4c74718d09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de6ac96f5ad453f9428d903cbd3d20d)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:52.920664 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b495e3-f7d9-48ed-9ce5-bd4c74718d09 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:52.968487 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d5b495e3-f7d9-48ed-9ce5-bd4c74718d09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de6ac96f5ad453f9428d903cbd3d20d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:52.969112 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d5b495e3-f7d9-48ed-9ce5-bd4c74718d09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de6ac96f5ad453f9428d903cbd3d20d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:52.975794 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d5b495e3-f7d9-48ed-9ce5-bd4c74718d09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de6ac96f5ad453f9428d903cbd3d20d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:52.988635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d5b495e3-f7d9-48ed-9ce5-bd4c74718d09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de6ac96f5ad453f9428d903cbd3d20d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:52.989265 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d5b495e3-f7d9-48ed-9ce5-bd4c74718d09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de6ac96f5ad453f9428d903cbd3d20d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:53.002875 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1304/2645] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:36:52 2022] DELETE /identity/v3/users/1de6ac96f5ad453f9428d903cbd3d20d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:53.007797 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fce185-a60d-4c0a-90f6-1cf4288ea080 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:53.008311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fce185-a60d-4c0a-90f6-1cf4288ea080 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:53.008467 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fce185-a60d-4c0a-90f6-1cf4288ea080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:53.035394 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-87fce185-a60d-4c0a-90f6-1cf4288ea080 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:53.037174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-87fce185-a60d-4c0a-90f6-1cf4288ea080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:53.102624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1342/2646] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:53.113130 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b495e3-f7d9-48ed-9ce5-bd4c74718d09 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:53.114831 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d5b495e3-f7d9-48ed-9ce5-bd4c74718d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:53.176451 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b495e3-f7d9-48ed-9ce5-bd4c74718d09 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:53.181132 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144de7a-a9cd-480d-ace8-93752d122c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:53.181829 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144de7a-a9cd-480d-ace8-93752d122c11 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:53.182186 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144de7a-a9cd-480d-ace8-93752d122c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:53.182450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144de7a-a9cd-480d-ace8-93752d122c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:53.192684 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144de7a-a9cd-480d-ace8-93752d122c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:53.194168 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144de7a-a9cd-480d-ace8-93752d122c11 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:53.204236 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1305/2647] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:36:53.484708 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fce185-a60d-4c0a-90f6-1cf4288ea080 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:53.486194 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-87fce185-a60d-4c0a-90f6-1cf4288ea080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:53.498876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fce185-a60d-4c0a-90f6-1cf4288ea080 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:53.504137 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888425f-3f0e-4820-8fb0-083d9f1f48c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:53.505077 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888425f-3f0e-4820-8fb0-083d9f1f48c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:53.505353 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888425f-3f0e-4820-8fb0-083d9f1f48c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:53.505623 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888425f-3f0e-4820-8fb0-083d9f1f48c0 admin admin] PATH_INFO: `/v3/projects/396a4a64d80c436d80ab7a4bcc0c7efd` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:53.506852 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888425f-3f0e-4820-8fb0-083d9f1f48c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=396a4a64d80c436d80ab7a4bcc0c7efd)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:53.509067 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888425f-3f0e-4820-8fb0-083d9f1f48c0 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:53.575239 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5888425f-3f0e-4820-8fb0-083d9f1f48c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '396a4a64d80c436d80ab7a4bcc0c7efd', 'request_id': 'req-5888425f-3f0e-4820-8fb0-083d9f1f48c0'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:53.584646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5888425f-3f0e-4820-8fb0-083d9f1f48c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '396a4a64d80c436d80ab7a4bcc0c7efd', 'request_id': 'req-5888425f-3f0e-4820-8fb0-083d9f1f48c0'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:53.592265 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5888425f-3f0e-4820-8fb0-083d9f1f48c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '396a4a64d80c436d80ab7a4bcc0c7efd', 'request_id': 'req-5888425f-3f0e-4820-8fb0-083d9f1f48c0'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:53.604161 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5888425f-3f0e-4820-8fb0-083d9f1f48c0 admin admin] The token cache is being invalidate because project 396a4a64d80c436d80ab7a4bcc0c7efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:36:53.604388 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5888425f-3f0e-4820-8fb0-083d9f1f48c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:53.605125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5888425f-3f0e-4820-8fb0-083d9f1f48c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:53.606817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1343/2648] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:36:53 2022] DELETE /identity/v3/projects/396a4a64d80c436d80ab7a4bcc0c7efd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:53.611085 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144de7a-a9cd-480d-ace8-93752d122c11 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:53.621766 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144de7a-a9cd-480d-ace8-93752d122c11 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:53.627256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:53.687471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d55789-fb28-42c5-b5fc-4585a495660c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:53.688350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d55789-fb28-42c5-b5fc-4585a495660c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:53.688631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d55789-fb28-42c5-b5fc-4585a495660c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:53.688901 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d55789-fb28-42c5-b5fc-4585a495660c admin admin] PATH_INFO: `/v3/users/d2b358d4fb3b4b0b9d57b34c1df6a542` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:53.690160 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d55789-fb28-42c5-b5fc-4585a495660c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2b358d4fb3b4b0b9d57b34c1df6a542)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:53.692141 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d55789-fb28-42c5-b5fc-4585a495660c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:53.740671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-47d55789-fb28-42c5-b5fc-4585a495660c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2b358d4fb3b4b0b9d57b34c1df6a542'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:53.741350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-47d55789-fb28-42c5-b5fc-4585a495660c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2b358d4fb3b4b0b9d57b34c1df6a542'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:53.748585 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-47d55789-fb28-42c5-b5fc-4585a495660c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2b358d4fb3b4b0b9d57b34c1df6a542'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:53.761632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-47d55789-fb28-42c5-b5fc-4585a495660c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2b358d4fb3b4b0b9d57b34c1df6a542'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:53.762315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-47d55789-fb28-42c5-b5fc-4585a495660c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2b358d4fb3b4b0b9d57b34c1df6a542'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:53.776648 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1306/2649] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:36:53 2022] DELETE /identity/v3/users/d2b358d4fb3b4b0b9d57b34c1df6a542 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:54.074150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888425f-3f0e-4820-8fb0-083d9f1f48c0 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:54.075786 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5888425f-3f0e-4820-8fb0-083d9f1f48c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:54.087374 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:54.092002 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888425f-3f0e-4820-8fb0-083d9f1f48c0 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:54.150963 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b3b3c-2828-4485-a0a5-0924ca8abb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:54.151963 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b3b3c-2828-4485-a0a5-0924ca8abb41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:54.152280 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b3b3c-2828-4485-a0a5-0924ca8abb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:54.152551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b3b3c-2828-4485-a0a5-0924ca8abb41 admin admin] PATH_INFO: `/v3/projects/2ebef2c42b82425789d9c7b8bd616e56` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:54.153756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b3b3c-2828-4485-a0a5-0924ca8abb41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ebef2c42b82425789d9c7b8bd616e56)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:54.155728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b3b3c-2828-4485-a0a5-0924ca8abb41 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:54.205910 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4a2b3b3c-2828-4485-a0a5-0924ca8abb41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ebef2c42b82425789d9c7b8bd616e56', 'request_id': 'req-4a2b3b3c-2828-4485-a0a5-0924ca8abb41'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:54.214033 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4a2b3b3c-2828-4485-a0a5-0924ca8abb41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ebef2c42b82425789d9c7b8bd616e56', 'request_id': 'req-4a2b3b3c-2828-4485-a0a5-0924ca8abb41'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:54.220829 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4a2b3b3c-2828-4485-a0a5-0924ca8abb41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ebef2c42b82425789d9c7b8bd616e56', 'request_id': 'req-4a2b3b3c-2828-4485-a0a5-0924ca8abb41'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:54.230978 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4a2b3b3c-2828-4485-a0a5-0924ca8abb41 admin admin] The token cache is being invalidate because project 2ebef2c42b82425789d9c7b8bd616e56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:36:54.231260 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4a2b3b3c-2828-4485-a0a5-0924ca8abb41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:54.231875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4a2b3b3c-2828-4485-a0a5-0924ca8abb41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:54.233393 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1344/2650] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:36:54 2022] DELETE /identity/v3/projects/2ebef2c42b82425789d9c7b8bd616e56 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:54.238489 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba327905-d86d-4fa6-97e3-24a4a70322fe None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:54.239082 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba327905-d86d-4fa6-97e3-24a4a70322fe None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:54.239082 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba327905-d86d-4fa6-97e3-24a4a70322fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:54.258018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ba327905-d86d-4fa6-97e3-24a4a70322fe None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:54.259225 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ba327905-d86d-4fa6-97e3-24a4a70322fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:54.321475 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1307/2651] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:54.331195 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af805ec5-0281-4ed8-b2ed-9f9431d4f763 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:54.331473 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af805ec5-0281-4ed8-b2ed-9f9431d4f763 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:54.331745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af805ec5-0281-4ed8-b2ed-9f9431d4f763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:54.359134 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-af805ec5-0281-4ed8-b2ed-9f9431d4f763 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:54.360345 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-af805ec5-0281-4ed8-b2ed-9f9431d4f763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:54.368645 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1345/2652] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:54.373448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba327905-d86d-4fa6-97e3-24a4a70322fe None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:54.384092 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba327905-d86d-4fa6-97e3-24a4a70322fe None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:54.390555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7bab3-4797-4ee4-95f3-1021f80d0d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:54.391251 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7bab3-4797-4ee4-95f3-1021f80d0d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:54.391528 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7bab3-4797-4ee4-95f3-1021f80d0d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:54.391801 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7bab3-4797-4ee4-95f3-1021f80d0d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:54.392541 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7bab3-4797-4ee4-95f3-1021f80d0d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:36:54.392844 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7bab3-4797-4ee4-95f3-1021f80d0d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:54.394498 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7bab3-4797-4ee4-95f3-1021f80d0d6e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:54.408880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1308/2653] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:36:54.413311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af805ec5-0281-4ed8-b2ed-9f9431d4f763 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:54.422977 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af805ec5-0281-4ed8-b2ed-9f9431d4f763 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:54.428818 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70586568-19b7-4954-8d36-a43e5c7326ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:54.429465 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70586568-19b7-4954-8d36-a43e5c7326ab admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:54.429740 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70586568-19b7-4954-8d36-a43e5c7326ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:54.430046 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70586568-19b7-4954-8d36-a43e5c7326ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:54.430733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70586568-19b7-4954-8d36-a43e5c7326ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:54.432634 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70586568-19b7-4954-8d36-a43e5c7326ab admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:54.460817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1346/2654] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:36:54 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:36:54.466425 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7bab3-4797-4ee4-95f3-1021f80d0d6e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:54.477291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7bab3-4797-4ee4-95f3-1021f80d0d6e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:54.490992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:54.540815 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c820be-8861-4f57-8d26-6a40565eff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:54.541569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c820be-8861-4f57-8d26-6a40565eff78 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:54.541885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c820be-8861-4f57-8d26-6a40565eff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:54.542157 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c820be-8861-4f57-8d26-6a40565eff78 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:54.543306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c820be-8861-4f57-8d26-6a40565eff78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:54.545237 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c820be-8861-4f57-8d26-6a40565eff78 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:54.568530 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1309/2655] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:36:54 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:36:54.572853 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70586568-19b7-4954-8d36-a43e5c7326ab admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:54.583801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70586568-19b7-4954-8d36-a43e5c7326ab admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:54.588524 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27937abf-0b74-40bc-bb16-21440cc87bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:54.589393 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27937abf-0b74-40bc-bb16-21440cc87bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:54.589674 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27937abf-0b74-40bc-bb16-21440cc87bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:54.589978 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27937abf-0b74-40bc-bb16-21440cc87bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:54.590711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27937abf-0b74-40bc-bb16-21440cc87bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:54.592298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27937abf-0b74-40bc-bb16-21440cc87bf5 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:54.602814 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1347/2656] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:36:54.606977 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c820be-8861-4f57-8d26-6a40565eff78 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:54.617475 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c820be-8861-4f57-8d26-6a40565eff78 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:54.622159 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fd5f9-bff4-41b4-a598-014f6655f556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:54.622848 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fd5f9-bff4-41b4-a598-014f6655f556 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:54.623132 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fd5f9-bff4-41b4-a598-014f6655f556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:54.623409 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fd5f9-bff4-41b4-a598-014f6655f556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:54.624138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fd5f9-bff4-41b4-a598-014f6655f556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:54.625824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fd5f9-bff4-41b4-a598-014f6655f556 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:54.636967 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1310/2657] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:36:54.641088 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27937abf-0b74-40bc-bb16-21440cc87bf5 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:54.651154 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27937abf-0b74-40bc-bb16-21440cc87bf5 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:54.655897 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787e76d-8ec8-40e5-8d4c-4373db894e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:54.656791 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787e76d-8ec8-40e5-8d4c-4373db894e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:54.657066 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787e76d-8ec8-40e5-8d4c-4373db894e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:54.657338 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787e76d-8ec8-40e5-8d4c-4373db894e1f admin admin] PATH_INFO: `/v3/projects/8d3ffa1079af40ca876cd1c75cdc696a/users/12d5d83775f04bae827c49c8f4018eed/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:54.672259 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787e76d-8ec8-40e5-8d4c-4373db894e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3ffa1079af40ca876cd1c75cdc696a, user_id=12d5d83775f04bae827c49c8f4018eed, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:54.674875 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787e76d-8ec8-40e5-8d4c-4373db894e1f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:54.690023 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1348/2658] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:36:54 2022] PUT /identity/v3/projects/8d3ffa1079af40ca876cd1c75cdc696a/users/12d5d83775f04bae827c49c8f4018eed/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:36:54.701310 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9825d5-5a2c-4810-b16c-31f0044e8273 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:54.701599 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9825d5-5a2c-4810-b16c-31f0044e8273 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:54.701911 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9825d5-5a2c-4810-b16c-31f0044e8273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:54.730727 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-3e9825d5-5a2c-4810-b16c-31f0044e8273 None None] MFA Rules not processed for user `12d5d83775f04bae827c49c8f4018eed`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:54.732023 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3e9825d5-5a2c-4810-b16c-31f0044e8273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:54.797378 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1311/2659] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:54.802475 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787e76d-8ec8-40e5-8d4c-4373db894e1f admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:54.838427 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:54.869682 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787e76d-8ec8-40e5-8d4c-4373db894e1f admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:54.875146 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420e5c3-9161-439a-9cd9-3fd32ec271b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:54.875806 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420e5c3-9161-439a-9cd9-3fd32ec271b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:54.876082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420e5c3-9161-439a-9cd9-3fd32ec271b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:54.876355 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420e5c3-9161-439a-9cd9-3fd32ec271b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:54.877031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420e5c3-9161-439a-9cd9-3fd32ec271b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:54.878971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420e5c3-9161-439a-9cd9-3fd32ec271b3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:54.908016 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1349/2660] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:36:54 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:36:54.913577 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9825d5-5a2c-4810-b16c-31f0044e8273 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:54.924988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9825d5-5a2c-4810-b16c-31f0044e8273 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:54.982250 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdc80f-dc8a-4bba-84d3-c274d1cde858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:54.982919 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdc80f-dc8a-4bba-84d3-c274d1cde858 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:54.983201 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdc80f-dc8a-4bba-84d3-c274d1cde858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:54.983459 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdc80f-dc8a-4bba-84d3-c274d1cde858 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:54.984166 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bdc80f-dc8a-4bba-84d3-c274d1cde858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:54.986246 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bdc80f-dc8a-4bba-84d3-c274d1cde858 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:55.009752 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1312/2661] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:36:54 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:36:55.014538 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420e5c3-9161-439a-9cd9-3fd32ec271b3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:55.026076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420e5c3-9161-439a-9cd9-3fd32ec271b3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:55.031087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ddcd3-5b54-45cb-9f52-ab95d775e05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:55.031743 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ddcd3-5b54-45cb-9f52-ab95d775e05d admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:55.032019 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ddcd3-5b54-45cb-9f52-ab95d775e05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:55.032288 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ddcd3-5b54-45cb-9f52-ab95d775e05d admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:55.033010 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ddcd3-5b54-45cb-9f52-ab95d775e05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:55.034640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ddcd3-5b54-45cb-9f52-ab95d775e05d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:55.045574 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1350/2662] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:36:55.050099 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdc80f-dc8a-4bba-84d3-c274d1cde858 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:55.062386 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdc80f-dc8a-4bba-84d3-c274d1cde858 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:55.068829 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f5681-94f8-4c23-95e7-98d2306d7e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:55.069719 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f5681-94f8-4c23-95e7-98d2306d7e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:55.070032 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f5681-94f8-4c23-95e7-98d2306d7e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:55.070310 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f5681-94f8-4c23-95e7-98d2306d7e89 admin admin] PATH_INFO: `/v3/projects/53b22f985bab4d6aaa2d87aa7b43fda4/users/a2fc2ad4b24246ed8d00c6d6070f241e/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:55.082274 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:55.086968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f5681-94f8-4c23-95e7-98d2306d7e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b22f985bab4d6aaa2d87aa7b43fda4, user_id=a2fc2ad4b24246ed8d00c6d6070f241e, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:55.090331 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f5681-94f8-4c23-95e7-98d2306d7e89 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:55.106429 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1313/2663] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:36:55 2022] PUT /identity/v3/projects/53b22f985bab4d6aaa2d87aa7b43fda4/users/a2fc2ad4b24246ed8d00c6d6070f241e/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:55.110455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ddcd3-5b54-45cb-9f52-ab95d775e05d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:55.121262 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ddcd3-5b54-45cb-9f52-ab95d775e05d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:55.191682 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cb8db-7766-4719-8e1b-f9c7218a9099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:55.192485 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cb8db-7766-4719-8e1b-f9c7218a9099 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:55.192844 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cb8db-7766-4719-8e1b-f9c7218a9099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:55.193109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cb8db-7766-4719-8e1b-f9c7218a9099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:55.194210 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cb8db-7766-4719-8e1b-f9c7218a9099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:55.196548 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cb8db-7766-4719-8e1b-f9c7218a9099 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:55.207106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1351/2664] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:36:55.211393 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f5681-94f8-4c23-95e7-98d2306d7e89 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:55.221897 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f5681-94f8-4c23-95e7-98d2306d7e89 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:55.226617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb013b69-d1f0-45e2-bf75-e25abc1da369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:55.227480 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb013b69-d1f0-45e2-bf75-e25abc1da369 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:55.227735 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb013b69-d1f0-45e2-bf75-e25abc1da369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:55.228025 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb013b69-d1f0-45e2-bf75-e25abc1da369 admin admin] PATH_INFO: `/v3/projects/53b22f985bab4d6aaa2d87aa7b43fda4/users/a2fc2ad4b24246ed8d00c6d6070f241e/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:55.230137 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb013b69-d1f0-45e2-bf75-e25abc1da369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b22f985bab4d6aaa2d87aa7b43fda4, user_id=a2fc2ad4b24246ed8d00c6d6070f241e, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:55.232774 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb013b69-d1f0-45e2-bf75-e25abc1da369 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:55.243231 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1314/2665] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:36:55 2022] PUT /identity/v3/projects/53b22f985bab4d6aaa2d87aa7b43fda4/users/a2fc2ad4b24246ed8d00c6d6070f241e/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:55.253340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cfc82-a05d-4da8-aae7-a7338c27a2ad None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:55.253607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cfc82-a05d-4da8-aae7-a7338c27a2ad None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:55.253933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cfc82-a05d-4da8-aae7-a7338c27a2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:55.293568 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-2b4cfc82-a05d-4da8-aae7-a7338c27a2ad None None] MFA Rules not processed for user `a2fc2ad4b24246ed8d00c6d6070f241e`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:55.294813 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2b4cfc82-a05d-4da8-aae7-a7338c27a2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:55.363032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1352/2666] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:55.379027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb013b69-d1f0-45e2-bf75-e25abc1da369 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:55.381531 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-bb013b69-d1f0-45e2-bf75-e25abc1da369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:55.474619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb013b69-d1f0-45e2-bf75-e25abc1da369 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:55.478934 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff58fb-0525-4b63-9b8c-f2775c7085a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:55.479597 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff58fb-0525-4b63-9b8c-f2775c7085a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:55.480350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff58fb-0525-4b63-9b8c-f2775c7085a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:55.480350 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff58fb-0525-4b63-9b8c-f2775c7085a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:55.491114 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff58fb-0525-4b63-9b8c-f2775c7085a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:55.492561 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff58fb-0525-4b63-9b8c-f2775c7085a1 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:55.503863 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1315/2667] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:36:55.659150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cfc82-a05d-4da8-aae7-a7338c27a2ad None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:55.695438 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:55.730891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cfc82-a05d-4da8-aae7-a7338c27a2ad None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:55.735621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdd7a3-3d7c-4f83-b52c-251493aa9be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:55.736511 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdd7a3-3d7c-4f83-b52c-251493aa9be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:55.736792 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdd7a3-3d7c-4f83-b52c-251493aa9be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:55.737071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdd7a3-3d7c-4f83-b52c-251493aa9be9 admin admin] PATH_INFO: `/v3/users/12d5d83775f04bae827c49c8f4018eed` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:55.738472 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdd7a3-3d7c-4f83-b52c-251493aa9be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d5d83775f04bae827c49c8f4018eed)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:55.740600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdd7a3-3d7c-4f83-b52c-251493aa9be9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:55.810337 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5ebdd7a3-3d7c-4f83-b52c-251493aa9be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d5d83775f04bae827c49c8f4018eed'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:55.812350 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5ebdd7a3-3d7c-4f83-b52c-251493aa9be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d5d83775f04bae827c49c8f4018eed'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:55.820055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5ebdd7a3-3d7c-4f83-b52c-251493aa9be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d5d83775f04bae827c49c8f4018eed'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:55.829711 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5ebdd7a3-3d7c-4f83-b52c-251493aa9be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d5d83775f04bae827c49c8f4018eed'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:55.830418 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5ebdd7a3-3d7c-4f83-b52c-251493aa9be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d5d83775f04bae827c49c8f4018eed'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:55.854522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1353/2668] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:36:55 2022] DELETE /identity/v3/users/12d5d83775f04bae827c49c8f4018eed => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:55.861842 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0b564-48d9-496c-82a8-14832a51e366 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:55.862524 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0b564-48d9-496c-82a8-14832a51e366 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:55.862976 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0b564-48d9-496c-82a8-14832a51e366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:55.882343 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-6fa0b564-48d9-496c-82a8-14832a51e366 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:55.884572 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6fa0b564-48d9-496c-82a8-14832a51e366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:55.960218 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1316/2669] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:55.970509 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdd7a3-3d7c-4f83-b52c-251493aa9be9 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:55.972016 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5ebdd7a3-3d7c-4f83-b52c-251493aa9be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:56.052071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdd7a3-3d7c-4f83-b52c-251493aa9be9 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:56.055802 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf35e6f-a2db-4b96-bcdb-3c80bd7f888a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:56.056474 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf35e6f-a2db-4b96-bcdb-3c80bd7f888a service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:56.056749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf35e6f-a2db-4b96-bcdb-3c80bd7f888a service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:56.057022 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf35e6f-a2db-4b96-bcdb-3c80bd7f888a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:56.066700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf35e6f-a2db-4b96-bcdb-3c80bd7f888a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:56.068136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf35e6f-a2db-4b96-bcdb-3c80bd7f888a service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:56.077945 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1354/2670] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:36:56.368347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0b564-48d9-496c-82a8-14832a51e366 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:56.369867 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6fa0b564-48d9-496c-82a8-14832a51e366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:56.382550 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0b564-48d9-496c-82a8-14832a51e366 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:56.388588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee97b0-b15f-4aa6-b897-2835d45831d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:56.389901 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee97b0-b15f-4aa6-b897-2835d45831d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:56.390171 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee97b0-b15f-4aa6-b897-2835d45831d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:56.390960 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee97b0-b15f-4aa6-b897-2835d45831d4 admin admin] PATH_INFO: `/v3/projects/8d3ffa1079af40ca876cd1c75cdc696a` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:56.391758 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee97b0-b15f-4aa6-b897-2835d45831d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d3ffa1079af40ca876cd1c75cdc696a)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:56.395383 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee97b0-b15f-4aa6-b897-2835d45831d4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:56.459502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d7ee97b0-b15f-4aa6-b897-2835d45831d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d3ffa1079af40ca876cd1c75cdc696a', 'request_id': 'req-d7ee97b0-b15f-4aa6-b897-2835d45831d4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:56.467454 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d7ee97b0-b15f-4aa6-b897-2835d45831d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d3ffa1079af40ca876cd1c75cdc696a', 'request_id': 'req-d7ee97b0-b15f-4aa6-b897-2835d45831d4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:56.477170 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d7ee97b0-b15f-4aa6-b897-2835d45831d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d3ffa1079af40ca876cd1c75cdc696a', 'request_id': 'req-d7ee97b0-b15f-4aa6-b897-2835d45831d4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:56.490795 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d7ee97b0-b15f-4aa6-b897-2835d45831d4 admin admin] The token cache is being invalidate because project 8d3ffa1079af40ca876cd1c75cdc696a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:36:56.491039 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d7ee97b0-b15f-4aa6-b897-2835d45831d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:56.491955 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d7ee97b0-b15f-4aa6-b897-2835d45831d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:56.494396 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1317/2671] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:36:56 2022] DELETE /identity/v3/projects/8d3ffa1079af40ca876cd1c75cdc696a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:56.498471 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf35e6f-a2db-4b96-bcdb-3c80bd7f888a service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:56.508285 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf35e6f-a2db-4b96-bcdb-3c80bd7f888a service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:56.555390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:56.570395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a61a4b-8f41-486b-b74b-e23ea4ac81d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:56.571328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a61a4b-8f41-486b-b74b-e23ea4ac81d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:56.571602 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a61a4b-8f41-486b-b74b-e23ea4ac81d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:56.571898 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a61a4b-8f41-486b-b74b-e23ea4ac81d8 admin admin] PATH_INFO: `/v3/users/a2fc2ad4b24246ed8d00c6d6070f241e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:56.573121 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a61a4b-8f41-486b-b74b-e23ea4ac81d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2fc2ad4b24246ed8d00c6d6070f241e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:56.575405 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a61a4b-8f41-486b-b74b-e23ea4ac81d8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:56.624759 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-42a61a4b-8f41-486b-b74b-e23ea4ac81d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2fc2ad4b24246ed8d00c6d6070f241e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:56.625427 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-42a61a4b-8f41-486b-b74b-e23ea4ac81d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2fc2ad4b24246ed8d00c6d6070f241e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:56.632371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-42a61a4b-8f41-486b-b74b-e23ea4ac81d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2fc2ad4b24246ed8d00c6d6070f241e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:56.641481 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-42a61a4b-8f41-486b-b74b-e23ea4ac81d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2fc2ad4b24246ed8d00c6d6070f241e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:56.642223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-42a61a4b-8f41-486b-b74b-e23ea4ac81d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2fc2ad4b24246ed8d00c6d6070f241e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:56.660131 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1355/2672] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:36:56 2022] DELETE /identity/v3/users/a2fc2ad4b24246ed8d00c6d6070f241e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:56.936019 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee97b0-b15f-4aa6-b897-2835d45831d4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:56.937734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d7ee97b0-b15f-4aa6-b897-2835d45831d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:56.947746 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:56.955196 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee97b0-b15f-4aa6-b897-2835d45831d4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:57.019801 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a00ed3-fd22-489c-9e12-f7919a46c56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:57.020680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a00ed3-fd22-489c-9e12-f7919a46c56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:57.020957 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a00ed3-fd22-489c-9e12-f7919a46c56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:57.021228 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a00ed3-fd22-489c-9e12-f7919a46c56f admin admin] PATH_INFO: `/v3/projects/53b22f985bab4d6aaa2d87aa7b43fda4` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:57.022518 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a00ed3-fd22-489c-9e12-f7919a46c56f admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b22f985bab4d6aaa2d87aa7b43fda4)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:57.024353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a00ed3-fd22-489c-9e12-f7919a46c56f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:57.077690 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d5a00ed3-fd22-489c-9e12-f7919a46c56f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b22f985bab4d6aaa2d87aa7b43fda4', 'request_id': 'req-d5a00ed3-fd22-489c-9e12-f7919a46c56f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:57.083869 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d5a00ed3-fd22-489c-9e12-f7919a46c56f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b22f985bab4d6aaa2d87aa7b43fda4', 'request_id': 'req-d5a00ed3-fd22-489c-9e12-f7919a46c56f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:57.094261 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d5a00ed3-fd22-489c-9e12-f7919a46c56f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b22f985bab4d6aaa2d87aa7b43fda4', 'request_id': 'req-d5a00ed3-fd22-489c-9e12-f7919a46c56f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:57.105947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d5a00ed3-fd22-489c-9e12-f7919a46c56f admin admin] The token cache is being invalidate because project 53b22f985bab4d6aaa2d87aa7b43fda4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:36:57.106078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d5a00ed3-fd22-489c-9e12-f7919a46c56f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:57.106711 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d5a00ed3-fd22-489c-9e12-f7919a46c56f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:57.111525 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1318/2673] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:36:56 2022] DELETE /identity/v3/projects/53b22f985bab4d6aaa2d87aa7b43fda4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:57.113397 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a4307-3eb0-4272-b018-8501b8a4a943 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:57.113864 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a4307-3eb0-4272-b018-8501b8a4a943 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:57.114206 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a4307-3eb0-4272-b018-8501b8a4a943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:57.132808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5c4a4307-3eb0-4272-b018-8501b8a4a943 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:57.134111 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5c4a4307-3eb0-4272-b018-8501b8a4a943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:57.215859 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1356/2674] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:57.224220 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f938b41-605b-40a9-891c-b350cb1b4204 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:57.224511 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f938b41-605b-40a9-891c-b350cb1b4204 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:57.225259 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f938b41-605b-40a9-891c-b350cb1b4204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:57.246579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4f938b41-605b-40a9-891c-b350cb1b4204 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:57.247870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4f938b41-605b-40a9-891c-b350cb1b4204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:57.256307 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1319/2675] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:57.261730 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a4307-3eb0-4272-b018-8501b8a4a943 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:57.271948 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a4307-3eb0-4272-b018-8501b8a4a943 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:57.276588 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6190d-769b-451f-a2b9-78e044ea56ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:57.277254 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6190d-769b-451f-a2b9-78e044ea56ce admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:57.277527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6190d-769b-451f-a2b9-78e044ea56ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:57.277810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6190d-769b-451f-a2b9-78e044ea56ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:57.278546 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6190d-769b-451f-a2b9-78e044ea56ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:36:57.278965 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6190d-769b-451f-a2b9-78e044ea56ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:57.280755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6190d-769b-451f-a2b9-78e044ea56ce admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:57.294676 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1357/2676] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:36:57.299192 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f938b41-605b-40a9-891c-b350cb1b4204 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:57.310568 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f938b41-605b-40a9-891c-b350cb1b4204 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:57.315948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4960a-6692-4eaa-9af8-277ca6c103bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:57.316921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4960a-6692-4eaa-9af8-277ca6c103bf admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:57.317208 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4960a-6692-4eaa-9af8-277ca6c103bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:57.317486 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4960a-6692-4eaa-9af8-277ca6c103bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:57.318245 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4960a-6692-4eaa-9af8-277ca6c103bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:57.320215 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4960a-6692-4eaa-9af8-277ca6c103bf admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:57.353882 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1320/2677] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:36:57 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:36:57.357756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6190d-769b-451f-a2b9-78e044ea56ce admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:57.368861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6190d-769b-451f-a2b9-78e044ea56ce admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:57.426895 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:57.435155 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5055af-c0d8-4b84-966f-79666fe4116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:57.435862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5055af-c0d8-4b84-966f-79666fe4116f admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:57.436532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5055af-c0d8-4b84-966f-79666fe4116f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:57.437145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5055af-c0d8-4b84-966f-79666fe4116f admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:57.438632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5055af-c0d8-4b84-966f-79666fe4116f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:57.440777 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5055af-c0d8-4b84-966f-79666fe4116f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:57.462165 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1358/2678] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:36:57 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:36:57.466894 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4960a-6692-4eaa-9af8-277ca6c103bf admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:57.478050 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4960a-6692-4eaa-9af8-277ca6c103bf admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:57.483832 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8885772-db3a-41f5-a386-f7f0b9d60b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:57.484585 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8885772-db3a-41f5-a386-f7f0b9d60b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:57.484974 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8885772-db3a-41f5-a386-f7f0b9d60b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:57.485288 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8885772-db3a-41f5-a386-f7f0b9d60b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:57.486171 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8885772-db3a-41f5-a386-f7f0b9d60b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:57.487885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8885772-db3a-41f5-a386-f7f0b9d60b3b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:57.499768 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1321/2679] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:36:57.504166 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5055af-c0d8-4b84-966f-79666fe4116f admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:57.514692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5055af-c0d8-4b84-966f-79666fe4116f admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:57.520188 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5604fb4-8138-44ef-9eab-66cb9c59356a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:57.520822 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5604fb4-8138-44ef-9eab-66cb9c59356a admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:57.521104 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5604fb4-8138-44ef-9eab-66cb9c59356a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:57.521378 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5604fb4-8138-44ef-9eab-66cb9c59356a admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:57.522148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5604fb4-8138-44ef-9eab-66cb9c59356a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:57.523808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5604fb4-8138-44ef-9eab-66cb9c59356a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:57.535592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1359/2680] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:36:57.539878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8885772-db3a-41f5-a386-f7f0b9d60b3b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:57.551388 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8885772-db3a-41f5-a386-f7f0b9d60b3b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:57.556841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a17784-37d6-4269-8bf3-3743082f5c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:57.557736 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a17784-37d6-4269-8bf3-3743082f5c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:57.558171 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a17784-37d6-4269-8bf3-3743082f5c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:57.558784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a17784-37d6-4269-8bf3-3743082f5c61 admin admin] PATH_INFO: `/v3/projects/f06f44bf8d8d4aefbe5b9bfa311068e3/users/cc2eabc1dadb481d80c24db2a36e4b8f/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:57.574534 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a17784-37d6-4269-8bf3-3743082f5c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06f44bf8d8d4aefbe5b9bfa311068e3, user_id=cc2eabc1dadb481d80c24db2a36e4b8f, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:57.577227 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a17784-37d6-4269-8bf3-3743082f5c61 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:57.592306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1322/2681] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:36:57 2022] PUT /identity/v3/projects/f06f44bf8d8d4aefbe5b9bfa311068e3/users/cc2eabc1dadb481d80c24db2a36e4b8f/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:57.603842 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58c2cb-cdb8-408e-b749-40a6b64756cd None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:57.604129 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58c2cb-cdb8-408e-b749-40a6b64756cd None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:57.604429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58c2cb-cdb8-408e-b749-40a6b64756cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:57.638642 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-fa58c2cb-cdb8-408e-b749-40a6b64756cd None None] MFA Rules not processed for user `cc2eabc1dadb481d80c24db2a36e4b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:57.639859 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fa58c2cb-cdb8-408e-b749-40a6b64756cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:57.711668 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1360/2682] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:57.716666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a17784-37d6-4269-8bf3-3743082f5c61 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:57.748600 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:57.782005 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a17784-37d6-4269-8bf3-3743082f5c61 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:57.787926 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f35129-f66e-42f9-ac78-0477dc528d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:57.788618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f35129-f66e-42f9-ac78-0477dc528d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:57.788882 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f35129-f66e-42f9-ac78-0477dc528d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:57.789146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f35129-f66e-42f9-ac78-0477dc528d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:57.789833 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f35129-f66e-42f9-ac78-0477dc528d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:57.791770 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f35129-f66e-42f9-ac78-0477dc528d38 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:57.822318 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1323/2683] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:36:57 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:36:57.826838 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58c2cb-cdb8-408e-b749-40a6b64756cd None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:57.837943 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58c2cb-cdb8-408e-b749-40a6b64756cd None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:57.896189 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4e60a-64d4-4c1e-a570-08617d77787e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:57.896848 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4e60a-64d4-4c1e-a570-08617d77787e admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:57.897136 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4e60a-64d4-4c1e-a570-08617d77787e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:57.897411 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4e60a-64d4-4c1e-a570-08617d77787e admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:57.898128 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4e60a-64d4-4c1e-a570-08617d77787e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:57.900049 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4e60a-64d4-4c1e-a570-08617d77787e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:57.922153 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1361/2684] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:36:57 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:36:57.926750 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f35129-f66e-42f9-ac78-0477dc528d38 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:57.937603 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f35129-f66e-42f9-ac78-0477dc528d38 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:57.942339 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b7efc-789a-4a0b-b358-87ca32a02219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:57.942997 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b7efc-789a-4a0b-b358-87ca32a02219 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:57.943279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b7efc-789a-4a0b-b358-87ca32a02219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:57.943553 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b7efc-789a-4a0b-b358-87ca32a02219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:57.944302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b7efc-789a-4a0b-b358-87ca32a02219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:57.945921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b7efc-789a-4a0b-b358-87ca32a02219 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:57.956832 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1324/2685] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:36:57.961139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4e60a-64d4-4c1e-a570-08617d77787e admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:57.971533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4e60a-64d4-4c1e-a570-08617d77787e admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:57.976345 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e58b0-1d3b-41b4-8939-2c4fdccceb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:57.977258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e58b0-1d3b-41b4-8939-2c4fdccceb8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:57.977539 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e58b0-1d3b-41b4-8939-2c4fdccceb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:57.977837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e58b0-1d3b-41b4-8939-2c4fdccceb8a admin admin] PATH_INFO: `/v3/projects/1b9d0db7685748f0ac17add221671c46/users/3fd363b5448c4b39baaff6d3dd99b14d/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:57.992748 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e58b0-1d3b-41b4-8939-2c4fdccceb8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9d0db7685748f0ac17add221671c46, user_id=3fd363b5448c4b39baaff6d3dd99b14d, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:57.995568 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e58b0-1d3b-41b4-8939-2c4fdccceb8a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:58.018915 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1362/2686] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:36:57 2022] PUT /identity/v3/projects/1b9d0db7685748f0ac17add221671c46/users/3fd363b5448c4b39baaff6d3dd99b14d/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:36:58.023158 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b7efc-789a-4a0b-b358-87ca32a02219 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:58.033403 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b7efc-789a-4a0b-b358-87ca32a02219 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:58.091512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18aba0f-1ccb-48df-a775-021cea5212fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:58.092179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aba0f-1ccb-48df-a775-021cea5212fc admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:58.092459 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aba0f-1ccb-48df-a775-021cea5212fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:58.092731 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aba0f-1ccb-48df-a775-021cea5212fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:58.093456 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18aba0f-1ccb-48df-a775-021cea5212fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:58.095094 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18aba0f-1ccb-48df-a775-021cea5212fc admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:58.105649 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1325/2687] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:36:58.110178 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e58b0-1d3b-41b4-8939-2c4fdccceb8a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:58.120963 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e58b0-1d3b-41b4-8939-2c4fdccceb8a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:58.126291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd85dd3-227c-43fa-acb6-b67392decc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:58.127177 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd85dd3-227c-43fa-acb6-b67392decc53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:58.127457 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd85dd3-227c-43fa-acb6-b67392decc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:58.127761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd85dd3-227c-43fa-acb6-b67392decc53 admin admin] PATH_INFO: `/v3/projects/1b9d0db7685748f0ac17add221671c46/users/3fd363b5448c4b39baaff6d3dd99b14d/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:58.129756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd85dd3-227c-43fa-acb6-b67392decc53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9d0db7685748f0ac17add221671c46, user_id=3fd363b5448c4b39baaff6d3dd99b14d, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:58.132449 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd85dd3-227c-43fa-acb6-b67392decc53 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:58.143285 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1363/2688] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:36:58 2022] PUT /identity/v3/projects/1b9d0db7685748f0ac17add221671c46/users/3fd363b5448c4b39baaff6d3dd99b14d/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:58.153262 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d83597-6017-4e4d-9805-e7f249014be2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:58.153553 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d83597-6017-4e4d-9805-e7f249014be2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:58.153829 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d83597-6017-4e4d-9805-e7f249014be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:58.188346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-73d83597-6017-4e4d-9805-e7f249014be2 None None] MFA Rules not processed for user `3fd363b5448c4b39baaff6d3dd99b14d`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:58.190239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-73d83597-6017-4e4d-9805-e7f249014be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:58.268858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1326/2689] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:58.280645 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd85dd3-227c-43fa-acb6-b67392decc53 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:58.282611 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-0dd85dd3-227c-43fa-acb6-b67392decc53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:58.304252 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:58.347831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd85dd3-227c-43fa-acb6-b67392decc53 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:58.352522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc8779-5ba5-4df3-9909-9042cd594487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:58.353177 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc8779-5ba5-4df3-9909-9042cd594487 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:58.353459 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc8779-5ba5-4df3-9909-9042cd594487 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:58.353732 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc8779-5ba5-4df3-9909-9042cd594487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:58.364802 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc8779-5ba5-4df3-9909-9042cd594487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:58.366225 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc8779-5ba5-4df3-9909-9042cd594487 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:58.375988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1364/2690] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:36:58.448744 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d83597-6017-4e4d-9805-e7f249014be2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:58.450329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-73d83597-6017-4e4d-9805-e7f249014be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:58.462622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d83597-6017-4e4d-9805-e7f249014be2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:58.467258 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1287e0-0011-4226-a25e-e332382c4d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:58.467941 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1287e0-0011-4226-a25e-e332382c4d1e service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:58.468181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1287e0-0011-4226-a25e-e332382c4d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:58.468453 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1287e0-0011-4226-a25e-e332382c4d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:58.491120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:58.546437 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1287e0-0011-4226-a25e-e332382c4d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:58.547880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1287e0-0011-4226-a25e-e332382c4d1e service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:58.557369 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1327/2691] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:36:58.832009 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc8779-5ba5-4df3-9909-9042cd594487 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:58.907507 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc8779-5ba5-4df3-9909-9042cd594487 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:58.912345 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e12fbf-b820-4206-94d6-6cec2b3ed900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:58.913231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e12fbf-b820-4206-94d6-6cec2b3ed900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:58.913513 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e12fbf-b820-4206-94d6-6cec2b3ed900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:58.913788 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e12fbf-b820-4206-94d6-6cec2b3ed900 admin admin] PATH_INFO: `/v3/users/cc2eabc1dadb481d80c24db2a36e4b8f` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:58.915054 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e12fbf-b820-4206-94d6-6cec2b3ed900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2eabc1dadb481d80c24db2a36e4b8f)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:58.917163 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e12fbf-b820-4206-94d6-6cec2b3ed900 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:58.971406 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a9e12fbf-b820-4206-94d6-6cec2b3ed900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2eabc1dadb481d80c24db2a36e4b8f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:58.972147 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a9e12fbf-b820-4206-94d6-6cec2b3ed900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2eabc1dadb481d80c24db2a36e4b8f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:58.979108 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a9e12fbf-b820-4206-94d6-6cec2b3ed900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2eabc1dadb481d80c24db2a36e4b8f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:58.988293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a9e12fbf-b820-4206-94d6-6cec2b3ed900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2eabc1dadb481d80c24db2a36e4b8f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:58.988917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a9e12fbf-b820-4206-94d6-6cec2b3ed900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2eabc1dadb481d80c24db2a36e4b8f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:59.006529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1365/2692] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:36:58 2022] DELETE /identity/v3/users/cc2eabc1dadb481d80c24db2a36e4b8f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:59.011327 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3da13-1558-4faf-b8ca-26b77d2ff621 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:59.011670 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3da13-1558-4faf-b8ca-26b77d2ff621 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:59.011946 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3da13-1558-4faf-b8ca-26b77d2ff621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:59.030016 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8ef3da13-1558-4faf-b8ca-26b77d2ff621 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:36:59.031214 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8ef3da13-1558-4faf-b8ca-26b77d2ff621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:59.092503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1328/2693] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:36:59.105534 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e12fbf-b820-4206-94d6-6cec2b3ed900 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:59.107109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a9e12fbf-b820-4206-94d6-6cec2b3ed900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:59.153002 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:36:59.171243 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e12fbf-b820-4206-94d6-6cec2b3ed900 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:59.175326 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d9f7f-f434-460f-847f-de8ad24b2a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:59.176318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d9f7f-f434-460f-847f-de8ad24b2a86 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:59.176604 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d9f7f-f434-460f-847f-de8ad24b2a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:59.176876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d9f7f-f434-460f-847f-de8ad24b2a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:59.186346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d9f7f-f434-460f-847f-de8ad24b2a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:59.187774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d9f7f-f434-460f-847f-de8ad24b2a86 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:59.197309 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1366/2694] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:36:59.479480 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3da13-1558-4faf-b8ca-26b77d2ff621 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:59.481816 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8ef3da13-1558-4faf-b8ca-26b77d2ff621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:36:59.503293 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3da13-1558-4faf-b8ca-26b77d2ff621 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:59.508592 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365eeb56-556d-4881-8dd7-1f7e5e78bdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:59.509387 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eeb56-556d-4881-8dd7-1f7e5e78bdf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:59.509687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eeb56-556d-4881-8dd7-1f7e5e78bdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:59.509992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eeb56-556d-4881-8dd7-1f7e5e78bdf2 admin admin] PATH_INFO: `/v3/projects/f06f44bf8d8d4aefbe5b9bfa311068e3` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:59.511471 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365eeb56-556d-4881-8dd7-1f7e5e78bdf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f06f44bf8d8d4aefbe5b9bfa311068e3)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:59.513461 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365eeb56-556d-4881-8dd7-1f7e5e78bdf2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:59.567903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-365eeb56-556d-4881-8dd7-1f7e5e78bdf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06f44bf8d8d4aefbe5b9bfa311068e3', 'request_id': 'req-365eeb56-556d-4881-8dd7-1f7e5e78bdf2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:59.573688 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-365eeb56-556d-4881-8dd7-1f7e5e78bdf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06f44bf8d8d4aefbe5b9bfa311068e3', 'request_id': 'req-365eeb56-556d-4881-8dd7-1f7e5e78bdf2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:59.582730 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-365eeb56-556d-4881-8dd7-1f7e5e78bdf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06f44bf8d8d4aefbe5b9bfa311068e3', 'request_id': 'req-365eeb56-556d-4881-8dd7-1f7e5e78bdf2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:59.594896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-365eeb56-556d-4881-8dd7-1f7e5e78bdf2 admin admin] The token cache is being invalidate because project f06f44bf8d8d4aefbe5b9bfa311068e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:36:59.595181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-365eeb56-556d-4881-8dd7-1f7e5e78bdf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:59.595928 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-365eeb56-556d-4881-8dd7-1f7e5e78bdf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:59.597762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1329/2695] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:36:59 2022] DELETE /identity/v3/projects/f06f44bf8d8d4aefbe5b9bfa311068e3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:36:59.602682 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d9f7f-f434-460f-847f-de8ad24b2a86 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:36:59.615485 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d9f7f-f434-460f-847f-de8ad24b2a86 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:36:59.682912 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1698f71-feab-4698-b419-aa32e52944ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:36:59.684357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1698f71-feab-4698-b419-aa32e52944ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:36:59.684645 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1698f71-feab-4698-b419-aa32e52944ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:36:59.685000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1698f71-feab-4698-b419-aa32e52944ab admin admin] PATH_INFO: `/v3/users/3fd363b5448c4b39baaff6d3dd99b14d` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:36:59.686361 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1698f71-feab-4698-b419-aa32e52944ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd363b5448c4b39baaff6d3dd99b14d)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:36:59.688327 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1698f71-feab-4698-b419-aa32e52944ab admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:36:59.743064 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b1698f71-feab-4698-b419-aa32e52944ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd363b5448c4b39baaff6d3dd99b14d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:59.743814 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b1698f71-feab-4698-b419-aa32e52944ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd363b5448c4b39baaff6d3dd99b14d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:59.754726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b1698f71-feab-4698-b419-aa32e52944ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd363b5448c4b39baaff6d3dd99b14d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:59.764243 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b1698f71-feab-4698-b419-aa32e52944ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd363b5448c4b39baaff6d3dd99b14d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:59.764983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b1698f71-feab-4698-b419-aa32e52944ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd363b5448c4b39baaff6d3dd99b14d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:36:59.784097 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1367/2696] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:36:59 2022] DELETE /identity/v3/users/3fd363b5448c4b39baaff6d3dd99b14d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:00.100124 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365eeb56-556d-4881-8dd7-1f7e5e78bdf2 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:00.101609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-365eeb56-556d-4881-8dd7-1f7e5e78bdf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:00.116359 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365eeb56-556d-4881-8dd7-1f7e5e78bdf2 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:00.163887 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:00.181555 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178ef97-a4c5-456e-8856-158ade98b3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:00.182485 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178ef97-a4c5-456e-8856-158ade98b3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:00.182910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178ef97-a4c5-456e-8856-158ade98b3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:00.183458 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178ef97-a4c5-456e-8856-158ade98b3af admin admin] PATH_INFO: `/v3/projects/1b9d0db7685748f0ac17add221671c46` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:00.184611 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178ef97-a4c5-456e-8856-158ade98b3af admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b9d0db7685748f0ac17add221671c46)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:00.186628 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178ef97-a4c5-456e-8856-158ade98b3af admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:00.238396 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b178ef97-a4c5-456e-8856-158ade98b3af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b9d0db7685748f0ac17add221671c46', 'request_id': 'req-b178ef97-a4c5-456e-8856-158ade98b3af'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:00.244999 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b178ef97-a4c5-456e-8856-158ade98b3af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b9d0db7685748f0ac17add221671c46', 'request_id': 'req-b178ef97-a4c5-456e-8856-158ade98b3af'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:00.252906 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b178ef97-a4c5-456e-8856-158ade98b3af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b9d0db7685748f0ac17add221671c46', 'request_id': 'req-b178ef97-a4c5-456e-8856-158ade98b3af'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:00.264064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b178ef97-a4c5-456e-8856-158ade98b3af admin admin] The token cache is being invalidate because project 1b9d0db7685748f0ac17add221671c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:37:00.264301 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b178ef97-a4c5-456e-8856-158ade98b3af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:00.264966 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b178ef97-a4c5-456e-8856-158ade98b3af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:00.266621 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1330/2697] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:37:00 2022] DELETE /identity/v3/projects/1b9d0db7685748f0ac17add221671c46 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:00.271583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad6dbc-4577-4a1c-879c-79e2e2cb6ca1 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:00.272109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad6dbc-4577-4a1c-879c-79e2e2cb6ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:00.272109 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad6dbc-4577-4a1c-879c-79e2e2cb6ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:00.289689 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-57ad6dbc-4577-4a1c-879c-79e2e2cb6ca1 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:00.290958 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-57ad6dbc-4577-4a1c-879c-79e2e2cb6ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:00.348996 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:00.359926 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1368/2698] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:00.373507 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60197688-f4ce-470b-814c-2db80aba23fb None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:00.373839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60197688-f4ce-470b-814c-2db80aba23fb None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:00.374132 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60197688-f4ce-470b-814c-2db80aba23fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:00.398679 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-60197688-f4ce-470b-814c-2db80aba23fb None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:00.399899 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-60197688-f4ce-470b-814c-2db80aba23fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:00.410214 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1331/2699] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:00.415317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad6dbc-4577-4a1c-879c-79e2e2cb6ca1 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:00.429124 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad6dbc-4577-4a1c-879c-79e2e2cb6ca1 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:00.438267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f4b0e-d1cb-4f93-88b7-50b5918536fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:00.439223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f4b0e-d1cb-4f93-88b7-50b5918536fa admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:00.439595 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f4b0e-d1cb-4f93-88b7-50b5918536fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:00.439851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f4b0e-d1cb-4f93-88b7-50b5918536fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:00.440993 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f4b0e-d1cb-4f93-88b7-50b5918536fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:37:00.441392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f4b0e-d1cb-4f93-88b7-50b5918536fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:00.444134 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f4b0e-d1cb-4f93-88b7-50b5918536fa admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:00.458773 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1369/2700] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:37:00.463747 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60197688-f4ce-470b-814c-2db80aba23fb None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:00.485502 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60197688-f4ce-470b-814c-2db80aba23fb None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:00.491655 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b809c-ecfa-466f-bd3a-76050c803cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:00.492321 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b809c-ecfa-466f-bd3a-76050c803cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:00.492594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b809c-ecfa-466f-bd3a-76050c803cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:00.492863 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b809c-ecfa-466f-bd3a-76050c803cb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:00.493716 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b809c-ecfa-466f-bd3a-76050c803cb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:00.502497 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b809c-ecfa-466f-bd3a-76050c803cb3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:00.536702 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1332/2701] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:37:00 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:37:00.541038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f4b0e-d1cb-4f93-88b7-50b5918536fa admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:00.552289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f4b0e-d1cb-4f93-88b7-50b5918536fa admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:00.618246 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b45b24-fb65-45e7-a9dd-ec2212ee6463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:00.618939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b45b24-fb65-45e7-a9dd-ec2212ee6463 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:00.619223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b45b24-fb65-45e7-a9dd-ec2212ee6463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:00.619472 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b45b24-fb65-45e7-a9dd-ec2212ee6463 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:00.620262 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b45b24-fb65-45e7-a9dd-ec2212ee6463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:00.622431 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b45b24-fb65-45e7-a9dd-ec2212ee6463 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:00.646328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1370/2702] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:37:00 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:37:00.650633 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b809c-ecfa-466f-bd3a-76050c803cb3 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:00.661448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b809c-ecfa-466f-bd3a-76050c803cb3 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:00.666137 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecaa807-8519-49e6-95b4-eb170ba247d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:00.666799 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecaa807-8519-49e6-95b4-eb170ba247d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:00.667200 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecaa807-8519-49e6-95b4-eb170ba247d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:00.667523 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecaa807-8519-49e6-95b4-eb170ba247d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:00.668245 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecaa807-8519-49e6-95b4-eb170ba247d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:00.669877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecaa807-8519-49e6-95b4-eb170ba247d5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:00.680694 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1333/2703] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:37:00.685051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b45b24-fb65-45e7-a9dd-ec2212ee6463 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:00.695779 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b45b24-fb65-45e7-a9dd-ec2212ee6463 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:00.701878 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fbf52-41c1-4a35-8278-c048f5254441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:00.702544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fbf52-41c1-4a35-8278-c048f5254441 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:00.702831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fbf52-41c1-4a35-8278-c048f5254441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:00.703105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fbf52-41c1-4a35-8278-c048f5254441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:00.704310 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fbf52-41c1-4a35-8278-c048f5254441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:00.706171 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fbf52-41c1-4a35-8278-c048f5254441 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:00.719993 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1371/2704] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:37:00.724897 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecaa807-8519-49e6-95b4-eb170ba247d5 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:00.735726 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecaa807-8519-49e6-95b4-eb170ba247d5 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:00.740674 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2628de-8cba-45a0-9e87-71049668e1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:00.741567 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2628de-8cba-45a0-9e87-71049668e1e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:00.742011 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2628de-8cba-45a0-9e87-71049668e1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:00.742356 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2628de-8cba-45a0-9e87-71049668e1e7 admin admin] PATH_INFO: `/v3/projects/53f87681cc01466eb743e970d6fa2d64/users/1fbf04823e6e49ada94c12cf5336a3ac/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:00.759003 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2628de-8cba-45a0-9e87-71049668e1e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f87681cc01466eb743e970d6fa2d64, user_id=1fbf04823e6e49ada94c12cf5336a3ac, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:00.762284 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2628de-8cba-45a0-9e87-71049668e1e7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:00.778229 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1334/2705] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:37:00 2022] PUT /identity/v3/projects/53f87681cc01466eb743e970d6fa2d64/users/1fbf04823e6e49ada94c12cf5336a3ac/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:00.790007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2e001-5458-4931-8a91-24d714c60f6f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:00.790295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2e001-5458-4931-8a91-24d714c60f6f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:00.790567 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2e001-5458-4931-8a91-24d714c60f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:00.819081 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-32f2e001-5458-4931-8a91-24d714c60f6f None None] MFA Rules not processed for user `1fbf04823e6e49ada94c12cf5336a3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:00.820287 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-32f2e001-5458-4931-8a91-24d714c60f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:00.904280 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1372/2706] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:00.909198 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2628de-8cba-45a0-9e87-71049668e1e7 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:00.972265 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2628de-8cba-45a0-9e87-71049668e1e7 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:00.977672 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff213ec-7298-4a6d-9f0d-c0d57f89f2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:00.978362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff213ec-7298-4a6d-9f0d-c0d57f89f2ce admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:00.978640 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff213ec-7298-4a6d-9f0d-c0d57f89f2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:00.978910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff213ec-7298-4a6d-9f0d-c0d57f89f2ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:00.980313 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff213ec-7298-4a6d-9f0d-c0d57f89f2ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:00.982328 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff213ec-7298-4a6d-9f0d-c0d57f89f2ce admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:01.003891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:01.018096 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1335/2707] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:37:00 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:37:01.018582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2e001-5458-4931-8a91-24d714c60f6f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:01.030483 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2e001-5458-4931-8a91-24d714c60f6f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:01.094605 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:01.102552 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addda3bd-1dae-457e-9501-4fe9cad03b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:01.103245 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addda3bd-1dae-457e-9501-4fe9cad03b47 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:01.103805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addda3bd-1dae-457e-9501-4fe9cad03b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:01.104213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addda3bd-1dae-457e-9501-4fe9cad03b47 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:01.105090 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addda3bd-1dae-457e-9501-4fe9cad03b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:01.107084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addda3bd-1dae-457e-9501-4fe9cad03b47 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:01.128235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1373/2708] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:37:01 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:37:01.132388 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff213ec-7298-4a6d-9f0d-c0d57f89f2ce admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:01.143273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff213ec-7298-4a6d-9f0d-c0d57f89f2ce admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:01.147999 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdc033-3d94-4c8a-865f-a649ddc31ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:01.148648 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdc033-3d94-4c8a-865f-a649ddc31ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:01.148925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdc033-3d94-4c8a-865f-a649ddc31ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:01.149195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdc033-3d94-4c8a-865f-a649ddc31ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:01.149960 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdc033-3d94-4c8a-865f-a649ddc31ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:01.151567 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdc033-3d94-4c8a-865f-a649ddc31ae2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:01.163499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1336/2709] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:37:01.168026 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addda3bd-1dae-457e-9501-4fe9cad03b47 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:01.179679 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addda3bd-1dae-457e-9501-4fe9cad03b47 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:01.185282 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb6674-6fe8-421f-aa75-471656fcddf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:01.186212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb6674-6fe8-421f-aa75-471656fcddf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:01.186509 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb6674-6fe8-421f-aa75-471656fcddf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:01.186778 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb6674-6fe8-421f-aa75-471656fcddf8 admin admin] PATH_INFO: `/v3/projects/df959cae5d8e4087bea66718b9cd9676/users/627ff3e80eb24901a30f90f004ecf588/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:01.203273 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb6674-6fe8-421f-aa75-471656fcddf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df959cae5d8e4087bea66718b9cd9676, user_id=627ff3e80eb24901a30f90f004ecf588, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:01.205966 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb6674-6fe8-421f-aa75-471656fcddf8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:01.220430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1374/2710] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:37:01 2022] PUT /identity/v3/projects/df959cae5d8e4087bea66718b9cd9676/users/627ff3e80eb24901a30f90f004ecf588/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:01.224713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdc033-3d94-4c8a-865f-a649ddc31ae2 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:01.236857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdc033-3d94-4c8a-865f-a649ddc31ae2 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:01.296512 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd967d89-ab31-49a1-bb7d-0b9e66c0dd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:01.297194 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd967d89-ab31-49a1-bb7d-0b9e66c0dd4d admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:01.297478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd967d89-ab31-49a1-bb7d-0b9e66c0dd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:01.297751 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd967d89-ab31-49a1-bb7d-0b9e66c0dd4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:01.298525 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd967d89-ab31-49a1-bb7d-0b9e66c0dd4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:01.300165 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd967d89-ab31-49a1-bb7d-0b9e66c0dd4d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:01.311925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1337/2711] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:37:01.316297 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb6674-6fe8-421f-aa75-471656fcddf8 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:01.327292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb6674-6fe8-421f-aa75-471656fcddf8 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:01.332063 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5595f9c-35d2-4331-b447-9de258668bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:01.332966 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5595f9c-35d2-4331-b447-9de258668bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:01.333247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5595f9c-35d2-4331-b447-9de258668bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:01.333532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5595f9c-35d2-4331-b447-9de258668bb3 admin admin] PATH_INFO: `/v3/projects/df959cae5d8e4087bea66718b9cd9676/users/627ff3e80eb24901a30f90f004ecf588/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:01.335580 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5595f9c-35d2-4331-b447-9de258668bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df959cae5d8e4087bea66718b9cd9676, user_id=627ff3e80eb24901a30f90f004ecf588, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:01.338388 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5595f9c-35d2-4331-b447-9de258668bb3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:01.350087 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1375/2712] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:37:01 2022] PUT /identity/v3/projects/df959cae5d8e4087bea66718b9cd9676/users/627ff3e80eb24901a30f90f004ecf588/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:01.361298 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22dbab-7e4b-4fbb-80a1-1c3000b07f43 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:01.361604 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22dbab-7e4b-4fbb-80a1-1c3000b07f43 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:01.361900 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22dbab-7e4b-4fbb-80a1-1c3000b07f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:01.390707 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-be22dbab-7e4b-4fbb-80a1-1c3000b07f43 None None] MFA Rules not processed for user `627ff3e80eb24901a30f90f004ecf588`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:01.391478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-be22dbab-7e4b-4fbb-80a1-1c3000b07f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:01.461842 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1338/2713] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:01.477858 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5595f9c-35d2-4331-b447-9de258668bb3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:01.480605 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d5595f9c-35d2-4331-b447-9de258668bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:01.547509 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5595f9c-35d2-4331-b447-9de258668bb3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:01.551683 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f78efb-f888-48f5-844f-9a9a4a644bc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:01.552335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f78efb-f888-48f5-844f-9a9a4a644bc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:01.552614 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f78efb-f888-48f5-844f-9a9a4a644bc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:01.552889 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f78efb-f888-48f5-844f-9a9a4a644bc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:01.614537 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f78efb-f888-48f5-844f-9a9a4a644bc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:01.617628 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f78efb-f888-48f5-844f-9a9a4a644bc8 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:01.630327 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1376/2714] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:37:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:37:03.235174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22dbab-7e4b-4fbb-80a1-1c3000b07f43 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:03.236741 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-be22dbab-7e4b-4fbb-80a1-1c3000b07f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:03.318266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22dbab-7e4b-4fbb-80a1-1c3000b07f43 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:03.323868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724c602-5a3e-49b0-a7db-993a56aa3ce8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:03.324523 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724c602-5a3e-49b0-a7db-993a56aa3ce8 service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:03.325133 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724c602-5a3e-49b0-a7db-993a56aa3ce8 service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:03.325530 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724c602-5a3e-49b0-a7db-993a56aa3ce8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:03.327473 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8724c602-5a3e-49b0-a7db-993a56aa3ce8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:03.343873 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724c602-5a3e-49b0-a7db-993a56aa3ce8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:03.345638 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724c602-5a3e-49b0-a7db-993a56aa3ce8 service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:03.351342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:03.361784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1339/2715] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:37:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:37:03.878299 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f78efb-f888-48f5-844f-9a9a4a644bc8 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:03.879885 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-26f78efb-f888-48f5-844f-9a9a4a644bc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:03.973758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f78efb-f888-48f5-844f-9a9a4a644bc8 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:03.979107 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9f1aa-36b9-4b34-9efb-78dafb3c5bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:03.979994 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9f1aa-36b9-4b34-9efb-78dafb3c5bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:03.980272 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9f1aa-36b9-4b34-9efb-78dafb3c5bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:03.980545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9f1aa-36b9-4b34-9efb-78dafb3c5bf0 admin admin] PATH_INFO: `/v3/users/f78dfc22e724485b8e981f7dfe82c1c6` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:03.982385 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9f1aa-36b9-4b34-9efb-78dafb3c5bf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f78dfc22e724485b8e981f7dfe82c1c6)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:03.984357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9f1aa-36b9-4b34-9efb-78dafb3c5bf0 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:03.987013 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:04.036846 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a7f9f1aa-36b9-4b34-9efb-78dafb3c5bf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f78dfc22e724485b8e981f7dfe82c1c6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:04.037526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a7f9f1aa-36b9-4b34-9efb-78dafb3c5bf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f78dfc22e724485b8e981f7dfe82c1c6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:04.045293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a7f9f1aa-36b9-4b34-9efb-78dafb3c5bf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f78dfc22e724485b8e981f7dfe82c1c6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:04.054224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a7f9f1aa-36b9-4b34-9efb-78dafb3c5bf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f78dfc22e724485b8e981f7dfe82c1c6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:04.054870 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a7f9f1aa-36b9-4b34-9efb-78dafb3c5bf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f78dfc22e724485b8e981f7dfe82c1c6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:04.074468 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1377/2716] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:37:03 2022] DELETE /identity/v3/users/f78dfc22e724485b8e981f7dfe82c1c6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:04.262480 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724c602-5a3e-49b0-a7db-993a56aa3ce8 service placement] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:04.275083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724c602-5a3e-49b0-a7db-993a56aa3ce8 service placement] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:04.337167 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b2b38-f22b-4532-be37-86410f6852a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:04.338097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b2b38-f22b-4532-be37-86410f6852a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:04.338380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b2b38-f22b-4532-be37-86410f6852a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:04.338656 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b2b38-f22b-4532-be37-86410f6852a7 admin admin] PATH_INFO: `/v3/projects/49291351324643eda4c6402b1eaedb04` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:04.339853 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b2b38-f22b-4532-be37-86410f6852a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49291351324643eda4c6402b1eaedb04)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:04.341971 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b2b38-f22b-4532-be37-86410f6852a7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:04.391377 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-648b2b38-f22b-4532-be37-86410f6852a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49291351324643eda4c6402b1eaedb04', 'request_id': 'req-648b2b38-f22b-4532-be37-86410f6852a7'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:04.399387 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-648b2b38-f22b-4532-be37-86410f6852a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49291351324643eda4c6402b1eaedb04', 'request_id': 'req-648b2b38-f22b-4532-be37-86410f6852a7'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:04.409591 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-648b2b38-f22b-4532-be37-86410f6852a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49291351324643eda4c6402b1eaedb04', 'request_id': 'req-648b2b38-f22b-4532-be37-86410f6852a7'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:04.422624 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-648b2b38-f22b-4532-be37-86410f6852a7 admin admin] The token cache is being invalidate because project 49291351324643eda4c6402b1eaedb04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:37:04.423097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-648b2b38-f22b-4532-be37-86410f6852a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:04.423870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-648b2b38-f22b-4532-be37-86410f6852a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:04.426320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1340/2717] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:37:04 2022] DELETE /identity/v3/projects/49291351324643eda4c6402b1eaedb04 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:04.430120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9f1aa-36b9-4b34-9efb-78dafb3c5bf0 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:04.431528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a7f9f1aa-36b9-4b34-9efb-78dafb3c5bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:04.447503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9f1aa-36b9-4b34-9efb-78dafb3c5bf0 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:04.525867 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331b8d1-51c0-4e0f-8a28-d477afca9deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:04.526810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331b8d1-51c0-4e0f-8a28-d477afca9deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:04.527098 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331b8d1-51c0-4e0f-8a28-d477afca9deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:04.527774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331b8d1-51c0-4e0f-8a28-d477afca9deb admin admin] PATH_INFO: `/v3/users/e34f3673356c44a2b2dc471571454a38` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:04.529485 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331b8d1-51c0-4e0f-8a28-d477afca9deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e34f3673356c44a2b2dc471571454a38)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:04.532049 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331b8d1-51c0-4e0f-8a28-d477afca9deb admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:04.600733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3331b8d1-51c0-4e0f-8a28-d477afca9deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e34f3673356c44a2b2dc471571454a38'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:04.601670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3331b8d1-51c0-4e0f-8a28-d477afca9deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e34f3673356c44a2b2dc471571454a38'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:04.611065 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3331b8d1-51c0-4e0f-8a28-d477afca9deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e34f3673356c44a2b2dc471571454a38'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:04.621906 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3331b8d1-51c0-4e0f-8a28-d477afca9deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e34f3673356c44a2b2dc471571454a38'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:04.622808 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3331b8d1-51c0-4e0f-8a28-d477afca9deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e34f3673356c44a2b2dc471571454a38'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:04.643230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:04.648714 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1378/2718] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:37:04 2022] DELETE /identity/v3/users/e34f3673356c44a2b2dc471571454a38 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:04.841775 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b2b38-f22b-4532-be37-86410f6852a7 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:04.843262 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-648b2b38-f22b-4532-be37-86410f6852a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:04.863410 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b2b38-f22b-4532-be37-86410f6852a7 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:04.934366 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8688a-0d56-4417-a001-425fc9d9f5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:04.935663 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8688a-0d56-4417-a001-425fc9d9f5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:04.935947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8688a-0d56-4417-a001-425fc9d9f5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:04.936224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8688a-0d56-4417-a001-425fc9d9f5bb admin admin] PATH_INFO: `/v3/projects/dad3fefc8fb64ba5a4e589afbe3790b7` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:04.937416 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8688a-0d56-4417-a001-425fc9d9f5bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad3fefc8fb64ba5a4e589afbe3790b7)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:04.939395 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8688a-0d56-4417-a001-425fc9d9f5bb admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:04.976777 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:04.991914 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f7a8688a-0d56-4417-a001-425fc9d9f5bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad3fefc8fb64ba5a4e589afbe3790b7', 'request_id': 'req-f7a8688a-0d56-4417-a001-425fc9d9f5bb'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:04.998533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f7a8688a-0d56-4417-a001-425fc9d9f5bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad3fefc8fb64ba5a4e589afbe3790b7', 'request_id': 'req-f7a8688a-0d56-4417-a001-425fc9d9f5bb'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:05.007681 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f7a8688a-0d56-4417-a001-425fc9d9f5bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad3fefc8fb64ba5a4e589afbe3790b7', 'request_id': 'req-f7a8688a-0d56-4417-a001-425fc9d9f5bb'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:05.020896 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f7a8688a-0d56-4417-a001-425fc9d9f5bb admin admin] The token cache is being invalidate because project dad3fefc8fb64ba5a4e589afbe3790b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:37:05.021186 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f7a8688a-0d56-4417-a001-425fc9d9f5bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:05.022179 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f7a8688a-0d56-4417-a001-425fc9d9f5bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:05.024150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1341/2719] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:37:04 2022] DELETE /identity/v3/projects/dad3fefc8fb64ba5a4e589afbe3790b7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:05.029474 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb8542-ff19-41c3-bb8c-915433a15c9a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:05.030024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb8542-ff19-41c3-bb8c-915433a15c9a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:05.030024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb8542-ff19-41c3-bb8c-915433a15c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:05.048275 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-1eeb8542-ff19-41c3-bb8c-915433a15c9a None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:05.049486 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1eeb8542-ff19-41c3-bb8c-915433a15c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:05.116557 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1379/2720] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:05.124676 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737aaedf-0e8f-411a-be65-49e21dcfabb0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:05.125018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737aaedf-0e8f-411a-be65-49e21dcfabb0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:05.125296 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737aaedf-0e8f-411a-be65-49e21dcfabb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:05.146550 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-737aaedf-0e8f-411a-be65-49e21dcfabb0 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:05.147813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-737aaedf-0e8f-411a-be65-49e21dcfabb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:05.156735 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1342/2721] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:05.161955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb8542-ff19-41c3-bb8c-915433a15c9a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:05.175151 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb8542-ff19-41c3-bb8c-915433a15c9a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:05.182304 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325060c-24c4-4ddd-84c3-d82969b43aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:05.183237 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325060c-24c4-4ddd-84c3-d82969b43aec admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:05.183553 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325060c-24c4-4ddd-84c3-d82969b43aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:05.183831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325060c-24c4-4ddd-84c3-d82969b43aec admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:05.184746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325060c-24c4-4ddd-84c3-d82969b43aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:37:05.185000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325060c-24c4-4ddd-84c3-d82969b43aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:05.186755 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325060c-24c4-4ddd-84c3-d82969b43aec admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:05.199413 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1380/2722] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:37:05.204790 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737aaedf-0e8f-411a-be65-49e21dcfabb0 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:05.216410 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737aaedf-0e8f-411a-be65-49e21dcfabb0 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:05.222371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ac17a-f290-48ad-9140-3519bd41dd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:05.223034 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ac17a-f290-48ad-9140-3519bd41dd57 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:05.223310 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ac17a-f290-48ad-9140-3519bd41dd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:05.223583 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ac17a-f290-48ad-9140-3519bd41dd57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:05.224272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ac17a-f290-48ad-9140-3519bd41dd57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:05.226235 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ac17a-f290-48ad-9140-3519bd41dd57 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:05.253810 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1343/2723] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:37:05 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:37:05.258341 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325060c-24c4-4ddd-84c3-d82969b43aec admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:05.269154 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325060c-24c4-4ddd-84c3-d82969b43aec admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:05.330824 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f5c70-6331-4985-a232-25b3e0abe493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:05.331503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f5c70-6331-4985-a232-25b3e0abe493 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:05.331785 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f5c70-6331-4985-a232-25b3e0abe493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:05.332062 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f5c70-6331-4985-a232-25b3e0abe493 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:05.332747 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f5c70-6331-4985-a232-25b3e0abe493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:05.334708 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f5c70-6331-4985-a232-25b3e0abe493 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:05.357565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1381/2724] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:37:05 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:37:05.362965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ac17a-f290-48ad-9140-3519bd41dd57 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:05.375561 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ac17a-f290-48ad-9140-3519bd41dd57 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:05.383064 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a23da-4023-4f38-9041-c183d39669e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:05.383729 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a23da-4023-4f38-9041-c183d39669e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:05.384015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a23da-4023-4f38-9041-c183d39669e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:05.384289 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a23da-4023-4f38-9041-c183d39669e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:05.385021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a23da-4023-4f38-9041-c183d39669e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:05.386681 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a23da-4023-4f38-9041-c183d39669e6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:05.398354 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1344/2725] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:37:05.402529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f5c70-6331-4985-a232-25b3e0abe493 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:05.413617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f5c70-6331-4985-a232-25b3e0abe493 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:05.419859 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c03aff-a4ff-413e-8071-bbaa7aeeaa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:05.420532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c03aff-a4ff-413e-8071-bbaa7aeeaa7a admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:05.420814 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c03aff-a4ff-413e-8071-bbaa7aeeaa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:05.421093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c03aff-a4ff-413e-8071-bbaa7aeeaa7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:05.421842 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c03aff-a4ff-413e-8071-bbaa7aeeaa7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:05.423515 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c03aff-a4ff-413e-8071-bbaa7aeeaa7a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:05.434095 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1382/2726] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:37:05.438933 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a23da-4023-4f38-9041-c183d39669e6 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:05.449759 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a23da-4023-4f38-9041-c183d39669e6 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:05.455495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee6b07-49db-46bf-a1a6-4c8ebdeaac98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:05.456385 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee6b07-49db-46bf-a1a6-4c8ebdeaac98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:05.456665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee6b07-49db-46bf-a1a6-4c8ebdeaac98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:05.456938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee6b07-49db-46bf-a1a6-4c8ebdeaac98 admin admin] PATH_INFO: `/v3/projects/410bd715c040472387b477e3bf1a9bd5/users/17499d2d0de542cf86e66048636ed1eb/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:05.474006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee6b07-49db-46bf-a1a6-4c8ebdeaac98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=410bd715c040472387b477e3bf1a9bd5, user_id=17499d2d0de542cf86e66048636ed1eb, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:05.476658 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee6b07-49db-46bf-a1a6-4c8ebdeaac98 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:05.491667 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1345/2727] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:37:05 2022] PUT /identity/v3/projects/410bd715c040472387b477e3bf1a9bd5/users/17499d2d0de542cf86e66048636ed1eb/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:05.503374 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4161842-322d-4c8f-9403-d869f4063acc None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:05.503661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4161842-322d-4c8f-9403-d869f4063acc None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:05.503936 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4161842-322d-4c8f-9403-d869f4063acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:05.531705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c4161842-322d-4c8f-9403-d869f4063acc None None] MFA Rules not processed for user `17499d2d0de542cf86e66048636ed1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:05.532911 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c4161842-322d-4c8f-9403-d869f4063acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:05.602738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:05.613750 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1383/2728] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:05.625980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee6b07-49db-46bf-a1a6-4c8ebdeaac98 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:05.627713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b8ee6b07-49db-46bf-a1a6-4c8ebdeaac98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:05.689760 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee6b07-49db-46bf-a1a6-4c8ebdeaac98 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:05.693535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda1b2b-7292-4a32-b318-8cf89b3b0d45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:05.694244 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda1b2b-7292-4a32-b318-8cf89b3b0d45 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:05.694524 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda1b2b-7292-4a32-b318-8cf89b3b0d45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:05.694804 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda1b2b-7292-4a32-b318-8cf89b3b0d45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:05.704002 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda1b2b-7292-4a32-b318-8cf89b3b0d45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:05.705437 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda1b2b-7292-4a32-b318-8cf89b3b0d45 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:05.714565 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1346/2729] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:37:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:37:05.735391 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4161842-322d-4c8f-9403-d869f4063acc None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:05.803304 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4161842-322d-4c8f-9403-d869f4063acc None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:05.810938 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15daff-4bdd-469d-b97a-10890210c882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:05.811837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15daff-4bdd-469d-b97a-10890210c882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:05.812127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15daff-4bdd-469d-b97a-10890210c882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:05.812405 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15daff-4bdd-469d-b97a-10890210c882 admin admin] PATH_INFO: `/v3/users/17499d2d0de542cf86e66048636ed1eb` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:05.813650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15daff-4bdd-469d-b97a-10890210c882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17499d2d0de542cf86e66048636ed1eb)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:05.815640 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15daff-4bdd-469d-b97a-10890210c882 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:05.870816 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ba15daff-4bdd-469d-b97a-10890210c882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17499d2d0de542cf86e66048636ed1eb'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:05.871532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ba15daff-4bdd-469d-b97a-10890210c882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17499d2d0de542cf86e66048636ed1eb'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:05.880667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ba15daff-4bdd-469d-b97a-10890210c882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17499d2d0de542cf86e66048636ed1eb'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:05.892288 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ba15daff-4bdd-469d-b97a-10890210c882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17499d2d0de542cf86e66048636ed1eb'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:05.893585 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ba15daff-4bdd-469d-b97a-10890210c882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17499d2d0de542cf86e66048636ed1eb'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:05.919495 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1384/2730] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:37:05 2022] DELETE /identity/v3/users/17499d2d0de542cf86e66048636ed1eb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:05.927197 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585853f-8df1-4b40-b01d-8a400fff4288 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:05.927852 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585853f-8df1-4b40-b01d-8a400fff4288 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:05.928422 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585853f-8df1-4b40-b01d-8a400fff4288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:05.956166 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-1585853f-8df1-4b40-b01d-8a400fff4288 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:05.958099 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1585853f-8df1-4b40-b01d-8a400fff4288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:06.001029 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15daff-4bdd-469d-b97a-10890210c882 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:06.003356 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ba15daff-4bdd-469d-b97a-10890210c882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:06.048552 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:06.062299 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1347/2731] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:06.072006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585853f-8df1-4b40-b01d-8a400fff4288 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:06.074086 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1585853f-8df1-4b40-b01d-8a400fff4288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:06.091500 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15daff-4bdd-469d-b97a-10890210c882 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:06.097100 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8339fa-d95b-4b9e-92be-ab9edfda33c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:06.097866 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8339fa-d95b-4b9e-92be-ab9edfda33c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:06.098209 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8339fa-d95b-4b9e-92be-ab9edfda33c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:06.098552 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8339fa-d95b-4b9e-92be-ab9edfda33c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:06.102528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5f8339fa-d95b-4b9e-92be-ab9edfda33c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:06.142956 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585853f-8df1-4b40-b01d-8a400fff4288 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:06.148065 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971891f-299c-4646-9adf-14faaf76d0a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:06.148256 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:06.148733 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971891f-299c-4646-9adf-14faaf76d0a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:06.149007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971891f-299c-4646-9adf-14faaf76d0a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:06.149278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971891f-299c-4646-9adf-14faaf76d0a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:06.162420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971891f-299c-4646-9adf-14faaf76d0a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:06.167965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971891f-299c-4646-9adf-14faaf76d0a7 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:06.183619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1348/2732] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:37:06.189618 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8339fa-d95b-4b9e-92be-ab9edfda33c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:06.191191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8339fa-d95b-4b9e-92be-ab9edfda33c3 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:06.202150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1385/2733] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:37:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:37:06.505985 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971891f-299c-4646-9adf-14faaf76d0a7 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:06.510065 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0971891f-299c-4646-9adf-14faaf76d0a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:06.542074 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971891f-299c-4646-9adf-14faaf76d0a7 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:06.549598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe2458-6082-45c2-bbe6-4b3f969f6c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:06.551496 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe2458-6082-45c2-bbe6-4b3f969f6c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:06.552055 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe2458-6082-45c2-bbe6-4b3f969f6c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:06.552515 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe2458-6082-45c2-bbe6-4b3f969f6c00 admin admin] PATH_INFO: `/v3/projects/410bd715c040472387b477e3bf1a9bd5` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:06.554077 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe2458-6082-45c2-bbe6-4b3f969f6c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=410bd715c040472387b477e3bf1a9bd5)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:06.557632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe2458-6082-45c2-bbe6-4b3f969f6c00 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:06.627514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c2fe2458-6082-45c2-bbe6-4b3f969f6c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410bd715c040472387b477e3bf1a9bd5', 'request_id': 'req-c2fe2458-6082-45c2-bbe6-4b3f969f6c00'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:06.636161 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c2fe2458-6082-45c2-bbe6-4b3f969f6c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410bd715c040472387b477e3bf1a9bd5', 'request_id': 'req-c2fe2458-6082-45c2-bbe6-4b3f969f6c00'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:06.653942 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c2fe2458-6082-45c2-bbe6-4b3f969f6c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410bd715c040472387b477e3bf1a9bd5', 'request_id': 'req-c2fe2458-6082-45c2-bbe6-4b3f969f6c00'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:06.675335 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c2fe2458-6082-45c2-bbe6-4b3f969f6c00 admin admin] The token cache is being invalidate because project 410bd715c040472387b477e3bf1a9bd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:37:06.676146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c2fe2458-6082-45c2-bbe6-4b3f969f6c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:06.677118 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c2fe2458-6082-45c2-bbe6-4b3f969f6c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:06.679661 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1349/2734] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:37:06 2022] DELETE /identity/v3/projects/410bd715c040472387b477e3bf1a9bd5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:06.685959 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd0ead-08d5-4b99-a40a-73fb8643b7fb None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:06.686380 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd0ead-08d5-4b99-a40a-73fb8643b7fb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:06.686833 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd0ead-08d5-4b99-a40a-73fb8643b7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:06.707623 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-1dfd0ead-08d5-4b99-a40a-73fb8643b7fb None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:06.708849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1dfd0ead-08d5-4b99-a40a-73fb8643b7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:06.771031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1386/2735] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:06.779141 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c40fed-87e6-44e7-83c4-7e777f492abc None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:06.779420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c40fed-87e6-44e7-83c4-7e777f492abc None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:06.779689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c40fed-87e6-44e7-83c4-7e777f492abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:06.798808 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-c5c40fed-87e6-44e7-83c4-7e777f492abc None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:06.800172 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c5c40fed-87e6-44e7-83c4-7e777f492abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:06.808314 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1350/2736] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:06.812783 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd0ead-08d5-4b99-a40a-73fb8643b7fb None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:06.822624 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd0ead-08d5-4b99-a40a-73fb8643b7fb None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:06.827364 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba0df3-aebb-4a2f-ba89-dc759d15e69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:06.828015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba0df3-aebb-4a2f-ba89-dc759d15e69f admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:06.828292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba0df3-aebb-4a2f-ba89-dc759d15e69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:06.828566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba0df3-aebb-4a2f-ba89-dc759d15e69f admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:06.829287 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba0df3-aebb-4a2f-ba89-dc759d15e69f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:37:06.829590 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba0df3-aebb-4a2f-ba89-dc759d15e69f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:06.831231 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba0df3-aebb-4a2f-ba89-dc759d15e69f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:06.842732 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1387/2737] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:37:06.847052 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c40fed-87e6-44e7-83c4-7e777f492abc None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:06.857083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c40fed-87e6-44e7-83c4-7e777f492abc None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:06.862902 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb7794-c2a2-4e1f-aaa9-5e7c1e866790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:06.863713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb7794-c2a2-4e1f-aaa9-5e7c1e866790 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:06.864033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb7794-c2a2-4e1f-aaa9-5e7c1e866790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:06.864306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb7794-c2a2-4e1f-aaa9-5e7c1e866790 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:06.865178 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb7794-c2a2-4e1f-aaa9-5e7c1e866790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:06.867197 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb7794-c2a2-4e1f-aaa9-5e7c1e866790 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:06.894702 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1351/2738] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:37:06 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:37:06.898906 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba0df3-aebb-4a2f-ba89-dc759d15e69f admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:06.908763 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba0df3-aebb-4a2f-ba89-dc759d15e69f admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:06.971281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9d298-63d7-41b5-8cf3-09f1738f2c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:06.971901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d298-63d7-41b5-8cf3-09f1738f2c03 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:06.972178 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d298-63d7-41b5-8cf3-09f1738f2c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:06.972450 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d298-63d7-41b5-8cf3-09f1738f2c03 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:06.973150 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9d298-63d7-41b5-8cf3-09f1738f2c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:06.975344 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9d298-63d7-41b5-8cf3-09f1738f2c03 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:06.998750 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1388/2739] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:37:06 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:37:07.002972 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb7794-c2a2-4e1f-aaa9-5e7c1e866790 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:07.014349 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb7794-c2a2-4e1f-aaa9-5e7c1e866790 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:07.020210 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a9cff-e732-4c60-96c0-8a5479abb870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:07.021117 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a9cff-e732-4c60-96c0-8a5479abb870 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:07.021482 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a9cff-e732-4c60-96c0-8a5479abb870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:07.021758 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a9cff-e732-4c60-96c0-8a5479abb870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:07.022570 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a9cff-e732-4c60-96c0-8a5479abb870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:07.025083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a9cff-e732-4c60-96c0-8a5479abb870 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:07.037619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1352/2740] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:37:07.041980 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9d298-63d7-41b5-8cf3-09f1738f2c03 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:07.053392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9d298-63d7-41b5-8cf3-09f1738f2c03 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:07.058981 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2bd11-f3a7-4eaa-ae6b-e9d98940d728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:07.059861 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2bd11-f3a7-4eaa-ae6b-e9d98940d728 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:07.060288 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2bd11-f3a7-4eaa-ae6b-e9d98940d728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:07.060564 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2bd11-f3a7-4eaa-ae6b-e9d98940d728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:07.061285 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2bd11-f3a7-4eaa-ae6b-e9d98940d728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:07.062931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2bd11-f3a7-4eaa-ae6b-e9d98940d728 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:07.073416 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1389/2741] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:37:07.078138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a9cff-e732-4c60-96c0-8a5479abb870 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:07.088607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a9cff-e732-4c60-96c0-8a5479abb870 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:07.094942 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee757ca3-c208-4e8a-af79-4acc4dc9fef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:07.095828 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee757ca3-c208-4e8a-af79-4acc4dc9fef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:07.096104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee757ca3-c208-4e8a-af79-4acc4dc9fef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:07.096375 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee757ca3-c208-4e8a-af79-4acc4dc9fef5 admin admin] PATH_INFO: `/v3/projects/9028b1da36234e848abd092572902c2f/users/ff4e696635684412a8dc16b26280a7b8/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:07.112966 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee757ca3-c208-4e8a-af79-4acc4dc9fef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9028b1da36234e848abd092572902c2f, user_id=ff4e696635684412a8dc16b26280a7b8, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:07.115650 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee757ca3-c208-4e8a-af79-4acc4dc9fef5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:07.130792 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1353/2742] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:37:07 2022] PUT /identity/v3/projects/9028b1da36234e848abd092572902c2f/users/ff4e696635684412a8dc16b26280a7b8/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:07.142458 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bdd6d-76c0-4f88-8570-ee872b8023ea None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:07.143021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bdd6d-76c0-4f88-8570-ee872b8023ea None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:07.143021 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bdd6d-76c0-4f88-8570-ee872b8023ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:07.171910 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6f5bdd6d-76c0-4f88-8570-ee872b8023ea None None] MFA Rules not processed for user `ff4e696635684412a8dc16b26280a7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:07.173143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6f5bdd6d-76c0-4f88-8570-ee872b8023ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:07.193840 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:07.244966 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1390/2743] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:07.256611 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee757ca3-c208-4e8a-af79-4acc4dc9fef5 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:07.258545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ee757ca3-c208-4e8a-af79-4acc4dc9fef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:07.283295 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:07.343539 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee757ca3-c208-4e8a-af79-4acc4dc9fef5 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:07.348069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e10347-cf01-4ef0-a6d7-cc95da427213 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1b010003c44dc19643558167424d13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:07.348717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e10347-cf01-4ef0-a6d7-cc95da427213 service glance] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:07.348992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e10347-cf01-4ef0-a6d7-cc95da427213 service glance] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:07.349261 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e10347-cf01-4ef0-a6d7-cc95da427213 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:07.358420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e10347-cf01-4ef0-a6d7-cc95da427213 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:07.359853 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e10347-cf01-4ef0-a6d7-cc95da427213 service glance] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:07.368877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1354/2744] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:37:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:37:08.978170 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bdd6d-76c0-4f88-8570-ee872b8023ea None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:08.980174 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6f5bdd6d-76c0-4f88-8570-ee872b8023ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:09.042447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bdd6d-76c0-4f88-8570-ee872b8023ea None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:09.046396 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cdae8-b00c-4d03-b4a7-dde5dd9c0f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:09.047059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cdae8-b00c-4d03-b4a7-dde5dd9c0f90 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:09.047323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cdae8-b00c-4d03-b4a7-dde5dd9c0f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:09.047595 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cdae8-b00c-4d03-b4a7-dde5dd9c0f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:09.052042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a41cdae8-b00c-4d03-b4a7-dde5dd9c0f90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:09.117295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cdae8-b00c-4d03-b4a7-dde5dd9c0f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:09.118855 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cdae8-b00c-4d03-b4a7-dde5dd9c0f90 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:09.132773 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1391/2745] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:37:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:37:09.903741 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e10347-cf01-4ef0-a6d7-cc95da427213 service glance] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:09.905702 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-73e10347-cf01-4ef0-a6d7-cc95da427213 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:09.922226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e10347-cf01-4ef0-a6d7-cc95da427213 service glance] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:09.928139 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8d814-b41d-45f2-b81a-6df8c660f16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:09.929045 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8d814-b41d-45f2-b81a-6df8c660f16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:09.929323 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8d814-b41d-45f2-b81a-6df8c660f16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:09.929597 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8d814-b41d-45f2-b81a-6df8c660f16e admin admin] PATH_INFO: `/v3/users/5c5875c5cba841a28560a475bb18d595` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:09.931247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8d814-b41d-45f2-b81a-6df8c660f16e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c5875c5cba841a28560a475bb18d595)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:09.933218 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8d814-b41d-45f2-b81a-6df8c660f16e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:09.991726 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-efc8d814-b41d-45f2-b81a-6df8c660f16e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c5875c5cba841a28560a475bb18d595'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:09.992505 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-efc8d814-b41d-45f2-b81a-6df8c660f16e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c5875c5cba841a28560a475bb18d595'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:10.000783 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-efc8d814-b41d-45f2-b81a-6df8c660f16e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c5875c5cba841a28560a475bb18d595'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:10.014110 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-efc8d814-b41d-45f2-b81a-6df8c660f16e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c5875c5cba841a28560a475bb18d595'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:10.014874 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-efc8d814-b41d-45f2-b81a-6df8c660f16e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c5875c5cba841a28560a475bb18d595'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:10.030454 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1355/2746] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:37:09 2022] DELETE /identity/v3/users/5c5875c5cba841a28560a475bb18d595 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:10.227170 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cdae8-b00c-4d03-b4a7-dde5dd9c0f90 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:10.240104 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cdae8-b00c-4d03-b4a7-dde5dd9c0f90 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:10.308313 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc1ad0-980a-4ada-a3fc-29a5d4ae8b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:10.309582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc1ad0-980a-4ada-a3fc-29a5d4ae8b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:10.310046 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc1ad0-980a-4ada-a3fc-29a5d4ae8b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:10.310455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc1ad0-980a-4ada-a3fc-29a5d4ae8b70 admin admin] PATH_INFO: `/v3/projects/6ad466a7fdbb4ef18dddf54fb200971d` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:10.311896 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc1ad0-980a-4ada-a3fc-29a5d4ae8b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad466a7fdbb4ef18dddf54fb200971d)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:10.313887 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc1ad0-980a-4ada-a3fc-29a5d4ae8b70 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:10.325628 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:10.366462 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2acc1ad0-980a-4ada-a3fc-29a5d4ae8b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad466a7fdbb4ef18dddf54fb200971d', 'request_id': 'req-2acc1ad0-980a-4ada-a3fc-29a5d4ae8b70'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:10.375572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2acc1ad0-980a-4ada-a3fc-29a5d4ae8b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad466a7fdbb4ef18dddf54fb200971d', 'request_id': 'req-2acc1ad0-980a-4ada-a3fc-29a5d4ae8b70'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:10.383135 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2acc1ad0-980a-4ada-a3fc-29a5d4ae8b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad466a7fdbb4ef18dddf54fb200971d', 'request_id': 'req-2acc1ad0-980a-4ada-a3fc-29a5d4ae8b70'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:10.393920 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2acc1ad0-980a-4ada-a3fc-29a5d4ae8b70 admin admin] The token cache is being invalidate because project 6ad466a7fdbb4ef18dddf54fb200971d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:37:10.394212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2acc1ad0-980a-4ada-a3fc-29a5d4ae8b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:10.394897 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2acc1ad0-980a-4ada-a3fc-29a5d4ae8b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:10.396476 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1392/2747] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:37:10 2022] DELETE /identity/v3/projects/6ad466a7fdbb4ef18dddf54fb200971d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:11.242541 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8d814-b41d-45f2-b81a-6df8c660f16e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:11.244697 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-efc8d814-b41d-45f2-b81a-6df8c660f16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:11.264636 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8d814-b41d-45f2-b81a-6df8c660f16e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:11.331506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839014d-d0da-4901-97a3-36f16907e91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:11.332393 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839014d-d0da-4901-97a3-36f16907e91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:11.332671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839014d-d0da-4901-97a3-36f16907e91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:11.332943 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839014d-d0da-4901-97a3-36f16907e91c admin admin] PATH_INFO: `/v3/users/1fbf04823e6e49ada94c12cf5336a3ac` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:11.334147 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839014d-d0da-4901-97a3-36f16907e91c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbf04823e6e49ada94c12cf5336a3ac)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:11.336061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839014d-d0da-4901-97a3-36f16907e91c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:11.352206 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:11.384746 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7839014d-d0da-4901-97a3-36f16907e91c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbf04823e6e49ada94c12cf5336a3ac'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:11.385426 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7839014d-d0da-4901-97a3-36f16907e91c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbf04823e6e49ada94c12cf5336a3ac'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:11.392344 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7839014d-d0da-4901-97a3-36f16907e91c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbf04823e6e49ada94c12cf5336a3ac'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:11.407144 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7839014d-d0da-4901-97a3-36f16907e91c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbf04823e6e49ada94c12cf5336a3ac'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:11.407846 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7839014d-d0da-4901-97a3-36f16907e91c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbf04823e6e49ada94c12cf5336a3ac'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:11.426063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1356/2748] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:37:11 2022] DELETE /identity/v3/users/1fbf04823e6e49ada94c12cf5336a3ac => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:11.431937 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cca78d-e491-4bca-b359-18acfeb9336f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:11.432537 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cca78d-e491-4bca-b359-18acfeb9336f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:11.433028 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cca78d-e491-4bca-b359-18acfeb9336f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:11.452610 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-13cca78d-e491-4bca-b359-18acfeb9336f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:11.453834 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-13cca78d-e491-4bca-b359-18acfeb9336f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:11.521311 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1393/2749] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:11.528358 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839014d-d0da-4901-97a3-36f16907e91c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:11.530095 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7839014d-d0da-4901-97a3-36f16907e91c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:11.600605 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839014d-d0da-4901-97a3-36f16907e91c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:11.604877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a8007-f917-42e1-b80e-d28e0b84fd51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:11.605522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a8007-f917-42e1-b80e-d28e0b84fd51 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:11.605834 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a8007-f917-42e1-b80e-d28e0b84fd51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:11.606125 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a8007-f917-42e1-b80e-d28e0b84fd51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:11.616627 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a8007-f917-42e1-b80e-d28e0b84fd51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:11.618703 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a8007-f917-42e1-b80e-d28e0b84fd51 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:11.628473 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1357/2750] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:37:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:37:11.925039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cca78d-e491-4bca-b359-18acfeb9336f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:11.926963 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-13cca78d-e491-4bca-b359-18acfeb9336f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:11.942478 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cca78d-e491-4bca-b359-18acfeb9336f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:11.947831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb81c45-c82e-471b-bc7c-04d140ea01e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:11.948714 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb81c45-c82e-471b-bc7c-04d140ea01e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:11.948993 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb81c45-c82e-471b-bc7c-04d140ea01e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:11.949352 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb81c45-c82e-471b-bc7c-04d140ea01e6 admin admin] PATH_INFO: `/v3/projects/53f87681cc01466eb743e970d6fa2d64` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:11.950660 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb81c45-c82e-471b-bc7c-04d140ea01e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f87681cc01466eb743e970d6fa2d64)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:11.952605 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb81c45-c82e-471b-bc7c-04d140ea01e6 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:12.003011 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-abb81c45-c82e-471b-bc7c-04d140ea01e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f87681cc01466eb743e970d6fa2d64', 'request_id': 'req-abb81c45-c82e-471b-bc7c-04d140ea01e6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:12.013670 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-abb81c45-c82e-471b-bc7c-04d140ea01e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f87681cc01466eb743e970d6fa2d64', 'request_id': 'req-abb81c45-c82e-471b-bc7c-04d140ea01e6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:12.021281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-abb81c45-c82e-471b-bc7c-04d140ea01e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f87681cc01466eb743e970d6fa2d64', 'request_id': 'req-abb81c45-c82e-471b-bc7c-04d140ea01e6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:12.032137 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-abb81c45-c82e-471b-bc7c-04d140ea01e6 admin admin] The token cache is being invalidate because project 53f87681cc01466eb743e970d6fa2d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:37:12.032328 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-abb81c45-c82e-471b-bc7c-04d140ea01e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:12.033012 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-abb81c45-c82e-471b-bc7c-04d140ea01e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:12.034705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1394/2751] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:37:11 2022] DELETE /identity/v3/projects/53f87681cc01466eb743e970d6fa2d64 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:12.038735 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a8007-f917-42e1-b80e-d28e0b84fd51 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:12.048849 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a8007-f917-42e1-b80e-d28e0b84fd51 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:12.109188 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71717a6a-8458-477e-882d-360b0f6cc6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:12.110110 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71717a6a-8458-477e-882d-360b0f6cc6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:12.110389 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71717a6a-8458-477e-882d-360b0f6cc6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:12.110659 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71717a6a-8458-477e-882d-360b0f6cc6dd admin admin] PATH_INFO: `/v3/users/627ff3e80eb24901a30f90f004ecf588` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:12.111860 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71717a6a-8458-477e-882d-360b0f6cc6dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=627ff3e80eb24901a30f90f004ecf588)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:12.113789 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71717a6a-8458-477e-882d-360b0f6cc6dd admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:12.172857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:12.180470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-71717a6a-8458-477e-882d-360b0f6cc6dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627ff3e80eb24901a30f90f004ecf588'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:12.181361 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-71717a6a-8458-477e-882d-360b0f6cc6dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627ff3e80eb24901a30f90f004ecf588'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:12.189788 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-71717a6a-8458-477e-882d-360b0f6cc6dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627ff3e80eb24901a30f90f004ecf588'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:12.202621 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-71717a6a-8458-477e-882d-360b0f6cc6dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627ff3e80eb24901a30f90f004ecf588'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:12.203263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-71717a6a-8458-477e-882d-360b0f6cc6dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627ff3e80eb24901a30f90f004ecf588'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:12.216644 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1358/2752] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:37:12 2022] DELETE /identity/v3/users/627ff3e80eb24901a30f90f004ecf588 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:12.503831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb81c45-c82e-471b-bc7c-04d140ea01e6 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:12.505314 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-abb81c45-c82e-471b-bc7c-04d140ea01e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:12.520145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb81c45-c82e-471b-bc7c-04d140ea01e6 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:12.553037 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:12.597065 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68066cd-70f7-4150-98c9-3d1dfc061cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:12.597910 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68066cd-70f7-4150-98c9-3d1dfc061cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:12.598192 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68066cd-70f7-4150-98c9-3d1dfc061cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:12.598463 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68066cd-70f7-4150-98c9-3d1dfc061cbb admin admin] PATH_INFO: `/v3/projects/df959cae5d8e4087bea66718b9cd9676` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:12.599769 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68066cd-70f7-4150-98c9-3d1dfc061cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=df959cae5d8e4087bea66718b9cd9676)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:12.601722 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68066cd-70f7-4150-98c9-3d1dfc061cbb admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:12.658544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d68066cd-70f7-4150-98c9-3d1dfc061cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df959cae5d8e4087bea66718b9cd9676', 'request_id': 'req-d68066cd-70f7-4150-98c9-3d1dfc061cbb'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:12.668917 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d68066cd-70f7-4150-98c9-3d1dfc061cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df959cae5d8e4087bea66718b9cd9676', 'request_id': 'req-d68066cd-70f7-4150-98c9-3d1dfc061cbb'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:12.676363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d68066cd-70f7-4150-98c9-3d1dfc061cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df959cae5d8e4087bea66718b9cd9676', 'request_id': 'req-d68066cd-70f7-4150-98c9-3d1dfc061cbb'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:12.687200 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d68066cd-70f7-4150-98c9-3d1dfc061cbb admin admin] The token cache is being invalidate because project df959cae5d8e4087bea66718b9cd9676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:37:12.687511 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d68066cd-70f7-4150-98c9-3d1dfc061cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:12.688255 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d68066cd-70f7-4150-98c9-3d1dfc061cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:12.689948 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1395/2753] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:37:12 2022] DELETE /identity/v3/projects/df959cae5d8e4087bea66718b9cd9676 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:12.699934 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d46289-8569-4e8d-a39a-48215902d4b6 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:12.700559 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d46289-8569-4e8d-a39a-48215902d4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:12.700666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d46289-8569-4e8d-a39a-48215902d4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:12.719996 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-30d46289-8569-4e8d-a39a-48215902d4b6 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:12.721243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-30d46289-8569-4e8d-a39a-48215902d4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:12.796812 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1359/2754] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:12.807584 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4b270-eb0f-4a2b-bbd7-0a365d3f6d6f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:12.807955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4b270-eb0f-4a2b-bbd7-0a365d3f6d6f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:12.808293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4b270-eb0f-4a2b-bbd7-0a365d3f6d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:12.828676 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-74c4b270-eb0f-4a2b-bbd7-0a365d3f6d6f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:12.829915 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-74c4b270-eb0f-4a2b-bbd7-0a365d3f6d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:12.838506 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1396/2755] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:12.842931 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d46289-8569-4e8d-a39a-48215902d4b6 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:12.854342 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d46289-8569-4e8d-a39a-48215902d4b6 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:12.859304 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711df120-9da9-4e49-b1ee-bf57c7588495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:12.859973 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df120-9da9-4e49-b1ee-bf57c7588495 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:12.860256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df120-9da9-4e49-b1ee-bf57c7588495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:12.860532 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df120-9da9-4e49-b1ee-bf57c7588495 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:12.861267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711df120-9da9-4e49-b1ee-bf57c7588495 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:37:12.861574 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711df120-9da9-4e49-b1ee-bf57c7588495 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:12.863256 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711df120-9da9-4e49-b1ee-bf57c7588495 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:12.875945 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1360/2756] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:37:12.880427 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4b270-eb0f-4a2b-bbd7-0a365d3f6d6f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:12.890432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4b270-eb0f-4a2b-bbd7-0a365d3f6d6f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:12.901143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bb844-a8c0-4472-8d65-5c3ec82f43ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:12.901990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bb844-a8c0-4472-8d65-5c3ec82f43ce admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:12.902291 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bb844-a8c0-4472-8d65-5c3ec82f43ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:12.902585 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bb844-a8c0-4472-8d65-5c3ec82f43ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:12.903657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bb844-a8c0-4472-8d65-5c3ec82f43ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:12.906120 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bb844-a8c0-4472-8d65-5c3ec82f43ce admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:12.937591 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1397/2757] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:37:12 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:37:12.942542 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711df120-9da9-4e49-b1ee-bf57c7588495 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:12.953933 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711df120-9da9-4e49-b1ee-bf57c7588495 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:13.026322 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fce42b-b86b-4d7e-8afb-ba9701a4fef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:13.027078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fce42b-b86b-4d7e-8afb-ba9701a4fef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:13.027472 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fce42b-b86b-4d7e-8afb-ba9701a4fef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:13.027742 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fce42b-b86b-4d7e-8afb-ba9701a4fef8 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:13.029258 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fce42b-b86b-4d7e-8afb-ba9701a4fef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:13.031529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fce42b-b86b-4d7e-8afb-ba9701a4fef8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:13.055273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1361/2758] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:37:12 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:37:13.061103 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bb844-a8c0-4472-8d65-5c3ec82f43ce admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:13.073013 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bb844-a8c0-4472-8d65-5c3ec82f43ce admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:13.082143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0980b9e-b01c-45dd-b6eb-dc76f81bb39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:13.083102 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0980b9e-b01c-45dd-b6eb-dc76f81bb39e admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:13.083377 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0980b9e-b01c-45dd-b6eb-dc76f81bb39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:13.083644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0980b9e-b01c-45dd-b6eb-dc76f81bb39e admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:13.084484 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0980b9e-b01c-45dd-b6eb-dc76f81bb39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:13.086947 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0980b9e-b01c-45dd-b6eb-dc76f81bb39e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:13.099890 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1398/2759] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:37:13.104299 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fce42b-b86b-4d7e-8afb-ba9701a4fef8 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:13.115092 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fce42b-b86b-4d7e-8afb-ba9701a4fef8 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:13.121473 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15150051-b88b-4f70-b168-e45844b5946e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:13.122858 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15150051-b88b-4f70-b168-e45844b5946e admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:13.122975 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15150051-b88b-4f70-b168-e45844b5946e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:13.123213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15150051-b88b-4f70-b168-e45844b5946e admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:13.123993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15150051-b88b-4f70-b168-e45844b5946e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:13.125933 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15150051-b88b-4f70-b168-e45844b5946e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:13.142264 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1362/2760] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:37:13.143298 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0980b9e-b01c-45dd-b6eb-dc76f81bb39e admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:13.164900 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0980b9e-b01c-45dd-b6eb-dc76f81bb39e admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:13.164900 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427c701-7fc6-4cf5-b0d8-9826ce71dfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:13.164900 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427c701-7fc6-4cf5-b0d8-9826ce71dfd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:13.164900 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427c701-7fc6-4cf5-b0d8-9826ce71dfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:13.165545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427c701-7fc6-4cf5-b0d8-9826ce71dfd2 admin admin] PATH_INFO: `/v3/projects/7935e764edb64de9ab418a737f4e2150/users/fb8d077038bb4a4e89e748b710c5d00c/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:13.180759 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427c701-7fc6-4cf5-b0d8-9826ce71dfd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7935e764edb64de9ab418a737f4e2150, user_id=fb8d077038bb4a4e89e748b710c5d00c, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:13.183466 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427c701-7fc6-4cf5-b0d8-9826ce71dfd2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:13.198705 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1399/2761] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:37:13 2022] PUT /identity/v3/projects/7935e764edb64de9ab418a737f4e2150/users/fb8d077038bb4a4e89e748b710c5d00c/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:13.210947 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c57f5-2434-4745-aa1a-9c40dfa7d270 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:13.211232 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c57f5-2434-4745-aa1a-9c40dfa7d270 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:13.211503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c57f5-2434-4745-aa1a-9c40dfa7d270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:13.239745 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-828c57f5-2434-4745-aa1a-9c40dfa7d270 None None] MFA Rules not processed for user `fb8d077038bb4a4e89e748b710c5d00c`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:13.240954 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-828c57f5-2434-4745-aa1a-9c40dfa7d270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:13.251135 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:13.311198 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1363/2762] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:13.315960 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427c701-7fc6-4cf5-b0d8-9826ce71dfd2 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:13.368748 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:13.384319 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427c701-7fc6-4cf5-b0d8-9826ce71dfd2 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:13.391395 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf8b97-a022-4290-8d38-bdbb67644217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:13.392094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf8b97-a022-4290-8d38-bdbb67644217 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:13.392374 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf8b97-a022-4290-8d38-bdbb67644217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:13.392644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf8b97-a022-4290-8d38-bdbb67644217 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:13.393343 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf8b97-a022-4290-8d38-bdbb67644217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:13.395288 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf8b97-a022-4290-8d38-bdbb67644217 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:13.427046 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1400/2763] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:37:13 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:37:13.429909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c57f5-2434-4745-aa1a-9c40dfa7d270 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:13.441593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c57f5-2434-4745-aa1a-9c40dfa7d270 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:13.514737 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1080a5-494d-44b6-8c52-058df628555d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:13.515434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1080a5-494d-44b6-8c52-058df628555d admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:13.515713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1080a5-494d-44b6-8c52-058df628555d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:13.516114 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1080a5-494d-44b6-8c52-058df628555d admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:13.516835 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1080a5-494d-44b6-8c52-058df628555d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:13.518654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1080a5-494d-44b6-8c52-058df628555d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:13.549028 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1364/2764] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:37:13 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:37:13.550712 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf8b97-a022-4290-8d38-bdbb67644217 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:13.561595 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf8b97-a022-4290-8d38-bdbb67644217 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:13.566519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb4b29-8e18-49ad-95cb-59f0e49004db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:13.567220 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb4b29-8e18-49ad-95cb-59f0e49004db admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:13.567549 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb4b29-8e18-49ad-95cb-59f0e49004db admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:13.567830 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb4b29-8e18-49ad-95cb-59f0e49004db admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:13.568582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb4b29-8e18-49ad-95cb-59f0e49004db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:13.570374 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb4b29-8e18-49ad-95cb-59f0e49004db admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:13.585095 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1401/2765] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:37:13.588760 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1080a5-494d-44b6-8c52-058df628555d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:13.604848 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1080a5-494d-44b6-8c52-058df628555d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:13.612669 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64554504-d554-4315-a72a-3314e5005d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:13.613389 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64554504-d554-4315-a72a-3314e5005d7b admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:13.613917 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64554504-d554-4315-a72a-3314e5005d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:13.614051 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64554504-d554-4315-a72a-3314e5005d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:13.614824 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64554504-d554-4315-a72a-3314e5005d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:13.616466 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64554504-d554-4315-a72a-3314e5005d7b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:13.633847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1365/2766] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:37:13.635409 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb4b29-8e18-49ad-95cb-59f0e49004db admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:13.647156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb4b29-8e18-49ad-95cb-59f0e49004db admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:13.652801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e2e48-2350-428a-8160-3c43afd54f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:13.654765 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e2e48-2350-428a-8160-3c43afd54f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:13.655139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e2e48-2350-428a-8160-3c43afd54f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:13.655432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e2e48-2350-428a-8160-3c43afd54f74 admin admin] PATH_INFO: `/v3/projects/fe68eb83f6524b5c8968a109de46f0e2/users/9008839918fd421388dbde1869668557/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:13.685551 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e2e48-2350-428a-8160-3c43afd54f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe68eb83f6524b5c8968a109de46f0e2, user_id=9008839918fd421388dbde1869668557, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:13.688563 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e2e48-2350-428a-8160-3c43afd54f74 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:13.706616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1402/2767] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:37:13 2022] PUT /identity/v3/projects/fe68eb83f6524b5c8968a109de46f0e2/users/9008839918fd421388dbde1869668557/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:13.719768 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f6db7-11dd-45c9-bbe5-5ccb7d737ad3 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:13.720425 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f6db7-11dd-45c9-bbe5-5ccb7d737ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:13.720425 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f6db7-11dd-45c9-bbe5-5ccb7d737ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:13.749732 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e67f6db7-11dd-45c9-bbe5-5ccb7d737ad3 None None] MFA Rules not processed for user `9008839918fd421388dbde1869668557`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:13.751049 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e67f6db7-11dd-45c9-bbe5-5ccb7d737ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:13.836872 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1366/2768] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:13.837149 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e2e48-2350-428a-8160-3c43afd54f74 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:13.903520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e2e48-2350-428a-8160-3c43afd54f74 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:13.911137 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2d5f5-8c34-4eb2-8ae4-75a8f424ab79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:13.912170 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2d5f5-8c34-4eb2-8ae4-75a8f424ab79 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:13.912524 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2d5f5-8c34-4eb2-8ae4-75a8f424ab79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:13.912908 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2d5f5-8c34-4eb2-8ae4-75a8f424ab79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:13.914055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2d5f5-8c34-4eb2-8ae4-75a8f424ab79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:13.917169 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2d5f5-8c34-4eb2-8ae4-75a8f424ab79 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:13.952834 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1403/2769] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:37:13 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:37:13.959305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f6db7-11dd-45c9-bbe5-5ccb7d737ad3 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:13.976254 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f6db7-11dd-45c9-bbe5-5ccb7d737ad3 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:13.995465 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:14.037880 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fedba-420d-4559-84fd-fb5052735488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:14.038562 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fedba-420d-4559-84fd-fb5052735488 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:14.038837 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fedba-420d-4559-84fd-fb5052735488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:14.039108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fedba-420d-4559-84fd-fb5052735488 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:14.039841 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fedba-420d-4559-84fd-fb5052735488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:14.041771 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fedba-420d-4559-84fd-fb5052735488 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:14.066548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1367/2770] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:37:13 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:37:14.070667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2d5f5-8c34-4eb2-8ae4-75a8f424ab79 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:14.081554 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2d5f5-8c34-4eb2-8ae4-75a8f424ab79 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:14.086618 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f64593-0c7a-4fd7-99c9-00182e3386d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:14.087282 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f64593-0c7a-4fd7-99c9-00182e3386d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:14.087561 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f64593-0c7a-4fd7-99c9-00182e3386d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:14.087836 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f64593-0c7a-4fd7-99c9-00182e3386d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:14.088703 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f64593-0c7a-4fd7-99c9-00182e3386d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:14.090526 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f64593-0c7a-4fd7-99c9-00182e3386d4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:14.103178 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1404/2771] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:37:14.107283 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fedba-420d-4559-84fd-fb5052735488 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:14.117739 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fedba-420d-4559-84fd-fb5052735488 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:14.123069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a12779-7857-403d-aaf0-26cdab7f4f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:14.123965 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a12779-7857-403d-aaf0-26cdab7f4f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:14.124224 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a12779-7857-403d-aaf0-26cdab7f4f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:14.124521 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a12779-7857-403d-aaf0-26cdab7f4f1e admin admin] PATH_INFO: `/v3/projects/2a9e96f617e74c3eace8fa05ffe46072/users/476b35afc6c445288e544b432cbb4950/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:14.139528 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a12779-7857-403d-aaf0-26cdab7f4f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9e96f617e74c3eace8fa05ffe46072, user_id=476b35afc6c445288e544b432cbb4950, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:14.142247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a12779-7857-403d-aaf0-26cdab7f4f1e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:14.157846 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1368/2772] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:37:14 2022] PUT /identity/v3/projects/2a9e96f617e74c3eace8fa05ffe46072/users/476b35afc6c445288e544b432cbb4950/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:14.161723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f64593-0c7a-4fd7-99c9-00182e3386d4 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:14.173018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f64593-0c7a-4fd7-99c9-00182e3386d4 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:14.249031 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce2211-b31f-4ca9-b4bc-b58fa7ed60a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:14.249713 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce2211-b31f-4ca9-b4bc-b58fa7ed60a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:14.250030 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce2211-b31f-4ca9-b4bc-b58fa7ed60a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:14.250304 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce2211-b31f-4ca9-b4bc-b58fa7ed60a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:14.251035 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce2211-b31f-4ca9-b4bc-b58fa7ed60a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:14.252643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce2211-b31f-4ca9-b4bc-b58fa7ed60a0 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:14.262599 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1405/2773] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:37:14.267236 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a12779-7857-403d-aaf0-26cdab7f4f1e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:14.277672 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a12779-7857-403d-aaf0-26cdab7f4f1e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:14.282729 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb533d4f-0dfc-4e93-80fe-177945b747ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:14.283607 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb533d4f-0dfc-4e93-80fe-177945b747ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:14.283882 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb533d4f-0dfc-4e93-80fe-177945b747ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:14.284154 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb533d4f-0dfc-4e93-80fe-177945b747ad admin admin] PATH_INFO: `/v3/projects/2a9e96f617e74c3eace8fa05ffe46072/users/476b35afc6c445288e544b432cbb4950/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:14.286267 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb533d4f-0dfc-4e93-80fe-177945b747ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9e96f617e74c3eace8fa05ffe46072, user_id=476b35afc6c445288e544b432cbb4950, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:14.288898 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb533d4f-0dfc-4e93-80fe-177945b747ad admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:14.299361 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1369/2774] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:37:14 2022] PUT /identity/v3/projects/2a9e96f617e74c3eace8fa05ffe46072/users/476b35afc6c445288e544b432cbb4950/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:14.311647 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ec09c-38d4-4dce-ae67-a5689ffc91ac None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:14.312007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ec09c-38d4-4dce-ae67-a5689ffc91ac None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:14.312178 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ec09c-38d4-4dce-ae67-a5689ffc91ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:14.337307 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:14.350558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-2e1ec09c-38d4-4dce-ae67-a5689ffc91ac None None] MFA Rules not processed for user `476b35afc6c445288e544b432cbb4950`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:14.352084 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2e1ec09c-38d4-4dce-ae67-a5689ffc91ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:14.428245 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1406/2775] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:14.440556 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb533d4f-0dfc-4e93-80fe-177945b747ad admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:14.442570 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-bb533d4f-0dfc-4e93-80fe-177945b747ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:14.509112 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb533d4f-0dfc-4e93-80fe-177945b747ad admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:14.513240 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ac98a-daaf-4feb-8c41-50ddd1eafaf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:14.513923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ac98a-daaf-4feb-8c41-50ddd1eafaf8 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:14.514305 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ac98a-daaf-4feb-8c41-50ddd1eafaf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:14.514499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ac98a-daaf-4feb-8c41-50ddd1eafaf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:14.580210 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ac98a-daaf-4feb-8c41-50ddd1eafaf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:14.581758 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ac98a-daaf-4feb-8c41-50ddd1eafaf8 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:14.592921 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1370/2776] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:37:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:37:16.104330 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ec09c-38d4-4dce-ae67-a5689ffc91ac None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:16.115692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ec09c-38d4-4dce-ae67-a5689ffc91ac None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:16.120127 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791168a0-39b1-48c8-9fb0-64b8cb14d67c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:16.120897 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791168a0-39b1-48c8-9fb0-64b8cb14d67c service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:16.121222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791168a0-39b1-48c8-9fb0-64b8cb14d67c service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:16.121587 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791168a0-39b1-48c8-9fb0-64b8cb14d67c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:16.188292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791168a0-39b1-48c8-9fb0-64b8cb14d67c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:16.190581 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791168a0-39b1-48c8-9fb0-64b8cb14d67c service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:16.200036 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1407/2777] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:37:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:37:16.817668 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ac98a-daaf-4feb-8c41-50ddd1eafaf8 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:16.828514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ac98a-daaf-4feb-8c41-50ddd1eafaf8 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:16.835231 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232c9d1-1dd9-4a98-9641-0c3c84bf83b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:16.836417 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232c9d1-1dd9-4a98-9641-0c3c84bf83b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:16.836878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232c9d1-1dd9-4a98-9641-0c3c84bf83b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:16.837276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232c9d1-1dd9-4a98-9641-0c3c84bf83b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:16.848717 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232c9d1-1dd9-4a98-9641-0c3c84bf83b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:16.850227 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232c9d1-1dd9-4a98-9641-0c3c84bf83b9 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:16.860345 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1371/2778] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:37:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:37:20.791809 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791168a0-39b1-48c8-9fb0-64b8cb14d67c service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:20.857007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791168a0-39b1-48c8-9fb0-64b8cb14d67c service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:20.862500 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fe2f3-edc7-448a-895f-f6eb8664afae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:20.863422 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fe2f3-edc7-448a-895f-f6eb8664afae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:20.863700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fe2f3-edc7-448a-895f-f6eb8664afae admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:20.863977 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fe2f3-edc7-448a-895f-f6eb8664afae admin admin] PATH_INFO: `/v3/users/fb8d077038bb4a4e89e748b710c5d00c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:20.865233 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fe2f3-edc7-448a-895f-f6eb8664afae admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb8d077038bb4a4e89e748b710c5d00c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:20.867191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fe2f3-edc7-448a-895f-f6eb8664afae admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:20.908461 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:20.918935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5d9fe2f3-edc7-448a-895f-f6eb8664afae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb8d077038bb4a4e89e748b710c5d00c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:20.919594 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5d9fe2f3-edc7-448a-895f-f6eb8664afae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb8d077038bb4a4e89e748b710c5d00c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:20.927684 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5d9fe2f3-edc7-448a-895f-f6eb8664afae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb8d077038bb4a4e89e748b710c5d00c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:20.936565 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5d9fe2f3-edc7-448a-895f-f6eb8664afae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb8d077038bb4a4e89e748b710c5d00c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:20.937256 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5d9fe2f3-edc7-448a-895f-f6eb8664afae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb8d077038bb4a4e89e748b710c5d00c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:20.955318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1408/2779] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:37:20 2022] DELETE /identity/v3/users/fb8d077038bb4a4e89e748b710c5d00c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:20.960014 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779396bc-5a78-4b67-92a7-e6d801f9ec06 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:20.960509 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779396bc-5a78-4b67-92a7-e6d801f9ec06 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:20.960646 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779396bc-5a78-4b67-92a7-e6d801f9ec06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:20.978213 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-779396bc-5a78-4b67-92a7-e6d801f9ec06 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:20.979443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-779396bc-5a78-4b67-92a7-e6d801f9ec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:20.989089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:21.046706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1372/2780] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:21.056995 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fe2f3-edc7-448a-895f-f6eb8664afae admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:21.058558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5d9fe2f3-edc7-448a-895f-f6eb8664afae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:21.118912 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fe2f3-edc7-448a-895f-f6eb8664afae admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:21.122767 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20b9bb-144b-47f8-9e61-3561d7a7eea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:21.123437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20b9bb-144b-47f8-9e61-3561d7a7eea8 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:21.123719 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20b9bb-144b-47f8-9e61-3561d7a7eea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:21.123993 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20b9bb-144b-47f8-9e61-3561d7a7eea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:21.133918 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20b9bb-144b-47f8-9e61-3561d7a7eea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:21.135369 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20b9bb-144b-47f8-9e61-3561d7a7eea8 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:21.145213 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1409/2781] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:37:21.421589 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779396bc-5a78-4b67-92a7-e6d801f9ec06 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:21.423168 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-779396bc-5a78-4b67-92a7-e6d801f9ec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:21.438078 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779396bc-5a78-4b67-92a7-e6d801f9ec06 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:21.443886 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5aec37-826e-4703-ba65-5406f89965d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:21.444768 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5aec37-826e-4703-ba65-5406f89965d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:21.445041 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5aec37-826e-4703-ba65-5406f89965d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:21.445309 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5aec37-826e-4703-ba65-5406f89965d2 admin admin] PATH_INFO: `/v3/projects/7935e764edb64de9ab418a737f4e2150` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:21.446768 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5aec37-826e-4703-ba65-5406f89965d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7935e764edb64de9ab418a737f4e2150)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:21.448632 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5aec37-826e-4703-ba65-5406f89965d2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:21.497070 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4c5aec37-826e-4703-ba65-5406f89965d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7935e764edb64de9ab418a737f4e2150', 'request_id': 'req-4c5aec37-826e-4703-ba65-5406f89965d2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:21.502881 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4c5aec37-826e-4703-ba65-5406f89965d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7935e764edb64de9ab418a737f4e2150', 'request_id': 'req-4c5aec37-826e-4703-ba65-5406f89965d2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:21.511539 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4c5aec37-826e-4703-ba65-5406f89965d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7935e764edb64de9ab418a737f4e2150', 'request_id': 'req-4c5aec37-826e-4703-ba65-5406f89965d2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:21.523485 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4c5aec37-826e-4703-ba65-5406f89965d2 admin admin] The token cache is being invalidate because project 7935e764edb64de9ab418a737f4e2150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:37:21.523752 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4c5aec37-826e-4703-ba65-5406f89965d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:21.524447 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4c5aec37-826e-4703-ba65-5406f89965d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:21.526097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1373/2782] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:37:21 2022] DELETE /identity/v3/projects/7935e764edb64de9ab418a737f4e2150 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:21.530543 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20b9bb-144b-47f8-9e61-3561d7a7eea8 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:21.541293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20b9bb-144b-47f8-9e61-3561d7a7eea8 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:21.600114 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40a351-3d6c-470a-910f-afbb8aaf95d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:21.600994 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40a351-3d6c-470a-910f-afbb8aaf95d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:21.601267 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40a351-3d6c-470a-910f-afbb8aaf95d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:21.601536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40a351-3d6c-470a-910f-afbb8aaf95d7 admin admin] PATH_INFO: `/v3/users/9008839918fd421388dbde1869668557` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:21.602740 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40a351-3d6c-470a-910f-afbb8aaf95d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9008839918fd421388dbde1869668557)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:21.604762 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40a351-3d6c-470a-910f-afbb8aaf95d7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:21.656288 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8a40a351-3d6c-470a-910f-afbb8aaf95d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9008839918fd421388dbde1869668557'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:21.656930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8a40a351-3d6c-470a-910f-afbb8aaf95d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9008839918fd421388dbde1869668557'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:21.664083 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8a40a351-3d6c-470a-910f-afbb8aaf95d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9008839918fd421388dbde1869668557'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:21.666605 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:21.675627 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8a40a351-3d6c-470a-910f-afbb8aaf95d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9008839918fd421388dbde1869668557'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:21.676357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8a40a351-3d6c-470a-910f-afbb8aaf95d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9008839918fd421388dbde1869668557'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:21.695733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1410/2783] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:37:21 2022] DELETE /identity/v3/users/9008839918fd421388dbde1869668557 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:21.992529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5aec37-826e-4703-ba65-5406f89965d2 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:21.994198 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4c5aec37-826e-4703-ba65-5406f89965d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:22.012467 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5aec37-826e-4703-ba65-5406f89965d2 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:22.080499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c7111-5f47-4d77-9868-6c39a63a807a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:22.081375 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c7111-5f47-4d77-9868-6c39a63a807a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:22.081666 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c7111-5f47-4d77-9868-6c39a63a807a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:22.081953 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c7111-5f47-4d77-9868-6c39a63a807a admin admin] PATH_INFO: `/v3/projects/fe68eb83f6524b5c8968a109de46f0e2` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:22.083155 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c7111-5f47-4d77-9868-6c39a63a807a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe68eb83f6524b5c8968a109de46f0e2)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:22.085055 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c7111-5f47-4d77-9868-6c39a63a807a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:22.127188 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:22.134911 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-807c7111-5f47-4d77-9868-6c39a63a807a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe68eb83f6524b5c8968a109de46f0e2', 'request_id': 'req-807c7111-5f47-4d77-9868-6c39a63a807a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:22.141479 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-807c7111-5f47-4d77-9868-6c39a63a807a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe68eb83f6524b5c8968a109de46f0e2', 'request_id': 'req-807c7111-5f47-4d77-9868-6c39a63a807a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:22.150698 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-807c7111-5f47-4d77-9868-6c39a63a807a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe68eb83f6524b5c8968a109de46f0e2', 'request_id': 'req-807c7111-5f47-4d77-9868-6c39a63a807a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:22.161912 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-807c7111-5f47-4d77-9868-6c39a63a807a admin admin] The token cache is being invalidate because project fe68eb83f6524b5c8968a109de46f0e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:37:22.162205 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-807c7111-5f47-4d77-9868-6c39a63a807a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:22.162830 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-807c7111-5f47-4d77-9868-6c39a63a807a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:22.164418 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1374/2784] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:37:21 2022] DELETE /identity/v3/projects/fe68eb83f6524b5c8968a109de46f0e2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:22.168698 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40a351-3d6c-470a-910f-afbb8aaf95d7 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:22.170176 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8a40a351-3d6c-470a-910f-afbb8aaf95d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:22.184122 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40a351-3d6c-470a-910f-afbb8aaf95d7 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:22.249985 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51237c31-6f53-4f98-9346-430b92512280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:22.250867 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51237c31-6f53-4f98-9346-430b92512280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:22.251170 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51237c31-6f53-4f98-9346-430b92512280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:22.251655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51237c31-6f53-4f98-9346-430b92512280 admin admin] PATH_INFO: `/v3/users/476b35afc6c445288e544b432cbb4950` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:22.252926 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51237c31-6f53-4f98-9346-430b92512280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=476b35afc6c445288e544b432cbb4950)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:22.255255 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51237c31-6f53-4f98-9346-430b92512280 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:22.304724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-51237c31-6f53-4f98-9346-430b92512280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476b35afc6c445288e544b432cbb4950'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:22.305576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-51237c31-6f53-4f98-9346-430b92512280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476b35afc6c445288e544b432cbb4950'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:22.312509 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-51237c31-6f53-4f98-9346-430b92512280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476b35afc6c445288e544b432cbb4950'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:22.321968 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-51237c31-6f53-4f98-9346-430b92512280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476b35afc6c445288e544b432cbb4950'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:22.322666 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-51237c31-6f53-4f98-9346-430b92512280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476b35afc6c445288e544b432cbb4950'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:22.340946 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1411/2785] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:37:22 2022] DELETE /identity/v3/users/476b35afc6c445288e544b432cbb4950 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:22.646719 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c7111-5f47-4d77-9868-6c39a63a807a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:22.648458 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-807c7111-5f47-4d77-9868-6c39a63a807a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:22.662292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c7111-5f47-4d77-9868-6c39a63a807a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:22.727339 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096441c4-e52c-49cb-9e48-6ae2ce4fb7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:22.728132 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096441c4-e52c-49cb-9e48-6ae2ce4fb7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:22.728412 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096441c4-e52c-49cb-9e48-6ae2ce4fb7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:22.728712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096441c4-e52c-49cb-9e48-6ae2ce4fb7e5 admin admin] PATH_INFO: `/v3/projects/2a9e96f617e74c3eace8fa05ffe46072` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:22.729959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096441c4-e52c-49cb-9e48-6ae2ce4fb7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9e96f617e74c3eace8fa05ffe46072)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:22.731878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096441c4-e52c-49cb-9e48-6ae2ce4fb7e5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:22.782986 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-096441c4-e52c-49cb-9e48-6ae2ce4fb7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9e96f617e74c3eace8fa05ffe46072', 'request_id': 'req-096441c4-e52c-49cb-9e48-6ae2ce4fb7e5'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:22.789672 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-096441c4-e52c-49cb-9e48-6ae2ce4fb7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9e96f617e74c3eace8fa05ffe46072', 'request_id': 'req-096441c4-e52c-49cb-9e48-6ae2ce4fb7e5'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:22.801527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-096441c4-e52c-49cb-9e48-6ae2ce4fb7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9e96f617e74c3eace8fa05ffe46072', 'request_id': 'req-096441c4-e52c-49cb-9e48-6ae2ce4fb7e5'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:22.814696 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-096441c4-e52c-49cb-9e48-6ae2ce4fb7e5 admin admin] The token cache is being invalidate because project 2a9e96f617e74c3eace8fa05ffe46072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:37:22.815073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-096441c4-e52c-49cb-9e48-6ae2ce4fb7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:22.816099 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-096441c4-e52c-49cb-9e48-6ae2ce4fb7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:22.817732 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1375/2786] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:37:22 2022] DELETE /identity/v3/projects/2a9e96f617e74c3eace8fa05ffe46072 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:32.337437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:DELETE=13,keystone:SELECT=61,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:32.811527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=61,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:34.279973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51237c31-6f53-4f98-9346-430b92512280 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:34.281646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-51237c31-6f53-4f98-9346-430b92512280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:34.295825 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51237c31-6f53-4f98-9346-430b92512280 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:34.359469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd56ae-8a3d-4fde-974f-abcb029a859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:34.360354 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd56ae-8a3d-4fde-974f-abcb029a859a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:34.360633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd56ae-8a3d-4fde-974f-abcb029a859a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:34.360904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd56ae-8a3d-4fde-974f-abcb029a859a admin admin] PATH_INFO: `/v3/users/ff4e696635684412a8dc16b26280a7b8` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:34.362155 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd56ae-8a3d-4fde-974f-abcb029a859a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4e696635684412a8dc16b26280a7b8)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:34.364101 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd56ae-8a3d-4fde-974f-abcb029a859a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:34.418050 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3cbd56ae-8a3d-4fde-974f-abcb029a859a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4e696635684412a8dc16b26280a7b8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:34.418683 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3cbd56ae-8a3d-4fde-974f-abcb029a859a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4e696635684412a8dc16b26280a7b8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:34.426233 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3cbd56ae-8a3d-4fde-974f-abcb029a859a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4e696635684412a8dc16b26280a7b8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:34.435260 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3cbd56ae-8a3d-4fde-974f-abcb029a859a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4e696635684412a8dc16b26280a7b8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:34.435885 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3cbd56ae-8a3d-4fde-974f-abcb029a859a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4e696635684412a8dc16b26280a7b8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:34.453292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1412/2787] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:37:34 2022] DELETE /identity/v3/users/ff4e696635684412a8dc16b26280a7b8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:34.457944 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6e894-5808-49c6-92cf-58e33dde0bb2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:34.458480 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6e894-5808-49c6-92cf-58e33dde0bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:34.458480 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6e894-5808-49c6-92cf-58e33dde0bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:34.476196 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-cae6e894-5808-49c6-92cf-58e33dde0bb2 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:34.477373 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-cae6e894-5808-49c6-92cf-58e33dde0bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:34.539764 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1376/2788] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:34.549771 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd56ae-8a3d-4fde-974f-abcb029a859a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:34.551928 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3cbd56ae-8a3d-4fde-974f-abcb029a859a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:34.624029 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd56ae-8a3d-4fde-974f-abcb029a859a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:34.628208 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306d306-2cca-40e7-a131-27d81a3e2928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:34.628859 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306d306-2cca-40e7-a131-27d81a3e2928 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:34.629148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306d306-2cca-40e7-a131-27d81a3e2928 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:34.629425 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306d306-2cca-40e7-a131-27d81a3e2928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:34.640530 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306d306-2cca-40e7-a131-27d81a3e2928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:34.642398 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306d306-2cca-40e7-a131-27d81a3e2928 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:34.653351 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1413/2789] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:37:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:37:34.944885 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6e894-5808-49c6-92cf-58e33dde0bb2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:34.945832 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-cae6e894-5808-49c6-92cf-58e33dde0bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:34.959936 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6e894-5808-49c6-92cf-58e33dde0bb2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:34.966288 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e6db9-e978-4a3a-8482-09ce4738bfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:34.967153 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e6db9-e978-4a3a-8482-09ce4738bfcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:34.967528 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e6db9-e978-4a3a-8482-09ce4738bfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:34.967687 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e6db9-e978-4a3a-8482-09ce4738bfcc admin admin] PATH_INFO: `/v3/projects/9028b1da36234e848abd092572902c2f` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:34.969660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e6db9-e978-4a3a-8482-09ce4738bfcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9028b1da36234e848abd092572902c2f)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:34.971082 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e6db9-e978-4a3a-8482-09ce4738bfcc admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:35.021647 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7b1e6db9-e978-4a3a-8482-09ce4738bfcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9028b1da36234e848abd092572902c2f', 'request_id': 'req-7b1e6db9-e978-4a3a-8482-09ce4738bfcc'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:35.027990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7b1e6db9-e978-4a3a-8482-09ce4738bfcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9028b1da36234e848abd092572902c2f', 'request_id': 'req-7b1e6db9-e978-4a3a-8482-09ce4738bfcc'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:35.037193 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7b1e6db9-e978-4a3a-8482-09ce4738bfcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9028b1da36234e848abd092572902c2f', 'request_id': 'req-7b1e6db9-e978-4a3a-8482-09ce4738bfcc'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:35.048728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7b1e6db9-e978-4a3a-8482-09ce4738bfcc admin admin] The token cache is being invalidate because project 9028b1da36234e848abd092572902c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:37:35.049010 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7b1e6db9-e978-4a3a-8482-09ce4738bfcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:35.049646 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7b1e6db9-e978-4a3a-8482-09ce4738bfcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:37:35.051618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1377/2790] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:37:34 2022] DELETE /identity/v3/projects/9028b1da36234e848abd092572902c2f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:35.056831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863d289-4a61-42db-a35c-9bee5dc244b6 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:35.057126 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863d289-4a61-42db-a35c-9bee5dc244b6 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:35.057365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863d289-4a61-42db-a35c-9bee5dc244b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:35.075595 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-8863d289-4a61-42db-a35c-9bee5dc244b6 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:35.076791 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8863d289-4a61-42db-a35c-9bee5dc244b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:35.094095 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:35.138007 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1414/2791] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:35.145924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2d478-1b33-480a-b81e-3a48074b6666 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:35.146215 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2d478-1b33-480a-b81e-3a48074b6666 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:35.146490 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2d478-1b33-480a-b81e-3a48074b6666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:35.165927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2ff2d478-1b33-480a-b81e-3a48074b6666 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:35.167123 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2ff2d478-1b33-480a-b81e-3a48074b6666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:35.176737 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1378/2792] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:35.180954 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863d289-4a61-42db-a35c-9bee5dc244b6 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:35.190821 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863d289-4a61-42db-a35c-9bee5dc244b6 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:35.196348 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6993df-5b6b-44b4-b629-d01ddc7a5135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:35.197002 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6993df-5b6b-44b4-b629-d01ddc7a5135 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:35.197283 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6993df-5b6b-44b4-b629-d01ddc7a5135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:35.197558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6993df-5b6b-44b4-b629-d01ddc7a5135 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:35.198319 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6993df-5b6b-44b4-b629-d01ddc7a5135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:37:35.198632 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6993df-5b6b-44b4-b629-d01ddc7a5135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:35.200254 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6993df-5b6b-44b4-b629-d01ddc7a5135 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:35.212376 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1415/2793] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:37:35.216827 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2d478-1b33-480a-b81e-3a48074b6666 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:35.226821 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2d478-1b33-480a-b81e-3a48074b6666 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:35.232221 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5137f-bb5c-4d28-8c23-760ef3dd5014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:35.232868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5137f-bb5c-4d28-8c23-760ef3dd5014 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:35.233164 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5137f-bb5c-4d28-8c23-760ef3dd5014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:35.233428 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5137f-bb5c-4d28-8c23-760ef3dd5014 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:35.234158 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5137f-bb5c-4d28-8c23-760ef3dd5014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:35.236073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5137f-bb5c-4d28-8c23-760ef3dd5014 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:35.266923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1379/2794] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:37:35 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:37:35.271873 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6993df-5b6b-44b4-b629-d01ddc7a5135 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:35.282505 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6993df-5b6b-44b4-b629-d01ddc7a5135 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:35.343519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36e21d-a161-4d21-9cd7-5e3185f4fdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:35.344106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36e21d-a161-4d21-9cd7-5e3185f4fdd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:35.344383 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36e21d-a161-4d21-9cd7-5e3185f4fdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:35.344649 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36e21d-a161-4d21-9cd7-5e3185f4fdd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:35.345345 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36e21d-a161-4d21-9cd7-5e3185f4fdd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:35.347323 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36e21d-a161-4d21-9cd7-5e3185f4fdd2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:35.371139 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1416/2795] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:37:35 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:37:35.375331 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5137f-bb5c-4d28-8c23-760ef3dd5014 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:35.385991 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5137f-bb5c-4d28-8c23-760ef3dd5014 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:35.390803 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50348b94-c881-4fd1-a9d2-ab078826ad1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:35.391464 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50348b94-c881-4fd1-a9d2-ab078826ad1c admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:35.391742 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50348b94-c881-4fd1-a9d2-ab078826ad1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:35.392013 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50348b94-c881-4fd1-a9d2-ab078826ad1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:35.392802 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50348b94-c881-4fd1-a9d2-ab078826ad1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:35.394442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50348b94-c881-4fd1-a9d2-ab078826ad1c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:35.405454 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1380/2796] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:37:35.410952 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36e21d-a161-4d21-9cd7-5e3185f4fdd2 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:35.422416 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36e21d-a161-4d21-9cd7-5e3185f4fdd2 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:35.428772 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65df0e0-9c68-4f57-a0c9-2915e64ec39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:35.429437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65df0e0-9c68-4f57-a0c9-2915e64ec39b admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:35.429718 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65df0e0-9c68-4f57-a0c9-2915e64ec39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:35.430024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65df0e0-9c68-4f57-a0c9-2915e64ec39b admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:35.430766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65df0e0-9c68-4f57-a0c9-2915e64ec39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:35.432354 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65df0e0-9c68-4f57-a0c9-2915e64ec39b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:35.447130 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1417/2797] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:37:35.451541 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50348b94-c881-4fd1-a9d2-ab078826ad1c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:35.462176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50348b94-c881-4fd1-a9d2-ab078826ad1c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:35.467362 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10aab64-2875-4450-a60b-c295833e6862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:35.468246 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10aab64-2875-4450-a60b-c295833e6862 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:35.468522 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10aab64-2875-4450-a60b-c295833e6862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:35.468801 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10aab64-2875-4450-a60b-c295833e6862 admin admin] PATH_INFO: `/v3/projects/7d83706590a34c76b0315e6a5e0ee931/users/5f92f1059a8b481aa5d44ebac5a7819d/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:35.486789 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10aab64-2875-4450-a60b-c295833e6862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d83706590a34c76b0315e6a5e0ee931, user_id=5f92f1059a8b481aa5d44ebac5a7819d, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:35.489470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10aab64-2875-4450-a60b-c295833e6862 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:35.505564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1381/2798] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:37:35 2022] PUT /identity/v3/projects/7d83706590a34c76b0315e6a5e0ee931/users/5f92f1059a8b481aa5d44ebac5a7819d/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:35.511854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d72a20-bfbb-4a12-ad0c-cef55d1f925d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:35.512221 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d72a20-bfbb-4a12-ad0c-cef55d1f925d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:35.512617 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d72a20-bfbb-4a12-ad0c-cef55d1f925d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:35.536148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-37d72a20-bfbb-4a12-ad0c-cef55d1f925d None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:35.537983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-37d72a20-bfbb-4a12-ad0c-cef55d1f925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:35.598043 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1418/2799] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:35.609699 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10aab64-2875-4450-a60b-c295833e6862 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:35.612447 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b10aab64-2875-4450-a60b-c295833e6862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:35.639544 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:35.681372 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10aab64-2875-4450-a60b-c295833e6862 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:35.685964 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa114d4-eb0a-4459-9a89-aefbf3bf21dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:35.686620 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa114d4-eb0a-4459-9a89-aefbf3bf21dc service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:35.686900 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa114d4-eb0a-4459-9a89-aefbf3bf21dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:35.687171 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa114d4-eb0a-4459-9a89-aefbf3bf21dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:35.697834 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa114d4-eb0a-4459-9a89-aefbf3bf21dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:35.699281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa114d4-eb0a-4459-9a89-aefbf3bf21dc service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:35.709644 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1382/2800] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:37:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:37:39.971759 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a994f-cc45-4336-afa6-465a8d506cf3 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:39.972248 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a994f-cc45-4336-afa6-465a8d506cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:39.972373 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a994f-cc45-4336-afa6-465a8d506cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:40.002724 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-556a994f-cc45-4336-afa6-465a8d506cf3 None None] MFA Rules not processed for user `5f92f1059a8b481aa5d44ebac5a7819d`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:40.003958 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-556a994f-cc45-4336-afa6-465a8d506cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:40.024913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:40.079657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1419/2801] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:40.084167 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa114d4-eb0a-4459-9a89-aefbf3bf21dc service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:40.094536 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa114d4-eb0a-4459-9a89-aefbf3bf21dc service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:40.100134 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b31e81-96e4-49e1-abb0-90409f1e9266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:40.100892 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b31e81-96e4-49e1-abb0-90409f1e9266 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:40.101501 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b31e81-96e4-49e1-abb0-90409f1e9266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:40.102013 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b31e81-96e4-49e1-abb0-90409f1e9266 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:40.102833 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b31e81-96e4-49e1-abb0-90409f1e9266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:40.104800 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b31e81-96e4-49e1-abb0-90409f1e9266 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:40.134927 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1383/2802] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:37:40 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:37:40.139013 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a994f-cc45-4336-afa6-465a8d506cf3 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:40.151834 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a994f-cc45-4336-afa6-465a8d506cf3 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:40.211984 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f617dfa-163e-4d65-af29-dcf538180a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:40.212582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f617dfa-163e-4d65-af29-dcf538180a11 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:40.212862 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f617dfa-163e-4d65-af29-dcf538180a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:40.213143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f617dfa-163e-4d65-af29-dcf538180a11 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:40.213876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f617dfa-163e-4d65-af29-dcf538180a11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:40.216075 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f617dfa-163e-4d65-af29-dcf538180a11 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:40.239472 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1420/2803] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:37:40 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:37:40.243638 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b31e81-96e4-49e1-abb0-90409f1e9266 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:40.254507 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b31e81-96e4-49e1-abb0-90409f1e9266 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:40.260162 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14330744-ec9b-4f54-b288-98258b45cbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:40.260855 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14330744-ec9b-4f54-b288-98258b45cbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:40.261138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14330744-ec9b-4f54-b288-98258b45cbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:40.261414 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14330744-ec9b-4f54-b288-98258b45cbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:40.262185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14330744-ec9b-4f54-b288-98258b45cbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:40.263806 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14330744-ec9b-4f54-b288-98258b45cbb7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:40.275335 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1384/2804] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:37:40.279707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f617dfa-163e-4d65-af29-dcf538180a11 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:40.290923 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f617dfa-163e-4d65-af29-dcf538180a11 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:40.295764 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3348fa5-4cf6-431b-a080-9916cca4ef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:40.296680 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3348fa5-4cf6-431b-a080-9916cca4ef1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:40.296965 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3348fa5-4cf6-431b-a080-9916cca4ef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:40.297241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3348fa5-4cf6-431b-a080-9916cca4ef1d admin admin] PATH_INFO: `/v3/projects/3afbc5f8793f4425b6de15427e7b7db4/users/8b3d58d84a5946d59f3fce12ef720109/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:40.314643 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3348fa5-4cf6-431b-a080-9916cca4ef1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3afbc5f8793f4425b6de15427e7b7db4, user_id=8b3d58d84a5946d59f3fce12ef720109, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:40.317391 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3348fa5-4cf6-431b-a080-9916cca4ef1d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:40.333230 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1421/2805] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:37:40 2022] PUT /identity/v3/projects/3afbc5f8793f4425b6de15427e7b7db4/users/8b3d58d84a5946d59f3fce12ef720109/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:40.338328 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14330744-ec9b-4f54-b288-98258b45cbb7 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:40.348886 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14330744-ec9b-4f54-b288-98258b45cbb7 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:40.414693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85025a01-060f-46a6-8824-14704f9bcd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:40.415414 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85025a01-060f-46a6-8824-14704f9bcd7e admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:40.415698 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85025a01-060f-46a6-8824-14704f9bcd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:40.416013 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85025a01-060f-46a6-8824-14704f9bcd7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:40.417058 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85025a01-060f-46a6-8824-14704f9bcd7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:40.418715 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85025a01-060f-46a6-8824-14704f9bcd7e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:40.433872 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1385/2806] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:37:40.439406 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3348fa5-4cf6-431b-a080-9916cca4ef1d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:40.456871 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3348fa5-4cf6-431b-a080-9916cca4ef1d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:40.463975 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c87f6-8af1-4970-a5ec-8b0b311144de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:40.464776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c87f6-8af1-4970-a5ec-8b0b311144de admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:40.465055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c87f6-8af1-4970-a5ec-8b0b311144de admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:40.465333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c87f6-8af1-4970-a5ec-8b0b311144de admin admin] PATH_INFO: `/v3/projects/3afbc5f8793f4425b6de15427e7b7db4/users/8b3d58d84a5946d59f3fce12ef720109/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:40.467346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c87f6-8af1-4970-a5ec-8b0b311144de admin admin] RBAC: Authorizing `identity:create_grant(project_id=3afbc5f8793f4425b6de15427e7b7db4, user_id=8b3d58d84a5946d59f3fce12ef720109, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:40.470044 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c87f6-8af1-4970-a5ec-8b0b311144de admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:40.481025 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1422/2807] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:37:40 2022] PUT /identity/v3/projects/3afbc5f8793f4425b6de15427e7b7db4/users/8b3d58d84a5946d59f3fce12ef720109/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:37:44.772626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ef17-9e62-42f0-8305-4d509d004aff None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:44.773839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ef17-9e62-42f0-8305-4d509d004aff None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:44.773839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ef17-9e62-42f0-8305-4d509d004aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:44.810183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a811ef17-9e62-42f0-8305-4d509d004aff None None] MFA Rules not processed for user `8b3d58d84a5946d59f3fce12ef720109`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:44.811708 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a811ef17-9e62-42f0-8305-4d509d004aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:44.899770 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1386/2808] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:44.917224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c87f6-8af1-4970-a5ec-8b0b311144de admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:37:44.921094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-588c87f6-8af1-4970-a5ec-8b0b311144de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:45.021948 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c87f6-8af1-4970-a5ec-8b0b311144de admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:37:45.030079 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291269e-9ce4-4c39-a326-58671df8009e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:37:45.030505 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291269e-9ce4-4c39-a326-58671df8009e service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:45.030881 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291269e-9ce4-4c39-a326-58671df8009e service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:45.031252 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291269e-9ce4-4c39-a326-58671df8009e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:45.041355 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:45.099381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291269e-9ce4-4c39-a326-58671df8009e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:37:45.101763 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291269e-9ce4-4c39-a326-58671df8009e service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:37:45.111106 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1423/2809] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:37:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:37:46.254608 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a20d32-135e-4d7d-a4eb-7e18525b982d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:37:46.255204 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a20d32-135e-4d7d-a4eb-7e18525b982d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:37:46.255204 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a20d32-135e-4d7d-a4eb-7e18525b982d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:37:46.273899 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f5a20d32-135e-4d7d-a4eb-7e18525b982d None None] MFA Rules not processed for user `5f92f1059a8b481aa5d44ebac5a7819d`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:37:46.275125 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f5a20d32-135e-4d7d-a4eb-7e18525b982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:37:46.282354 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1387/2810] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:37:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:37:55.106837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=24 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:37:56.267767 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:38:18.093404 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291269e-9ce4-4c39-a326-58671df8009e service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:38:18.154252 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291269e-9ce4-4c39-a326-58671df8009e service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:38:18.158292 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc89140-2a82-4635-92b3-e693104a810d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:38:18.159222 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc89140-2a82-4635-92b3-e693104a810d service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:38:18.159486 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc89140-2a82-4635-92b3-e693104a810d service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:38:18.159754 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc89140-2a82-4635-92b3-e693104a810d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:38:18.170436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc89140-2a82-4635-92b3-e693104a810d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:38:18.171868 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc89140-2a82-4635-92b3-e693104a810d service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:38:18.182335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1424/2811] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:38:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:38:28.178028 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=26 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:38:46.791021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a20d32-135e-4d7d-a4eb-7e18525b982d None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:38:46.792730 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f5a20d32-135e-4d7d-a4eb-7e18525b982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:38:46.831190 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a20d32-135e-4d7d-a4eb-7e18525b982d None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:38:46.835691 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fbd65-d6c4-4042-94eb-804232d73a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:38:46.836346 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fbd65-d6c4-4042-94eb-804232d73a4d service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:38:46.836629 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fbd65-d6c4-4042-94eb-804232d73a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:38:46.836909 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fbd65-d6c4-4042-94eb-804232d73a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:38:46.839180 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c99fbd65-d6c4-4042-94eb-804232d73a4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:38:46.849414 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fbd65-d6c4-4042-94eb-804232d73a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:38:46.850899 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fbd65-d6c4-4042-94eb-804232d73a4d service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:38:46.859474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1388/2812] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:38:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:38:56.855710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=15 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:38:59.209890 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a39488-8b4d-4185-b02d-0d45d5c70c62 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:38:59.210468 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a39488-8b4d-4185-b02d-0d45d5c70c62 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:38:59.210468 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a39488-8b4d-4185-b02d-0d45d5c70c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:38:59.229002 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d2a39488-8b4d-4185-b02d-0d45d5c70c62 None None] MFA Rules not processed for user `d160ccef27104953beadc68e74b2d49e`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:38:59.230389 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d2a39488-8b4d-4185-b02d-0d45d5c70c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:38:59.286733 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1425/2813] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:38:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:38:59.616615 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fbd65-d6c4-4042-94eb-804232d73a4d service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:38:59.629606 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fbd65-d6c4-4042-94eb-804232d73a4d service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:38:59.634083 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d617577-f4f3-464e-b373-68156abc58e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:38:59.634732 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d617577-f4f3-464e-b373-68156abc58e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:38:59.635026 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d617577-f4f3-464e-b373-68156abc58e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:38:59.635291 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d617577-f4f3-464e-b373-68156abc58e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:38:59.637128 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4d617577-f4f3-464e-b373-68156abc58e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:38:59.646993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d617577-f4f3-464e-b373-68156abc58e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:38:59.648432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d617577-f4f3-464e-b373-68156abc58e0 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:38:59.656816 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1389/2814] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:38:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:39:09.278793 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=25 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:39:09.652877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:18.577018 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a39488-8b4d-4185-b02d-0d45d5c70c62 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:18.578608 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d2a39488-8b4d-4185-b02d-0d45d5c70c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:18.651457 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a39488-8b4d-4185-b02d-0d45d5c70c62 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:18.656761 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa2f46-6043-433b-a7a7-a654c1c25556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:18.657717 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa2f46-6043-433b-a7a7-a654c1c25556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:18.658295 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa2f46-6043-433b-a7a7-a654c1c25556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:18.658682 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa2f46-6043-433b-a7a7-a654c1c25556 admin admin] PATH_INFO: `/v3/users/d160ccef27104953beadc68e74b2d49e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:18.660042 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa2f46-6043-433b-a7a7-a654c1c25556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d160ccef27104953beadc68e74b2d49e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:18.662938 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa2f46-6043-433b-a7a7-a654c1c25556 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:18.743096 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-28aa2f46-6043-433b-a7a7-a654c1c25556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd160ccef27104953beadc68e74b2d49e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:18.743851 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-28aa2f46-6043-433b-a7a7-a654c1c25556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd160ccef27104953beadc68e74b2d49e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:18.754484 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-28aa2f46-6043-433b-a7a7-a654c1c25556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd160ccef27104953beadc68e74b2d49e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:18.765618 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-28aa2f46-6043-433b-a7a7-a654c1c25556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd160ccef27104953beadc68e74b2d49e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:18.766435 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-28aa2f46-6043-433b-a7a7-a654c1c25556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd160ccef27104953beadc68e74b2d49e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:18.791104 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1426/2815] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:40:18 2022] DELETE /identity/v3/users/d160ccef27104953beadc68e74b2d49e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:40:18.994744 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d617577-f4f3-464e-b373-68156abc58e0 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:19.008229 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d617577-f4f3-464e-b373-68156abc58e0 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:19.081580 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4789284-f06b-46cb-a24c-8f9c5cf244f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:19.082635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4789284-f06b-46cb-a24c-8f9c5cf244f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:19.083040 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4789284-f06b-46cb-a24c-8f9c5cf244f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:19.083508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4789284-f06b-46cb-a24c-8f9c5cf244f4 admin admin] PATH_INFO: `/v3/projects/119263b9683e44eba604fc24eca20061` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:19.084954 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4789284-f06b-46cb-a24c-8f9c5cf244f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=119263b9683e44eba604fc24eca20061)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:19.087099 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4789284-f06b-46cb-a24c-8f9c5cf244f4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:19.139277 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c4789284-f06b-46cb-a24c-8f9c5cf244f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119263b9683e44eba604fc24eca20061', 'request_id': 'req-c4789284-f06b-46cb-a24c-8f9c5cf244f4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:19.145750 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c4789284-f06b-46cb-a24c-8f9c5cf244f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119263b9683e44eba604fc24eca20061', 'request_id': 'req-c4789284-f06b-46cb-a24c-8f9c5cf244f4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:19.155563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c4789284-f06b-46cb-a24c-8f9c5cf244f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119263b9683e44eba604fc24eca20061', 'request_id': 'req-c4789284-f06b-46cb-a24c-8f9c5cf244f4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:19.170504 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c4789284-f06b-46cb-a24c-8f9c5cf244f4 admin admin] The token cache is being invalidate because project 119263b9683e44eba604fc24eca20061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:40:19.170804 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c4789284-f06b-46cb-a24c-8f9c5cf244f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:19.171694 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c4789284-f06b-46cb-a24c-8f9c5cf244f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:19.174689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1390/2816] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:40:18 2022] DELETE /identity/v3/projects/119263b9683e44eba604fc24eca20061 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:40:19.181414 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cffd9b-0e26-4066-baf8-5d0882c5d47a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:19.181683 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cffd9b-0e26-4066-baf8-5d0882c5d47a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:19.182038 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cffd9b-0e26-4066-baf8-5d0882c5d47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:19.201002 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-79cffd9b-0e26-4066-baf8-5d0882c5d47a None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:40:19.202281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-79cffd9b-0e26-4066-baf8-5d0882c5d47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:19.273607 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1427/2817] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:40:19.281925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80087daa-d882-4408-9aff-2c40ee1998a0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:19.282246 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80087daa-d882-4408-9aff-2c40ee1998a0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:19.282593 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80087daa-d882-4408-9aff-2c40ee1998a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:19.301786 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-80087daa-d882-4408-9aff-2c40ee1998a0 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:40:19.303101 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-80087daa-d882-4408-9aff-2c40ee1998a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:19.312528 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1391/2818] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:40:19.317060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cffd9b-0e26-4066-baf8-5d0882c5d47a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:19.328596 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cffd9b-0e26-4066-baf8-5d0882c5d47a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:19.335165 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a064b-96eb-40cd-ad05-2eaea7cee0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:19.335849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a064b-96eb-40cd-ad05-2eaea7cee0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:19.336128 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a064b-96eb-40cd-ad05-2eaea7cee0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:19.336401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a064b-96eb-40cd-ad05-2eaea7cee0ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:19.337141 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a064b-96eb-40cd-ad05-2eaea7cee0ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:40:19.337450 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a064b-96eb-40cd-ad05-2eaea7cee0ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:19.339134 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a064b-96eb-40cd-ad05-2eaea7cee0ed admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:19.352015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1428/2819] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:40:19.359192 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80087daa-d882-4408-9aff-2c40ee1998a0 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:19.369130 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80087daa-d882-4408-9aff-2c40ee1998a0 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:19.375002 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815e589-f930-42bf-a437-ca6357292dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:19.375671 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815e589-f930-42bf-a437-ca6357292dbb admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:19.375953 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815e589-f930-42bf-a437-ca6357292dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:19.376230 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815e589-f930-42bf-a437-ca6357292dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:19.376932 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815e589-f930-42bf-a437-ca6357292dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:19.378919 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815e589-f930-42bf-a437-ca6357292dbb admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:19.409785 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1392/2820] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:40:19 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:40:19.414344 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a064b-96eb-40cd-ad05-2eaea7cee0ed admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:19.425464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a064b-96eb-40cd-ad05-2eaea7cee0ed admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:19.429357 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:19.491414 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1562b3-38f6-42ec-b68d-468304555275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:19.492100 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1562b3-38f6-42ec-b68d-468304555275 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:19.492401 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1562b3-38f6-42ec-b68d-468304555275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:19.492667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1562b3-38f6-42ec-b68d-468304555275 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:19.493371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1562b3-38f6-42ec-b68d-468304555275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:19.495355 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1562b3-38f6-42ec-b68d-468304555275 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:19.531289 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1429/2821] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:40:19 2022] POST /identity/v3/users => generated 296 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:40:19.537424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815e589-f930-42bf-a437-ca6357292dbb admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:19.552951 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815e589-f930-42bf-a437-ca6357292dbb admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:19.558677 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e05ba-8254-41c2-92fb-877e081b4bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:19.559554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e05ba-8254-41c2-92fb-877e081b4bdf admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:19.559908 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e05ba-8254-41c2-92fb-877e081b4bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:19.560260 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e05ba-8254-41c2-92fb-877e081b4bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:19.561264 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e05ba-8254-41c2-92fb-877e081b4bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:19.563245 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e05ba-8254-41c2-92fb-877e081b4bdf admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:19.577336 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1393/2822] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:40:19.581507 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1562b3-38f6-42ec-b68d-468304555275 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:19.593247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1562b3-38f6-42ec-b68d-468304555275 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:19.601990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add26ad-b906-4bae-ba31-1b567eec9856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:19.602692 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add26ad-b906-4bae-ba31-1b567eec9856 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:19.602979 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add26ad-b906-4bae-ba31-1b567eec9856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:19.603252 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add26ad-b906-4bae-ba31-1b567eec9856 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:19.604006 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add26ad-b906-4bae-ba31-1b567eec9856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:19.605983 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add26ad-b906-4bae-ba31-1b567eec9856 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:19.622011 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1430/2823] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:40:19.626234 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e05ba-8254-41c2-92fb-877e081b4bdf admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:19.636852 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e05ba-8254-41c2-92fb-877e081b4bdf admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:19.644532 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2376df-1e0a-4617-a779-01b847354c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:19.645438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2376df-1e0a-4617-a779-01b847354c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:19.645713 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2376df-1e0a-4617-a779-01b847354c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:19.646029 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2376df-1e0a-4617-a779-01b847354c5e admin admin] PATH_INFO: `/v3/projects/26042160b4844c85a59edb0657c0c692/users/20101540b4864ffdac872d492889c60c/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:19.665911 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2376df-1e0a-4617-a779-01b847354c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26042160b4844c85a59edb0657c0c692, user_id=20101540b4864ffdac872d492889c60c, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:19.669195 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2376df-1e0a-4617-a779-01b847354c5e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:19.685897 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1394/2824] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:40:19 2022] PUT /identity/v3/projects/26042160b4844c85a59edb0657c0c692/users/20101540b4864ffdac872d492889c60c/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:40:19.751258 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ff03d-9a34-4edf-806a-05ade3286c0f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:19.751549 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ff03d-9a34-4edf-806a-05ade3286c0f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:19.751819 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ff03d-9a34-4edf-806a-05ade3286c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:19.781321 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-938ff03d-9a34-4edf-806a-05ade3286c0f None None] MFA Rules not processed for user `20101540b4864ffdac872d492889c60c`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:40:19.782596 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-938ff03d-9a34-4edf-806a-05ade3286c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:19.855902 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1431/2825] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:40:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:40:19.860516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2376df-1e0a-4617-a779-01b847354c5e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:19.900442 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:19.946327 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2376df-1e0a-4617-a779-01b847354c5e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:19.951739 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b840bb2-b527-40e0-8cb3-36abd263c323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:19.952430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b840bb2-b527-40e0-8cb3-36abd263c323 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:19.952714 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b840bb2-b527-40e0-8cb3-36abd263c323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:19.952993 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b840bb2-b527-40e0-8cb3-36abd263c323 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:19.953699 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b840bb2-b527-40e0-8cb3-36abd263c323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:19.955903 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b840bb2-b527-40e0-8cb3-36abd263c323 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:19.992785 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1395/2826] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:40:19 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:40:19.995806 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ff03d-9a34-4edf-806a-05ade3286c0f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:20.007635 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ff03d-9a34-4edf-806a-05ade3286c0f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:20.078209 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26bdfd-4cb0-4686-ab52-239ebbaafe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:20.078994 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26bdfd-4cb0-4686-ab52-239ebbaafe09 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:20.079319 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26bdfd-4cb0-4686-ab52-239ebbaafe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:20.079631 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26bdfd-4cb0-4686-ab52-239ebbaafe09 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:20.080472 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26bdfd-4cb0-4686-ab52-239ebbaafe09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:20.082759 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26bdfd-4cb0-4686-ab52-239ebbaafe09 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:20.107051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1432/2827] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:40:19 2022] POST /identity/v3/users => generated 302 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:40:20.111797 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b840bb2-b527-40e0-8cb3-36abd263c323 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:20.123857 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b840bb2-b527-40e0-8cb3-36abd263c323 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:20.129448 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e3282-adfa-4861-b681-34d30af2cc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:20.130175 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e3282-adfa-4861-b681-34d30af2cc23 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:20.130455 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e3282-adfa-4861-b681-34d30af2cc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:20.130728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e3282-adfa-4861-b681-34d30af2cc23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:20.131476 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e3282-adfa-4861-b681-34d30af2cc23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:20.133220 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e3282-adfa-4861-b681-34d30af2cc23 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:20.147355 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1396/2828] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:40:20.152734 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26bdfd-4cb0-4686-ab52-239ebbaafe09 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:20.159579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:20.163727 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26bdfd-4cb0-4686-ab52-239ebbaafe09 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:20.170997 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41dfc3-76ea-4e86-8a76-77a6eaa53fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:20.172235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41dfc3-76ea-4e86-8a76-77a6eaa53fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:20.172531 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41dfc3-76ea-4e86-8a76-77a6eaa53fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:20.172796 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41dfc3-76ea-4e86-8a76-77a6eaa53fb3 admin admin] PATH_INFO: `/v3/projects/cdfa749a728744178ea3437f286b4ba5/users/8dc1099c97904028aba423320e48f8f9/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:20.189776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41dfc3-76ea-4e86-8a76-77a6eaa53fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfa749a728744178ea3437f286b4ba5, user_id=8dc1099c97904028aba423320e48f8f9, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:20.192577 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41dfc3-76ea-4e86-8a76-77a6eaa53fb3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:20.210469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1433/2829] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:40:20 2022] PUT /identity/v3/projects/cdfa749a728744178ea3437f286b4ba5/users/8dc1099c97904028aba423320e48f8f9/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:40:20.215801 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e3282-adfa-4861-b681-34d30af2cc23 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:20.226728 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e3282-adfa-4861-b681-34d30af2cc23 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:20.291169 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67a571-62d6-490a-8d2e-eae29a203858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:20.291958 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67a571-62d6-490a-8d2e-eae29a203858 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:20.292926 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67a571-62d6-490a-8d2e-eae29a203858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:20.293273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67a571-62d6-490a-8d2e-eae29a203858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:20.294093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67a571-62d6-490a-8d2e-eae29a203858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:20.295855 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67a571-62d6-490a-8d2e-eae29a203858 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:20.307482 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1397/2830] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:40:20.312485 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41dfc3-76ea-4e86-8a76-77a6eaa53fb3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:20.327746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41dfc3-76ea-4e86-8a76-77a6eaa53fb3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:20.334784 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95065fb6-5f69-46e1-864d-309606bd3d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:20.336365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95065fb6-5f69-46e1-864d-309606bd3d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:20.336658 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95065fb6-5f69-46e1-864d-309606bd3d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:20.336937 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95065fb6-5f69-46e1-864d-309606bd3d23 admin admin] PATH_INFO: `/v3/projects/cdfa749a728744178ea3437f286b4ba5/users/8dc1099c97904028aba423320e48f8f9/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:20.339049 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95065fb6-5f69-46e1-864d-309606bd3d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfa749a728744178ea3437f286b4ba5, user_id=8dc1099c97904028aba423320e48f8f9, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:20.341839 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95065fb6-5f69-46e1-864d-309606bd3d23 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:20.355548 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1434/2831] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:40:20 2022] PUT /identity/v3/projects/cdfa749a728744178ea3437f286b4ba5/users/8dc1099c97904028aba423320e48f8f9/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:40:20.366018 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc56a0b-3141-4190-8af9-8ab31e535f7f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:20.366406 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc56a0b-3141-4190-8af9-8ab31e535f7f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:20.366745 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc56a0b-3141-4190-8af9-8ab31e535f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:20.397816 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-5dc56a0b-3141-4190-8af9-8ab31e535f7f None None] MFA Rules not processed for user `8dc1099c97904028aba423320e48f8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:40:20.399243 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5dc56a0b-3141-4190-8af9-8ab31e535f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:20.480581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1398/2832] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:40:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:40:20.491576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95065fb6-5f69-46e1-864d-309606bd3d23 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:20.493432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-95065fb6-5f69-46e1-864d-309606bd3d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:20.591854 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95065fb6-5f69-46e1-864d-309606bd3d23 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:20.595876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ed1ed-eaa1-4a26-8896-ceadab29e42a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:20.596555 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ed1ed-eaa1-4a26-8896-ceadab29e42a service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:20.596831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ed1ed-eaa1-4a26-8896-ceadab29e42a service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:20.597108 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ed1ed-eaa1-4a26-8896-ceadab29e42a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:20.607973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ed1ed-eaa1-4a26-8896-ceadab29e42a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:20.610410 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ed1ed-eaa1-4a26-8896-ceadab29e42a service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:20.621950 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1435/2833] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:40:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:40:20.688813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc56a0b-3141-4190-8af9-8ab31e535f7f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:20.690279 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5dc56a0b-3141-4190-8af9-8ab31e535f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:20.704440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc56a0b-3141-4190-8af9-8ab31e535f7f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:20.709061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb902ac-6425-47a2-bc74-c82c8760b75a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:20.709744 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb902ac-6425-47a2-bc74-c82c8760b75a service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:20.710065 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb902ac-6425-47a2-bc74-c82c8760b75a service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:20.710339 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb902ac-6425-47a2-bc74-c82c8760b75a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:20.744693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:20.789503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb902ac-6425-47a2-bc74-c82c8760b75a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:20.790995 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb902ac-6425-47a2-bc74-c82c8760b75a service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:20.800985 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1399/2834] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:40:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:40:24.287257 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ed1ed-eaa1-4a26-8896-ceadab29e42a service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:24.372381 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ed1ed-eaa1-4a26-8896-ceadab29e42a service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:24.376904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b53c00-c47a-40ab-b538-bdbdcad17319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:24.377785 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b53c00-c47a-40ab-b538-bdbdcad17319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:24.378093 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b53c00-c47a-40ab-b538-bdbdcad17319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:24.378365 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b53c00-c47a-40ab-b538-bdbdcad17319 admin admin] PATH_INFO: `/v3/users/20101540b4864ffdac872d492889c60c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:24.379571 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b53c00-c47a-40ab-b538-bdbdcad17319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20101540b4864ffdac872d492889c60c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:24.381522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b53c00-c47a-40ab-b538-bdbdcad17319 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:24.438901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-13b53c00-c47a-40ab-b538-bdbdcad17319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20101540b4864ffdac872d492889c60c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:24.439556 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-13b53c00-c47a-40ab-b538-bdbdcad17319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20101540b4864ffdac872d492889c60c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:24.444447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:24.448622 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-13b53c00-c47a-40ab-b538-bdbdcad17319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20101540b4864ffdac872d492889c60c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:24.460016 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-13b53c00-c47a-40ab-b538-bdbdcad17319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20101540b4864ffdac872d492889c60c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:24.460663 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-13b53c00-c47a-40ab-b538-bdbdcad17319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20101540b4864ffdac872d492889c60c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:24.481235 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1436/2835] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:40:24 2022] DELETE /identity/v3/users/20101540b4864ffdac872d492889c60c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:40:24.486152 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9128d6b-2627-48a7-9263-bc2be0324e1f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:24.486680 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9128d6b-2627-48a7-9263-bc2be0324e1f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:24.486804 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9128d6b-2627-48a7-9263-bc2be0324e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:24.508483 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a9128d6b-2627-48a7-9263-bc2be0324e1f None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:40:24.509731 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a9128d6b-2627-48a7-9263-bc2be0324e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:24.582066 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1400/2836] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:40:24.603345 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b53c00-c47a-40ab-b538-bdbdcad17319 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:24.605744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-13b53c00-c47a-40ab-b538-bdbdcad17319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:24.679073 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b53c00-c47a-40ab-b538-bdbdcad17319 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:24.682973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3404b5b-df4e-4ff4-aa37-6c905b54dce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:24.683660 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3404b5b-df4e-4ff4-aa37-6c905b54dce1 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:24.683941 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3404b5b-df4e-4ff4-aa37-6c905b54dce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:24.684217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3404b5b-df4e-4ff4-aa37-6c905b54dce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:24.694253 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3404b5b-df4e-4ff4-aa37-6c905b54dce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:24.695714 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3404b5b-df4e-4ff4-aa37-6c905b54dce1 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:24.708157 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1437/2837] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:40:25.044418 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9128d6b-2627-48a7-9263-bc2be0324e1f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:25.047233 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a9128d6b-2627-48a7-9263-bc2be0324e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:25.067634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9128d6b-2627-48a7-9263-bc2be0324e1f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:25.075063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fda96d-e34a-40cb-9b09-dccdf566d79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:25.076474 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fda96d-e34a-40cb-9b09-dccdf566d79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:25.076922 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fda96d-e34a-40cb-9b09-dccdf566d79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:25.077347 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fda96d-e34a-40cb-9b09-dccdf566d79b admin admin] PATH_INFO: `/v3/projects/26042160b4844c85a59edb0657c0c692` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:25.079473 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fda96d-e34a-40cb-9b09-dccdf566d79b admin admin] RBAC: Authorizing `identity:delete_project(project_id=26042160b4844c85a59edb0657c0c692)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:25.081661 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fda96d-e34a-40cb-9b09-dccdf566d79b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:25.150055 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-69fda96d-e34a-40cb-9b09-dccdf566d79b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26042160b4844c85a59edb0657c0c692', 'request_id': 'req-69fda96d-e34a-40cb-9b09-dccdf566d79b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:25.157615 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-69fda96d-e34a-40cb-9b09-dccdf566d79b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26042160b4844c85a59edb0657c0c692', 'request_id': 'req-69fda96d-e34a-40cb-9b09-dccdf566d79b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:25.169376 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-69fda96d-e34a-40cb-9b09-dccdf566d79b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26042160b4844c85a59edb0657c0c692', 'request_id': 'req-69fda96d-e34a-40cb-9b09-dccdf566d79b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:25.184977 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-69fda96d-e34a-40cb-9b09-dccdf566d79b admin admin] The token cache is being invalidate because project 26042160b4844c85a59edb0657c0c692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:40:25.185306 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-69fda96d-e34a-40cb-9b09-dccdf566d79b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:25.186005 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-69fda96d-e34a-40cb-9b09-dccdf566d79b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:25.187585 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1401/2838] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:40:25 2022] DELETE /identity/v3/projects/26042160b4844c85a59edb0657c0c692 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:40:25.192810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3404b5b-df4e-4ff4-aa37-6c905b54dce1 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:25.205387 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3404b5b-df4e-4ff4-aa37-6c905b54dce1 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:25.293270 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c2de6-ae0a-4729-8b9d-1454fa045b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:25.294849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c2de6-ae0a-4729-8b9d-1454fa045b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:25.295363 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c2de6-ae0a-4729-8b9d-1454fa045b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:25.295856 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c2de6-ae0a-4729-8b9d-1454fa045b97 admin admin] PATH_INFO: `/v3/users/8dc1099c97904028aba423320e48f8f9` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:25.298015 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c2de6-ae0a-4729-8b9d-1454fa045b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dc1099c97904028aba423320e48f8f9)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:25.301248 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c2de6-ae0a-4729-8b9d-1454fa045b97 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:25.372256 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-603c2de6-ae0a-4729-8b9d-1454fa045b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dc1099c97904028aba423320e48f8f9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:25.372944 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-603c2de6-ae0a-4729-8b9d-1454fa045b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dc1099c97904028aba423320e48f8f9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:25.380474 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-603c2de6-ae0a-4729-8b9d-1454fa045b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dc1099c97904028aba423320e48f8f9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:25.390527 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-603c2de6-ae0a-4729-8b9d-1454fa045b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dc1099c97904028aba423320e48f8f9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:25.391438 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-603c2de6-ae0a-4729-8b9d-1454fa045b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dc1099c97904028aba423320e48f8f9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:25.401876 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:25.418368 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1438/2839] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:40:25 2022] DELETE /identity/v3/users/8dc1099c97904028aba423320e48f8f9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:40:25.773006 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fda96d-e34a-40cb-9b09-dccdf566d79b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:25.775340 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-69fda96d-e34a-40cb-9b09-dccdf566d79b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:25.795937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fda96d-e34a-40cb-9b09-dccdf566d79b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:25.871873 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:25.893910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94c772-9442-4a7a-a480-d30c34aada56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:25.894819 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94c772-9442-4a7a-a480-d30c34aada56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:25.895097 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94c772-9442-4a7a-a480-d30c34aada56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:25.895360 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94c772-9442-4a7a-a480-d30c34aada56 admin admin] PATH_INFO: `/v3/projects/cdfa749a728744178ea3437f286b4ba5` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:25.896634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94c772-9442-4a7a-a480-d30c34aada56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdfa749a728744178ea3437f286b4ba5)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:25.898878 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94c772-9442-4a7a-a480-d30c34aada56 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:25.972622 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-9f94c772-9442-4a7a-a480-d30c34aada56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdfa749a728744178ea3437f286b4ba5', 'request_id': 'req-9f94c772-9442-4a7a-a480-d30c34aada56'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:25.984956 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-9f94c772-9442-4a7a-a480-d30c34aada56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdfa749a728744178ea3437f286b4ba5', 'request_id': 'req-9f94c772-9442-4a7a-a480-d30c34aada56'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:25.996937 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-9f94c772-9442-4a7a-a480-d30c34aada56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdfa749a728744178ea3437f286b4ba5', 'request_id': 'req-9f94c772-9442-4a7a-a480-d30c34aada56'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:26.017961 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-9f94c772-9442-4a7a-a480-d30c34aada56 admin admin] The token cache is being invalidate because project cdfa749a728744178ea3437f286b4ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:40:26.018490 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-9f94c772-9442-4a7a-a480-d30c34aada56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:26.019356 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-9f94c772-9442-4a7a-a480-d30c34aada56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:26.021059 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1402/2840] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:40:25 2022] DELETE /identity/v3/projects/cdfa749a728744178ea3437f286b4ba5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:40:26.027785 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426aab3-69fe-43bf-b4b6-5f7d85acaa19 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:26.028162 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426aab3-69fe-43bf-b4b6-5f7d85acaa19 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:26.028511 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426aab3-69fe-43bf-b4b6-5f7d85acaa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:26.049772 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-3426aab3-69fe-43bf-b4b6-5f7d85acaa19 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:40:26.051483 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3426aab3-69fe-43bf-b4b6-5f7d85acaa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:26.137151 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1439/2841] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:40:26.158432 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f3636-6baf-478a-aebe-76f0994c33cc None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:26.158734 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f3636-6baf-478a-aebe-76f0994c33cc None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:26.158984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f3636-6baf-478a-aebe-76f0994c33cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:26.179875 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-9c7f3636-6baf-478a-aebe-76f0994c33cc None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:40:26.181163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9c7f3636-6baf-478a-aebe-76f0994c33cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:26.190724 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1403/2842] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:40:26.195799 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426aab3-69fe-43bf-b4b6-5f7d85acaa19 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:26.207688 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426aab3-69fe-43bf-b4b6-5f7d85acaa19 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:26.213507 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6c964-c43f-4086-a519-013c810c6fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:26.215074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6c964-c43f-4086-a519-013c810c6fac admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:26.215074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6c964-c43f-4086-a519-013c810c6fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:26.215509 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6c964-c43f-4086-a519-013c810c6fac admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:26.216424 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6c964-c43f-4086-a519-013c810c6fac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:40:26.216810 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6c964-c43f-4086-a519-013c810c6fac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:26.218688 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6c964-c43f-4086-a519-013c810c6fac admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:26.234085 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1440/2843] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:40:26.239510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f3636-6baf-478a-aebe-76f0994c33cc None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:26.249634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f3636-6baf-478a-aebe-76f0994c33cc None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:26.254577 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40063615-75ad-4bf5-87cf-f15eafd1e781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:26.255266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40063615-75ad-4bf5-87cf-f15eafd1e781 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:26.255548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40063615-75ad-4bf5-87cf-f15eafd1e781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:26.255823 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40063615-75ad-4bf5-87cf-f15eafd1e781 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:26.256620 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40063615-75ad-4bf5-87cf-f15eafd1e781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:26.258536 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40063615-75ad-4bf5-87cf-f15eafd1e781 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:26.295525 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1404/2844] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:40:26 2022] POST /identity/v3/projects => generated 399 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:40:26.300638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6c964-c43f-4086-a519-013c810c6fac admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:26.315219 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6c964-c43f-4086-a519-013c810c6fac admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:26.406592 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc7572-a0d8-4981-a8c8-83db25725975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:26.407702 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc7572-a0d8-4981-a8c8-83db25725975 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:26.408198 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc7572-a0d8-4981-a8c8-83db25725975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:26.408583 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc7572-a0d8-4981-a8c8-83db25725975 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:26.409379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc7572-a0d8-4981-a8c8-83db25725975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:26.412476 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc7572-a0d8-4981-a8c8-83db25725975 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:26.439655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1441/2845] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:40:26 2022] POST /identity/v3/users => generated 300 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:40:26.445299 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40063615-75ad-4bf5-87cf-f15eafd1e781 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:26.466027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40063615-75ad-4bf5-87cf-f15eafd1e781 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:26.478895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c7fe0-2da7-4de0-a1bc-0ad92f02014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:26.480238 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c7fe0-2da7-4de0-a1bc-0ad92f02014d admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:26.480816 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c7fe0-2da7-4de0-a1bc-0ad92f02014d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:26.481333 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c7fe0-2da7-4de0-a1bc-0ad92f02014d admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:26.482673 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c7fe0-2da7-4de0-a1bc-0ad92f02014d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:26.487712 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c7fe0-2da7-4de0-a1bc-0ad92f02014d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:26.500578 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1405/2846] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:40:26.504558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc7572-a0d8-4981-a8c8-83db25725975 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:26.515803 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc7572-a0d8-4981-a8c8-83db25725975 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:26.521045 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f67ed0-17e2-4297-8ffe-bb3efd3fdbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:26.521746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f67ed0-17e2-4297-8ffe-bb3efd3fdbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:26.522220 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f67ed0-17e2-4297-8ffe-bb3efd3fdbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:26.522506 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f67ed0-17e2-4297-8ffe-bb3efd3fdbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:26.523447 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f67ed0-17e2-4297-8ffe-bb3efd3fdbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:26.524901 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f67ed0-17e2-4297-8ffe-bb3efd3fdbe1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:26.537533 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1442/2847] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:40:26.541501 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c7fe0-2da7-4de0-a1bc-0ad92f02014d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:26.553561 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c7fe0-2da7-4de0-a1bc-0ad92f02014d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:26.558948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ed211-65b2-4f69-bc01-6d93997b534c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:26.561635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ed211-65b2-4f69-bc01-6d93997b534c admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:26.561635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ed211-65b2-4f69-bc01-6d93997b534c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:26.561635 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ed211-65b2-4f69-bc01-6d93997b534c admin admin] PATH_INFO: `/v3/projects/4bfe28f8ce6b4a1f9362a9682c7fc026/users/19b224752b524ae6b07df69f9a11724b/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:26.582393 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ed211-65b2-4f69-bc01-6d93997b534c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bfe28f8ce6b4a1f9362a9682c7fc026, user_id=19b224752b524ae6b07df69f9a11724b, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:26.585155 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ed211-65b2-4f69-bc01-6d93997b534c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:26.605380 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1406/2848] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:40:26 2022] PUT /identity/v3/projects/4bfe28f8ce6b4a1f9362a9682c7fc026/users/19b224752b524ae6b07df69f9a11724b/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:40:26.618842 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c7f48-32fa-4777-9e3c-23e6084a9668 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:26.619161 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c7f48-32fa-4777-9e3c-23e6084a9668 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:26.619390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c7f48-32fa-4777-9e3c-23e6084a9668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:26.664032 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a77c7f48-32fa-4777-9e3c-23e6084a9668 None None] MFA Rules not processed for user `19b224752b524ae6b07df69f9a11724b`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:40:26.666068 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a77c7f48-32fa-4777-9e3c-23e6084a9668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:26.724600 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:26.752857 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1443/2849] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:40:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:40:26.757658 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ed211-65b2-4f69-bc01-6d93997b534c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:26.828109 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ed211-65b2-4f69-bc01-6d93997b534c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:26.834848 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ecbad-4df7-429c-abbc-25015350d3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:26.835571 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ecbad-4df7-429c-abbc-25015350d3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:26.835860 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ecbad-4df7-429c-abbc-25015350d3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:26.836191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ecbad-4df7-429c-abbc-25015350d3d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:26.836933 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ecbad-4df7-429c-abbc-25015350d3d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:26.839980 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ecbad-4df7-429c-abbc-25015350d3d3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:26.856487 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:26.878462 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1407/2850] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:40:26 2022] POST /identity/v3/projects => generated 399 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 19:40:26.883002 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c7f48-32fa-4777-9e3c-23e6084a9668 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:26.895456 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c7f48-32fa-4777-9e3c-23e6084a9668 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:26.968805 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2ee0c-aa5b-418a-8104-28203cbaa9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:26.969505 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2ee0c-aa5b-418a-8104-28203cbaa9ec admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:26.969820 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2ee0c-aa5b-418a-8104-28203cbaa9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:26.970113 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2ee0c-aa5b-418a-8104-28203cbaa9ec admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:26.970850 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2ee0c-aa5b-418a-8104-28203cbaa9ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:26.972963 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2ee0c-aa5b-418a-8104-28203cbaa9ec admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:27.003699 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1444/2851] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:40:26 2022] POST /identity/v3/users => generated 306 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:40:27.008361 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ecbad-4df7-429c-abbc-25015350d3d3 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:27.020266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ecbad-4df7-429c-abbc-25015350d3d3 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:27.027069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf42de-5883-43c2-93a8-be32b64adcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:27.027863 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf42de-5883-43c2-93a8-be32b64adcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:27.028146 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf42de-5883-43c2-93a8-be32b64adcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:27.028424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf42de-5883-43c2-93a8-be32b64adcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:27.029174 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf42de-5883-43c2-93a8-be32b64adcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:27.030830 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf42de-5883-43c2-93a8-be32b64adcf3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:27.043413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1408/2852] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:40:27.048549 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2ee0c-aa5b-418a-8104-28203cbaa9ec admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:27.062165 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2ee0c-aa5b-418a-8104-28203cbaa9ec admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:27.067396 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e676f-8f33-4c3a-929b-f1c2767d13d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:27.068488 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e676f-8f33-4c3a-929b-f1c2767d13d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:27.069168 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e676f-8f33-4c3a-929b-f1c2767d13d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:27.069494 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e676f-8f33-4c3a-929b-f1c2767d13d3 admin admin] PATH_INFO: `/v3/projects/62aaddf4a5894e9a8c40718420cbe12a/users/21b0754d5e51421a9bbf4152e2ab0b72/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:27.087811 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e676f-8f33-4c3a-929b-f1c2767d13d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62aaddf4a5894e9a8c40718420cbe12a, user_id=21b0754d5e51421a9bbf4152e2ab0b72, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:27.090596 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e676f-8f33-4c3a-929b-f1c2767d13d3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:27.109661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1445/2853] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:40:27 2022] PUT /identity/v3/projects/62aaddf4a5894e9a8c40718420cbe12a/users/21b0754d5e51421a9bbf4152e2ab0b72/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:40:27.115106 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf42de-5883-43c2-93a8-be32b64adcf3 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:27.127150 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf42de-5883-43c2-93a8-be32b64adcf3 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:27.218212 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be496a6-3892-4ed7-bea4-328b0f3e3ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:27.218981 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be496a6-3892-4ed7-bea4-328b0f3e3ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:27.219239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be496a6-3892-4ed7-bea4-328b0f3e3ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:27.219567 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be496a6-3892-4ed7-bea4-328b0f3e3ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:27.220388 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be496a6-3892-4ed7-bea4-328b0f3e3ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:27.223509 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be496a6-3892-4ed7-bea4-328b0f3e3ff6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:27.241422 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1409/2854] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 19:40:27.242855 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e676f-8f33-4c3a-929b-f1c2767d13d3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:27.255220 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e676f-8f33-4c3a-929b-f1c2767d13d3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:27.270593 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a081df-e306-4393-85d7-076fbafa306c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:27.271615 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a081df-e306-4393-85d7-076fbafa306c admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:27.272025 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a081df-e306-4393-85d7-076fbafa306c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:27.272609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a081df-e306-4393-85d7-076fbafa306c admin admin] PATH_INFO: `/v3/projects/62aaddf4a5894e9a8c40718420cbe12a/users/21b0754d5e51421a9bbf4152e2ab0b72/roles/8560bac1acf74dce81ea6a76f751b641` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:27.280564 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a081df-e306-4393-85d7-076fbafa306c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62aaddf4a5894e9a8c40718420cbe12a, user_id=21b0754d5e51421a9bbf4152e2ab0b72, role_id=8560bac1acf74dce81ea6a76f751b641)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:27.283440 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a081df-e306-4393-85d7-076fbafa306c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:27.296558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1446/2855] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:40:27 2022] PUT /identity/v3/projects/62aaddf4a5894e9a8c40718420cbe12a/users/21b0754d5e51421a9bbf4152e2ab0b72/roles/8560bac1acf74dce81ea6a76f751b641 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:40:27.307801 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fbd11-84f7-4707-8b45-7e8696363424 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:27.308811 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fbd11-84f7-4707-8b45-7e8696363424 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:27.309149 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fbd11-84f7-4707-8b45-7e8696363424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:27.341007 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-493fbd11-84f7-4707-8b45-7e8696363424 None None] MFA Rules not processed for user `21b0754d5e51421a9bbf4152e2ab0b72`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:40:27.342480 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-493fbd11-84f7-4707-8b45-7e8696363424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:27.422258 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1410/2856] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:40:27 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:40:27.435899 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a081df-e306-4393-85d7-076fbafa306c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:27.437707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-48a081df-e306-4393-85d7-076fbafa306c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:27.509933 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a081df-e306-4393-85d7-076fbafa306c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:27.514082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9877d5-5f04-4d33-a95c-61bda654f0bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:27.514752 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9877d5-5f04-4d33-a95c-61bda654f0bd service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:27.515060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9877d5-5f04-4d33-a95c-61bda654f0bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:27.515335 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9877d5-5f04-4d33-a95c-61bda654f0bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:27.529517 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9877d5-5f04-4d33-a95c-61bda654f0bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:27.531347 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9877d5-5f04-4d33-a95c-61bda654f0bd service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:27.546212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1447/2857] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:40:27 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:40:27.635112 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fbd11-84f7-4707-8b45-7e8696363424 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:27.648079 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fbd11-84f7-4707-8b45-7e8696363424 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:27.652618 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762fc34-b561-4d84-a0e1-cc126b2aca7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:27.653297 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762fc34-b561-4d84-a0e1-cc126b2aca7a service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:27.653569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762fc34-b561-4d84-a0e1-cc126b2aca7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:27.653891 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762fc34-b561-4d84-a0e1-cc126b2aca7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:27.718742 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762fc34-b561-4d84-a0e1-cc126b2aca7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:27.720242 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762fc34-b561-4d84-a0e1-cc126b2aca7a service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:27.730517 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1411/2858] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:40:27 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:40:29.948890 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9877d5-5f04-4d33-a95c-61bda654f0bd service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:29.950642 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7c9877d5-5f04-4d33-a95c-61bda654f0bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:30.012773 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:30.039265 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9877d5-5f04-4d33-a95c-61bda654f0bd service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:30.043392 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6164e83-9fbc-467e-a5bd-a130e74a02a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:30.044081 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6164e83-9fbc-467e-a5bd-a130e74a02a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:30.044348 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6164e83-9fbc-467e-a5bd-a130e74a02a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:30.044627 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6164e83-9fbc-467e-a5bd-a130e74a02a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:30.046660 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b6164e83-9fbc-467e-a5bd-a130e74a02a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:30.057638 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6164e83-9fbc-467e-a5bd-a130e74a02a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:30.059656 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6164e83-9fbc-467e-a5bd-a130e74a02a0 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:30.070437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1448/2859] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:40:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:40:30.157371 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762fc34-b561-4d84-a0e1-cc126b2aca7a service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:30.159015 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7762fc34-b561-4d84-a0e1-cc126b2aca7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:30.168184 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:30.173021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762fc34-b561-4d84-a0e1-cc126b2aca7a service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:30.177258 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08302338-eb38-41a5-824d-9b207193c1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:30.177938 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08302338-eb38-41a5-824d-9b207193c1ef service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:30.178218 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08302338-eb38-41a5-824d-9b207193c1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:30.178519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08302338-eb38-41a5-824d-9b207193c1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:30.180417 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-08302338-eb38-41a5-824d-9b207193c1ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:30.285663 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08302338-eb38-41a5-824d-9b207193c1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:30.287082 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08302338-eb38-41a5-824d-9b207193c1ef service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:30.310918 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1412/2860] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:40:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:40:31.981027 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6164e83-9fbc-467e-a5bd-a130e74a02a0 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:32.062302 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6164e83-9fbc-467e-a5bd-a130e74a02a0 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:32.067060 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0e58a-754c-47e2-961a-6d2487703168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:32.068166 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0e58a-754c-47e2-961a-6d2487703168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:32.068297 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0e58a-754c-47e2-961a-6d2487703168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:32.068495 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0e58a-754c-47e2-961a-6d2487703168 admin admin] PATH_INFO: `/v3/users/19b224752b524ae6b07df69f9a11724b` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:32.069902 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0e58a-754c-47e2-961a-6d2487703168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b224752b524ae6b07df69f9a11724b)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:32.071893 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0e58a-754c-47e2-961a-6d2487703168 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:32.132474 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f5e0e58a-754c-47e2-961a-6d2487703168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b224752b524ae6b07df69f9a11724b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:32.133161 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f5e0e58a-754c-47e2-961a-6d2487703168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b224752b524ae6b07df69f9a11724b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:32.140714 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f5e0e58a-754c-47e2-961a-6d2487703168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b224752b524ae6b07df69f9a11724b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:32.149756 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f5e0e58a-754c-47e2-961a-6d2487703168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b224752b524ae6b07df69f9a11724b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:32.150508 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f5e0e58a-754c-47e2-961a-6d2487703168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b224752b524ae6b07df69f9a11724b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:32.178959 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1449/2861] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:40:31 2022] DELETE /identity/v3/users/19b224752b524ae6b07df69f9a11724b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:40:32.185491 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc58086-b4bf-403a-bc28-dda6743322ab None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:32.186443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc58086-b4bf-403a-bc28-dda6743322ab None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:32.186443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc58086-b4bf-403a-bc28-dda6743322ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:32.211433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-9dc58086-b4bf-403a-bc28-dda6743322ab None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:40:32.212700 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9dc58086-b4bf-403a-bc28-dda6743322ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:32.297716 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1413/2862] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 19:40:32.311052 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0e58a-754c-47e2-961a-6d2487703168 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:32.312584 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f5e0e58a-754c-47e2-961a-6d2487703168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:32.402558 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0e58a-754c-47e2-961a-6d2487703168 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:32.407302 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9c5c3-a12c-47fb-9bae-7f88cb6b7024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:32.407560 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9c5c3-a12c-47fb-9bae-7f88cb6b7024 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:32.407748 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9c5c3-a12c-47fb-9bae-7f88cb6b7024 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:32.408188 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9c5c3-a12c-47fb-9bae-7f88cb6b7024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:32.420745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9c5c3-a12c-47fb-9bae-7f88cb6b7024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:32.423240 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9c5c3-a12c-47fb-9bae-7f88cb6b7024 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:32.441744 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1450/2863] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:40:32.753583 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc58086-b4bf-403a-bc28-dda6743322ab None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:32.755143 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9dc58086-b4bf-403a-bc28-dda6743322ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:32.771386 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc58086-b4bf-403a-bc28-dda6743322ab None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:32.780240 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e99cc-d998-411c-b2db-834851c578f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:32.781773 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e99cc-d998-411c-b2db-834851c578f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:32.782297 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e99cc-d998-411c-b2db-834851c578f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:32.783609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e99cc-d998-411c-b2db-834851c578f9 admin admin] PATH_INFO: `/v3/projects/4bfe28f8ce6b4a1f9362a9682c7fc026` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:32.785508 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e99cc-d998-411c-b2db-834851c578f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bfe28f8ce6b4a1f9362a9682c7fc026)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:32.788009 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e99cc-d998-411c-b2db-834851c578f9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:32.854592 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-102e99cc-d998-411c-b2db-834851c578f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bfe28f8ce6b4a1f9362a9682c7fc026', 'request_id': 'req-102e99cc-d998-411c-b2db-834851c578f9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:32.862989 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-102e99cc-d998-411c-b2db-834851c578f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bfe28f8ce6b4a1f9362a9682c7fc026', 'request_id': 'req-102e99cc-d998-411c-b2db-834851c578f9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:32.865600 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:32.878413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-102e99cc-d998-411c-b2db-834851c578f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bfe28f8ce6b4a1f9362a9682c7fc026', 'request_id': 'req-102e99cc-d998-411c-b2db-834851c578f9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:32.890946 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-102e99cc-d998-411c-b2db-834851c578f9 admin admin] The token cache is being invalidate because project 4bfe28f8ce6b4a1f9362a9682c7fc026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:40:32.891262 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-102e99cc-d998-411c-b2db-834851c578f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:32.891870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-102e99cc-d998-411c-b2db-834851c578f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:32.893450 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1414/2864] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:40:32 2022] DELETE /identity/v3/projects/4bfe28f8ce6b4a1f9362a9682c7fc026 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:40:32.897856 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9c5c3-a12c-47fb-9bae-7f88cb6b7024 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:32.908515 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9c5c3-a12c-47fb-9bae-7f88cb6b7024 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:32.914389 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:32.981582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e2fef-d1f9-4935-b1ff-98040a0fb772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:32.982510 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e2fef-d1f9-4935-b1ff-98040a0fb772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:32.982785 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e2fef-d1f9-4935-b1ff-98040a0fb772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:32.983056 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e2fef-d1f9-4935-b1ff-98040a0fb772 admin admin] PATH_INFO: `/v3/users/21b0754d5e51421a9bbf4152e2ab0b72` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:32.984735 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e2fef-d1f9-4935-b1ff-98040a0fb772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b0754d5e51421a9bbf4152e2ab0b72)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:32.986726 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e2fef-d1f9-4935-b1ff-98040a0fb772 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:33.055596 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-031e2fef-d1f9-4935-b1ff-98040a0fb772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b0754d5e51421a9bbf4152e2ab0b72'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:33.056390 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-031e2fef-d1f9-4935-b1ff-98040a0fb772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b0754d5e51421a9bbf4152e2ab0b72'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:33.065867 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-031e2fef-d1f9-4935-b1ff-98040a0fb772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b0754d5e51421a9bbf4152e2ab0b72'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:33.077688 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-031e2fef-d1f9-4935-b1ff-98040a0fb772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b0754d5e51421a9bbf4152e2ab0b72'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:33.079841 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-031e2fef-d1f9-4935-b1ff-98040a0fb772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b0754d5e51421a9bbf4152e2ab0b72'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:33.100205 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1451/2865] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:40:32 2022] DELETE /identity/v3/users/21b0754d5e51421a9bbf4152e2ab0b72 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:40:33.420252 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e99cc-d998-411c-b2db-834851c578f9 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:33.422594 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-102e99cc-d998-411c-b2db-834851c578f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:33.439995 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e99cc-d998-411c-b2db-834851c578f9 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:33.518922 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa936d2-ab8e-4a28-a5f7-c083c6e0b409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:33.519850 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa936d2-ab8e-4a28-a5f7-c083c6e0b409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:33.520120 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa936d2-ab8e-4a28-a5f7-c083c6e0b409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:33.520399 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa936d2-ab8e-4a28-a5f7-c083c6e0b409 admin admin] PATH_INFO: `/v3/projects/62aaddf4a5894e9a8c40718420cbe12a` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:33.521826 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa936d2-ab8e-4a28-a5f7-c083c6e0b409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62aaddf4a5894e9a8c40718420cbe12a)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:33.523861 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa936d2-ab8e-4a28-a5f7-c083c6e0b409 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:33.584048 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6fa936d2-ab8e-4a28-a5f7-c083c6e0b409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62aaddf4a5894e9a8c40718420cbe12a', 'request_id': 'req-6fa936d2-ab8e-4a28-a5f7-c083c6e0b409'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:33.591554 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6fa936d2-ab8e-4a28-a5f7-c083c6e0b409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62aaddf4a5894e9a8c40718420cbe12a', 'request_id': 'req-6fa936d2-ab8e-4a28-a5f7-c083c6e0b409'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:33.603339 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6fa936d2-ab8e-4a28-a5f7-c083c6e0b409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62aaddf4a5894e9a8c40718420cbe12a', 'request_id': 'req-6fa936d2-ab8e-4a28-a5f7-c083c6e0b409'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:33.616973 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6fa936d2-ab8e-4a28-a5f7-c083c6e0b409 admin admin] The token cache is being invalidate because project 62aaddf4a5894e9a8c40718420cbe12a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:40:33.617281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6fa936d2-ab8e-4a28-a5f7-c083c6e0b409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:33.617987 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6fa936d2-ab8e-4a28-a5f7-c083c6e0b409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:40:33.619633 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1415/2866] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:40:33 2022] DELETE /identity/v3/projects/62aaddf4a5894e9a8c40718420cbe12a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:40:33.625080 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbe872-6876-49b4-b853-17b790962c39 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:33.625452 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbe872-6876-49b4-b853-17b790962c39 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:33.625741 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbe872-6876-49b4-b853-17b790962c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:33.645673 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-92fbe872-6876-49b4-b853-17b790962c39 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:40:33.646940 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-92fbe872-6876-49b4-b853-17b790962c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:33.727716 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1452/2867] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:40:33.738620 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9da6a-1b8c-4a52-bf03-fdebff7eba9c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:33.738883 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9da6a-1b8c-4a52-bf03-fdebff7eba9c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:33.739185 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9da6a-1b8c-4a52-bf03-fdebff7eba9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:33.761527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-06b9da6a-1b8c-4a52-bf03-fdebff7eba9c None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:40:33.762831 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-06b9da6a-1b8c-4a52-bf03-fdebff7eba9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:33.772189 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1416/2868] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:40:33.776930 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbe872-6876-49b4-b853-17b790962c39 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:33.788502 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbe872-6876-49b4-b853-17b790962c39 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:33.793723 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df953f-1843-41f6-8508-5c39a3157759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:33.794429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df953f-1843-41f6-8508-5c39a3157759 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:33.794728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df953f-1843-41f6-8508-5c39a3157759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:33.794980 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df953f-1843-41f6-8508-5c39a3157759 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:33.795710 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df953f-1843-41f6-8508-5c39a3157759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:40:33.796013 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df953f-1843-41f6-8508-5c39a3157759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:33.798000 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df953f-1843-41f6-8508-5c39a3157759 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:33.812098 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1453/2869] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:40:33.816923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9da6a-1b8c-4a52-bf03-fdebff7eba9c None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:33.830260 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9da6a-1b8c-4a52-bf03-fdebff7eba9c None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:33.836009 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd313b68-1e26-43a1-838e-33cfdaf86f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:33.836721 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd313b68-1e26-43a1-838e-33cfdaf86f5c admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:33.837001 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd313b68-1e26-43a1-838e-33cfdaf86f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:33.837272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd313b68-1e26-43a1-838e-33cfdaf86f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:33.837995 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd313b68-1e26-43a1-838e-33cfdaf86f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:33.840952 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd313b68-1e26-43a1-838e-33cfdaf86f5c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:33.871055 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1417/2870] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:40:33 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:40:33.875704 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df953f-1843-41f6-8508-5c39a3157759 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:33.887100 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df953f-1843-41f6-8508-5c39a3157759 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:33.898072 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:33.952055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d1372-e1fa-4a82-a41c-1c50bd77692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:33.952719 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d1372-e1fa-4a82-a41c-1c50bd77692a admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:33.953133 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d1372-e1fa-4a82-a41c-1c50bd77692a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:33.953439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d1372-e1fa-4a82-a41c-1c50bd77692a admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:33.954190 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d1372-e1fa-4a82-a41c-1c50bd77692a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:33.956137 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d1372-e1fa-4a82-a41c-1c50bd77692a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:33.981281 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1454/2871] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:40:33 2022] POST /identity/v3/users => generated 282 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:40:33.985702 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd313b68-1e26-43a1-838e-33cfdaf86f5c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:33.997870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd313b68-1e26-43a1-838e-33cfdaf86f5c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:34.003319 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93f930-b417-4790-a243-fae5d8aa21e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:34.004002 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93f930-b417-4790-a243-fae5d8aa21e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:34.004277 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93f930-b417-4790-a243-fae5d8aa21e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:34.004551 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93f930-b417-4790-a243-fae5d8aa21e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:34.005281 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93f930-b417-4790-a243-fae5d8aa21e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:34.006959 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93f930-b417-4790-a243-fae5d8aa21e3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:34.019495 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1418/2872] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:40:34.025191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d1372-e1fa-4a82-a41c-1c50bd77692a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:34.037830 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d1372-e1fa-4a82-a41c-1c50bd77692a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:34.044020 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18966d85-7b92-4827-a5f3-44010c0c908b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:34.044701 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18966d85-7b92-4827-a5f3-44010c0c908b admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:34.044975 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18966d85-7b92-4827-a5f3-44010c0c908b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:34.045241 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18966d85-7b92-4827-a5f3-44010c0c908b admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:34.046008 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18966d85-7b92-4827-a5f3-44010c0c908b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:34.047954 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18966d85-7b92-4827-a5f3-44010c0c908b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:34.060544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1455/2873] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:40:34.065679 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93f930-b417-4790-a243-fae5d8aa21e3 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:34.081781 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93f930-b417-4790-a243-fae5d8aa21e3 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:34.088990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60780e-f5fe-4583-9301-2802ab1347b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:34.089968 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60780e-f5fe-4583-9301-2802ab1347b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:34.090216 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60780e-f5fe-4583-9301-2802ab1347b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:34.090490 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60780e-f5fe-4583-9301-2802ab1347b0 admin admin] PATH_INFO: `/v3/projects/546c23ebdf2245a19364c969b2da2ce0/users/d3c8dc552ab64a84950605ff6d7cdf72/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:34.107568 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60780e-f5fe-4583-9301-2802ab1347b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=546c23ebdf2245a19364c969b2da2ce0, user_id=d3c8dc552ab64a84950605ff6d7cdf72, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:34.110434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60780e-f5fe-4583-9301-2802ab1347b0 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:34.128737 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1419/2874] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:40:34 2022] PUT /identity/v3/projects/546c23ebdf2245a19364c969b2da2ce0/users/d3c8dc552ab64a84950605ff6d7cdf72/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:40:34.139989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605e3c4-904a-4645-8bae-9ff4fd95ad1c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:34.140253 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605e3c4-904a-4645-8bae-9ff4fd95ad1c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:34.140542 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605e3c4-904a-4645-8bae-9ff4fd95ad1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:34.173306 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-1605e3c4-904a-4645-8bae-9ff4fd95ad1c None None] MFA Rules not processed for user `d3c8dc552ab64a84950605ff6d7cdf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:40:34.175746 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1605e3c4-904a-4645-8bae-9ff4fd95ad1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:34.271532 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1456/2875] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:40:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:40:34.283453 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60780e-f5fe-4583-9301-2802ab1347b0 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:34.285463 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-bc60780e-f5fe-4583-9301-2802ab1347b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:34.302463 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:34.351532 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60780e-f5fe-4583-9301-2802ab1347b0 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:34.355892 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c442c-8fcf-496b-acc1-f18969ba6adb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:34.356609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c442c-8fcf-496b-acc1-f18969ba6adb service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:34.356944 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c442c-8fcf-496b-acc1-f18969ba6adb service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:34.357273 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c442c-8fcf-496b-acc1-f18969ba6adb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:34.367646 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c442c-8fcf-496b-acc1-f18969ba6adb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:34.369100 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c442c-8fcf-496b-acc1-f18969ba6adb service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:34.379360 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1420/2876] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:40:34 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:40:44.262487 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=60,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:44.375148 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=20 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:40:59.078484 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605e3c4-904a-4645-8bae-9ff4fd95ad1c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:40:59.080079 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1605e3c4-904a-4645-8bae-9ff4fd95ad1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:59.156528 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605e3c4-904a-4645-8bae-9ff4fd95ad1c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:40:59.162817 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0ea53-cbfb-437e-8453-deb5e5f4323e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:40:59.163480 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0ea53-cbfb-437e-8453-deb5e5f4323e service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:40:59.163766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0ea53-cbfb-437e-8453-deb5e5f4323e service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:40:59.164233 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0ea53-cbfb-437e-8453-deb5e5f4323e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:40:59.167039 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d8e0ea53-cbfb-437e-8453-deb5e5f4323e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:40:59.180958 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0ea53-cbfb-437e-8453-deb5e5f4323e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:40:59.182521 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0ea53-cbfb-437e-8453-deb5e5f4323e service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:40:59.193266 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1457/2877] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:40:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:41:08.736002 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c442c-8fcf-496b-acc1-f18969ba6adb service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:08.804507 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c442c-8fcf-496b-acc1-f18969ba6adb service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:08.809536 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7b437-0bc5-45bd-9102-434043827518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:08.810453 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7b437-0bc5-45bd-9102-434043827518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:08.810737 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7b437-0bc5-45bd-9102-434043827518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:08.811289 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7b437-0bc5-45bd-9102-434043827518 admin admin] PATH_INFO: `/v3/users/d3c8dc552ab64a84950605ff6d7cdf72` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:08.812338 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7b437-0bc5-45bd-9102-434043827518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3c8dc552ab64a84950605ff6d7cdf72)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:08.814354 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7b437-0bc5-45bd-9102-434043827518 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:08.871420 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-dad7b437-0bc5-45bd-9102-434043827518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3c8dc552ab64a84950605ff6d7cdf72'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:08.872103 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-dad7b437-0bc5-45bd-9102-434043827518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3c8dc552ab64a84950605ff6d7cdf72'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:08.879397 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-dad7b437-0bc5-45bd-9102-434043827518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3c8dc552ab64a84950605ff6d7cdf72'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:08.892176 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-dad7b437-0bc5-45bd-9102-434043827518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3c8dc552ab64a84950605ff6d7cdf72'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:08.892984 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-dad7b437-0bc5-45bd-9102-434043827518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3c8dc552ab64a84950605ff6d7cdf72'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:08.907923 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1421/2878] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:41:08 2022] DELETE /identity/v3/users/d3c8dc552ab64a84950605ff6d7cdf72 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:41:08.912748 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95ec0d-565f-4d2f-825c-a67504d762e8 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:08.913274 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95ec0d-565f-4d2f-825c-a67504d762e8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:08.913274 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95ec0d-565f-4d2f-825c-a67504d762e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:08.932523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ec95ec0d-565f-4d2f-825c-a67504d762e8 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:41:08.933745 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ec95ec0d-565f-4d2f-825c-a67504d762e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:09.007216 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1458/2879] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:41:09.017612 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7b437-0bc5-45bd-9102-434043827518 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:09.019266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-dad7b437-0bc5-45bd-9102-434043827518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:09.081863 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7b437-0bc5-45bd-9102-434043827518 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:09.085588 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461f111-cb73-4e76-85ac-f671d866d207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:09.086282 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461f111-cb73-4e76-85ac-f671d866d207 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:09.086563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461f111-cb73-4e76-85ac-f671d866d207 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:09.086840 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461f111-cb73-4e76-85ac-f671d866d207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:09.097276 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461f111-cb73-4e76-85ac-f671d866d207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:09.098760 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461f111-cb73-4e76-85ac-f671d866d207 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:09.108619 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1422/2880] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:41:09.392962 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95ec0d-565f-4d2f-825c-a67504d762e8 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:09.394575 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ec95ec0d-565f-4d2f-825c-a67504d762e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:09.411774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95ec0d-565f-4d2f-825c-a67504d762e8 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:09.417064 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590507f-e6db-4b35-a72b-e05e22bec733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:09.417982 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590507f-e6db-4b35-a72b-e05e22bec733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:09.418261 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590507f-e6db-4b35-a72b-e05e22bec733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:09.418530 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590507f-e6db-4b35-a72b-e05e22bec733 admin admin] PATH_INFO: `/v3/projects/546c23ebdf2245a19364c969b2da2ce0` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:09.419813 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590507f-e6db-4b35-a72b-e05e22bec733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=546c23ebdf2245a19364c969b2da2ce0)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:09.422621 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590507f-e6db-4b35-a72b-e05e22bec733 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:09.476071 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a590507f-e6db-4b35-a72b-e05e22bec733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546c23ebdf2245a19364c969b2da2ce0', 'request_id': 'req-a590507f-e6db-4b35-a72b-e05e22bec733'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:09.485164 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a590507f-e6db-4b35-a72b-e05e22bec733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546c23ebdf2245a19364c969b2da2ce0', 'request_id': 'req-a590507f-e6db-4b35-a72b-e05e22bec733'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:09.491931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a590507f-e6db-4b35-a72b-e05e22bec733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546c23ebdf2245a19364c969b2da2ce0', 'request_id': 'req-a590507f-e6db-4b35-a72b-e05e22bec733'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:09.504297 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a590507f-e6db-4b35-a72b-e05e22bec733 admin admin] The token cache is being invalidate because project 546c23ebdf2245a19364c969b2da2ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:41:09.504608 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a590507f-e6db-4b35-a72b-e05e22bec733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:09.505472 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a590507f-e6db-4b35-a72b-e05e22bec733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:09.507194 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1459/2881] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:41:09 2022] DELETE /identity/v3/projects/546c23ebdf2245a19364c969b2da2ce0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:41:09.512631 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50b991-3d85-46e5-a2ad-0a7b7fea6946 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:09.512908 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50b991-3d85-46e5-a2ad-0a7b7fea6946 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:09.513199 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50b991-3d85-46e5-a2ad-0a7b7fea6946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:09.538964 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-9d50b991-3d85-46e5-a2ad-0a7b7fea6946 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:41:09.540764 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9d50b991-3d85-46e5-a2ad-0a7b7fea6946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:09.564771 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:09.622170 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1423/2882] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:41:09.630970 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd547ca-bb6d-4d03-a7ad-20d9cb153e1a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:09.631254 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd547ca-bb6d-4d03-a7ad-20d9cb153e1a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:09.631545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd547ca-bb6d-4d03-a7ad-20d9cb153e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:09.651988 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-bdd547ca-bb6d-4d03-a7ad-20d9cb153e1a None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:41:09.653212 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-bdd547ca-bb6d-4d03-a7ad-20d9cb153e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:09.664030 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1460/2883] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:41:09.668490 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50b991-3d85-46e5-a2ad-0a7b7fea6946 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:09.680093 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50b991-3d85-46e5-a2ad-0a7b7fea6946 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:09.687163 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8258b04-7c92-4961-ab2b-4b9248ab6ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:09.688245 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8258b04-7c92-4961-ab2b-4b9248ab6ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:09.688702 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8258b04-7c92-4961-ab2b-4b9248ab6ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:09.689061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8258b04-7c92-4961-ab2b-4b9248ab6ba4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:09.690315 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8258b04-7c92-4961-ab2b-4b9248ab6ba4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:41:09.691073 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8258b04-7c92-4961-ab2b-4b9248ab6ba4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:09.693686 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8258b04-7c92-4961-ab2b-4b9248ab6ba4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:09.709375 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1424/2884] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:41:09.713916 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd547ca-bb6d-4d03-a7ad-20d9cb153e1a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:09.723581 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd547ca-bb6d-4d03-a7ad-20d9cb153e1a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:09.728234 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc59f7f-916d-40bf-82bb-d89afbf10cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:09.728895 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc59f7f-916d-40bf-82bb-d89afbf10cdb admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:09.729169 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc59f7f-916d-40bf-82bb-d89afbf10cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:09.729436 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc59f7f-916d-40bf-82bb-d89afbf10cdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:09.730161 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc59f7f-916d-40bf-82bb-d89afbf10cdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:09.732076 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc59f7f-916d-40bf-82bb-d89afbf10cdb admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:09.735644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:09.761830 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1461/2885] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:41:09 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:41:09.766511 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8258b04-7c92-4961-ab2b-4b9248ab6ba4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:09.776785 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8258b04-7c92-4961-ab2b-4b9248ab6ba4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:09.836813 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6175bb6-66bb-430e-915e-268681f06a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:09.837517 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6175bb6-66bb-430e-915e-268681f06a4a admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:09.837779 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6175bb6-66bb-430e-915e-268681f06a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:09.838089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6175bb6-66bb-430e-915e-268681f06a4a admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:09.838782 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6175bb6-66bb-430e-915e-268681f06a4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:09.840757 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6175bb6-66bb-430e-915e-268681f06a4a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:09.863357 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1425/2886] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:41:09 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:41:09.869508 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc59f7f-916d-40bf-82bb-d89afbf10cdb admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:09.885333 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc59f7f-916d-40bf-82bb-d89afbf10cdb admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:09.892904 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f8dc7-24f1-46fd-92e6-65f739830fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:09.893594 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f8dc7-24f1-46fd-92e6-65f739830fda admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:09.893909 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f8dc7-24f1-46fd-92e6-65f739830fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:09.894183 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f8dc7-24f1-46fd-92e6-65f739830fda admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:09.894921 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f8dc7-24f1-46fd-92e6-65f739830fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:09.896543 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f8dc7-24f1-46fd-92e6-65f739830fda admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:09.907567 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1462/2887] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:41:09.911834 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6175bb6-66bb-430e-915e-268681f06a4a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:09.923514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6175bb6-66bb-430e-915e-268681f06a4a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:09.929325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23b08a-752f-488c-bd36-5be4f2df7255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:09.930042 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23b08a-752f-488c-bd36-5be4f2df7255 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:09.930320 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23b08a-752f-488c-bd36-5be4f2df7255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:09.930573 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23b08a-752f-488c-bd36-5be4f2df7255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:09.931302 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23b08a-752f-488c-bd36-5be4f2df7255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:09.932915 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23b08a-752f-488c-bd36-5be4f2df7255 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:09.944581 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1426/2888] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:41:09.948965 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f8dc7-24f1-46fd-92e6-65f739830fda admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:09.960543 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f8dc7-24f1-46fd-92e6-65f739830fda admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:09.965588 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e43fc5-94a0-492b-8eb3-89e807f4205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:09.966674 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e43fc5-94a0-492b-8eb3-89e807f4205a admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:09.966829 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e43fc5-94a0-492b-8eb3-89e807f4205a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:09.967057 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e43fc5-94a0-492b-8eb3-89e807f4205a admin admin] PATH_INFO: `/v3/projects/4f99a86c522e4efb92d2c2a5bb790eb8/users/b29cae7d05754c89885964d3cb6393e1/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:09.984685 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e43fc5-94a0-492b-8eb3-89e807f4205a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f99a86c522e4efb92d2c2a5bb790eb8, user_id=b29cae7d05754c89885964d3cb6393e1, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:09.987545 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e43fc5-94a0-492b-8eb3-89e807f4205a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:10.003004 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1463/2889] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:41:09 2022] PUT /identity/v3/projects/4f99a86c522e4efb92d2c2a5bb790eb8/users/b29cae7d05754c89885964d3cb6393e1/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:41:10.013478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eef49-5f18-4d14-857b-5b4ddcb4664d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:10.013817 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eef49-5f18-4d14-857b-5b4ddcb4664d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:10.014202 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eef49-5f18-4d14-857b-5b4ddcb4664d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:10.053672 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-972eef49-5f18-4d14-857b-5b4ddcb4664d None None] MFA Rules not processed for user `b29cae7d05754c89885964d3cb6393e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:41:10.054991 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-972eef49-5f18-4d14-857b-5b4ddcb4664d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:10.127563 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1427/2890] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:41:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:41:10.140098 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e43fc5-94a0-492b-8eb3-89e807f4205a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:10.141371 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b0e43fc5-94a0-492b-8eb3-89e807f4205a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:10.204667 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e43fc5-94a0-492b-8eb3-89e807f4205a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:10.209036 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1309be0-eda0-4b81-8ac0-248bac417e51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:10.209691 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1309be0-eda0-4b81-8ac0-248bac417e51 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:10.210002 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1309be0-eda0-4b81-8ac0-248bac417e51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:10.210282 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1309be0-eda0-4b81-8ac0-248bac417e51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:10.219994 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1309be0-eda0-4b81-8ac0-248bac417e51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:10.221438 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1309be0-eda0-4b81-8ac0-248bac417e51 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:10.230609 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1464/2891] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:41:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:41:11.628437 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e3459-f5d2-4b01-9fae-c8087d6c924c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:11.629089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e3459-f5d2-4b01-9fae-c8087d6c924c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:11.629089 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e3459-f5d2-4b01-9fae-c8087d6c924c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:11.650478 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-842e3459-f5d2-4b01-9fae-c8087d6c924c None None] MFA Rules not processed for user `b29cae7d05754c89885964d3cb6393e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:41:11.651706 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-842e3459-f5d2-4b01-9fae-c8087d6c924c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:11.659654 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1428/2892] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:41:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:41:11.698059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1309be0-eda0-4b81-8ac0-248bac417e51 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:11.699522 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a1309be0-eda0-4b81-8ac0-248bac417e51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:11.767582 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1309be0-eda0-4b81-8ac0-248bac417e51 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:11.773633 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ac6d9-faa5-4900-9c72-cbfbb18b742a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1b010003c44dc19643558167424d13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:11.774772 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ac6d9-faa5-4900-9c72-cbfbb18b742a service glance] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:11.775238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ac6d9-faa5-4900-9c72-cbfbb18b742a service glance] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:11.775697 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ac6d9-faa5-4900-9c72-cbfbb18b742a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:11.778804 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-912ac6d9-faa5-4900-9c72-cbfbb18b742a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:11.878903 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:11.884430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ac6d9-faa5-4900-9c72-cbfbb18b742a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:11.885910 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ac6d9-faa5-4900-9c72-cbfbb18b742a service glance] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:11.898322 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1465/2893] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:41:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:41:12.582019 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e3459-f5d2-4b01-9fae-c8087d6c924c None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:12.583436 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-842e3459-f5d2-4b01-9fae-c8087d6c924c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:12.590340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ac6d9-faa5-4900-9c72-cbfbb18b742a service glance] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:12.591749 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-912ac6d9-faa5-4900-9c72-cbfbb18b742a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:12.598865 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:12.662566 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ac6d9-faa5-4900-9c72-cbfbb18b742a service glance] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:12.663253 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e3459-f5d2-4b01-9fae-c8087d6c924c None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:12.666293 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e97a7-c469-48d3-bdd2-736ce318fd23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:12.666992 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e97a7-c469-48d3-bdd2-736ce318fd23 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:12.667319 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e97a7-c469-48d3-bdd2-736ce318fd23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:12.667500 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e97a7-c469-48d3-bdd2-736ce318fd23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:12.668392 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8eb403-a403-4177-800f-fe4d9977fa14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:12.668961 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8eb403-a403-4177-800f-fe4d9977fa14 service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:12.669247 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8eb403-a403-4177-800f-fe4d9977fa14 service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:12.669523 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8eb403-a403-4177-800f-fe4d9977fa14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:12.669648 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-692e97a7-c469-48d3-bdd2-736ce318fd23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:12.671884 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7a8eb403-a403-4177-800f-fe4d9977fa14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:12.684569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8eb403-a403-4177-800f-fe4d9977fa14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:12.685229 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e97a7-c469-48d3-bdd2-736ce318fd23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:12.686470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8eb403-a403-4177-800f-fe4d9977fa14 service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:12.687432 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e97a7-c469-48d3-bdd2-736ce318fd23 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:12.697475 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1429/2894] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:41:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:41:12.699646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1466/2895] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:41:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:41:20.570226 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8eb403-a403-4177-800f-fe4d9977fa14 service placement] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:20.571868 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7a8eb403-a403-4177-800f-fe4d9977fa14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:20.598216 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8eb403-a403-4177-800f-fe4d9977fa14 service placement] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:20.603760 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c105f-ccf5-4fcc-8848-4b9651c3d846 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:20.604401 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c105f-ccf5-4fcc-8848-4b9651c3d846 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:20.605063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c105f-ccf5-4fcc-8848-4b9651c3d846 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:20.605063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c105f-ccf5-4fcc-8848-4b9651c3d846 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:20.606948 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-862c105f-ccf5-4fcc-8848-4b9651c3d846 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:20.621438 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c105f-ccf5-4fcc-8848-4b9651c3d846 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:20.623085 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c105f-ccf5-4fcc-8848-4b9651c3d846 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:20.635264 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1430/2896] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:41:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:41:22.694628 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=29 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:25.523037 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e97a7-c469-48d3-bdd2-736ce318fd23 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:25.525145 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-692e97a7-c469-48d3-bdd2-736ce318fd23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:25.557259 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e97a7-c469-48d3-bdd2-736ce318fd23 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:25.564694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e772e8d-cda3-4f8a-bdef-bb7b02b8b832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:25.565511 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e772e8d-cda3-4f8a-bdef-bb7b02b8b832 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:25.565939 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e772e8d-cda3-4f8a-bdef-bb7b02b8b832 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:25.566346 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e772e8d-cda3-4f8a-bdef-bb7b02b8b832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:25.568391 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8e772e8d-cda3-4f8a-bdef-bb7b02b8b832 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:25.586254 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e772e8d-cda3-4f8a-bdef-bb7b02b8b832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:25.588497 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e772e8d-cda3-4f8a-bdef-bb7b02b8b832 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:25.602579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1467/2897] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:41:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 19:41:26.278844 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6500d-9440-4f1a-9aec-a25bd006e2db None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:26.279367 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6500d-9440-4f1a-9aec-a25bd006e2db None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:26.279499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6500d-9440-4f1a-9aec-a25bd006e2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:26.491854 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-13e6500d-9440-4f1a-9aec-a25bd006e2db None None] MFA Rules not processed for user `23aa142375c54b94ad276d1a4b9031e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:41:26.492992 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-13e6500d-9440-4f1a-9aec-a25bd006e2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:26.562145 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1431/2898] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 2 19:41:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:41:26.615359 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e772e8d-cda3-4f8a-bdef-bb7b02b8b832 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:26.616888 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8e772e8d-cda3-4f8a-bdef-bb7b02b8b832 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:26.731290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e772e8d-cda3-4f8a-bdef-bb7b02b8b832 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:26.738399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf6be8-33af-4af9-ac7f-2f88800ef520 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4faac48f82244bebf039aab92898617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:26.739059 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf6be8-33af-4af9-ac7f-2f88800ef520 service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:26.739342 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf6be8-33af-4af9-ac7f-2f88800ef520 service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:26.739613 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf6be8-33af-4af9-ac7f-2f88800ef520 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:26.748651 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf6be8-33af-4af9-ac7f-2f88800ef520 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:26.750220 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf6be8-33af-4af9-ac7f-2f88800ef520 service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:26.759261 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1468/2899] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 2 19:41:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:41:27.304255 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca783444-c062-408b-9ef1-fa5935b87f20 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:27.304746 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca783444-c062-408b-9ef1-fa5935b87f20 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:27.304859 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca783444-c062-408b-9ef1-fa5935b87f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:27.322590 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ca783444-c062-408b-9ef1-fa5935b87f20 None None] MFA Rules not processed for user `23aa142375c54b94ad276d1a4b9031e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:41:27.323776 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ca783444-c062-408b-9ef1-fa5935b87f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:27.332596 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1432/2900] 10.222.0.15 () {58 vars in 967 bytes} [Thu Jun 2 19:41:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:41:27.345217 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf6be8-33af-4af9-ac7f-2f88800ef520 service swift] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:27.356849 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf6be8-33af-4af9-ac7f-2f88800ef520 service swift] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:27.364406 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaabe6-7b05-4f93-b21f-213568574408 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4faac48f82244bebf039aab92898617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:27.365376 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaabe6-7b05-4f93-b21f-213568574408 service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:27.365857 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaabe6-7b05-4f93-b21f-213568574408 service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:27.366255 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaabe6-7b05-4f93-b21f-213568574408 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:27.379512 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaabe6-7b05-4f93-b21f-213568574408 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:27.381116 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaabe6-7b05-4f93-b21f-213568574408 service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:27.389915 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1469/2901] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 2 19:41:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:41:27.612939 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d7121-bf4c-4b52-8eb5-754ca29a3de5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:27.613239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d7121-bf4c-4b52-8eb5-754ca29a3de5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:27.613510 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d7121-bf4c-4b52-8eb5-754ca29a3de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:27.633449 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-635d7121-bf4c-4b52-8eb5-754ca29a3de5 None None] MFA Rules not processed for user `23aa142375c54b94ad276d1a4b9031e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:41:27.635167 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-635d7121-bf4c-4b52-8eb5-754ca29a3de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:27.644200 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1433/2902] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 2 19:41:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:41:27.657488 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaabe6-7b05-4f93-b21f-213568574408 service swift] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:27.669193 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaabe6-7b05-4f93-b21f-213568574408 service swift] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:27.675416 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040a5f5-ecb6-4eb3-b01a-fbf72d2aec5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4faac48f82244bebf039aab92898617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:27.676055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040a5f5-ecb6-4eb3-b01a-fbf72d2aec5f service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:27.676336 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040a5f5-ecb6-4eb3-b01a-fbf72d2aec5f service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:27.676610 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040a5f5-ecb6-4eb3-b01a-fbf72d2aec5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:27.685024 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040a5f5-ecb6-4eb3-b01a-fbf72d2aec5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:27.686650 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040a5f5-ecb6-4eb3-b01a-fbf72d2aec5f service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:27.695338 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1470/2903] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 2 19:41:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:41:28.050424 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bbebc-6bbb-4f2a-a6a3-de23b492886e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:28.050735 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bbebc-6bbb-4f2a-a6a3-de23b492886e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:28.050999 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bbebc-6bbb-4f2a-a6a3-de23b492886e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:28.069183 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ae1bbebc-6bbb-4f2a-a6a3-de23b492886e None None] MFA Rules not processed for user `23aa142375c54b94ad276d1a4b9031e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:41:28.070410 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ae1bbebc-6bbb-4f2a-a6a3-de23b492886e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:28.077784 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1434/2904] 10.222.0.15 () {58 vars in 967 bytes} [Thu Jun 2 19:41:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:41:28.091760 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040a5f5-ecb6-4eb3-b01a-fbf72d2aec5f service swift] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:28.103294 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040a5f5-ecb6-4eb3-b01a-fbf72d2aec5f service swift] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:28.109240 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9863a-f73c-4e12-897c-6add3e7165b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4faac48f82244bebf039aab92898617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:28.110014 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9863a-f73c-4e12-897c-6add3e7165b1 service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:28.110296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9863a-f73c-4e12-897c-6add3e7165b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:28.110572 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9863a-f73c-4e12-897c-6add3e7165b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:28.119665 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9863a-f73c-4e12-897c-6add3e7165b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:28.121265 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9863a-f73c-4e12-897c-6add3e7165b1 service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:28.130429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1471/2905] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 2 19:41:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 19:41:30.354289 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bbebc-6bbb-4f2a-a6a3-de23b492886e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:30.392357 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:30.424014 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bbebc-6bbb-4f2a-a6a3-de23b492886e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:30.429076 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fffd28-5431-4826-8107-3c97c42b493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:30.429990 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fffd28-5431-4826-8107-3c97c42b493e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:30.430266 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fffd28-5431-4826-8107-3c97c42b493e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:30.430535 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fffd28-5431-4826-8107-3c97c42b493e admin admin] PATH_INFO: `/v3/users/b29cae7d05754c89885964d3cb6393e1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:30.431730 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fffd28-5431-4826-8107-3c97c42b493e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b29cae7d05754c89885964d3cb6393e1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:30.433660 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fffd28-5431-4826-8107-3c97c42b493e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:30.483870 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c2fffd28-5431-4826-8107-3c97c42b493e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b29cae7d05754c89885964d3cb6393e1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:30.484506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c2fffd28-5431-4826-8107-3c97c42b493e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b29cae7d05754c89885964d3cb6393e1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:30.492104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c2fffd28-5431-4826-8107-3c97c42b493e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b29cae7d05754c89885964d3cb6393e1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:30.505461 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c2fffd28-5431-4826-8107-3c97c42b493e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b29cae7d05754c89885964d3cb6393e1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:30.506413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c2fffd28-5431-4826-8107-3c97c42b493e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b29cae7d05754c89885964d3cb6393e1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:30.521329 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1435/2906] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:41:30 2022] DELETE /identity/v3/users/b29cae7d05754c89885964d3cb6393e1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:41:30.526290 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe129420-8c16-4f1f-9172-422c2a9182c6 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:30.526764 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe129420-8c16-4f1f-9172-422c2a9182c6 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:30.526839 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe129420-8c16-4f1f-9172-422c2a9182c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:30.549094 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-fe129420-8c16-4f1f-9172-422c2a9182c6 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:41:30.550518 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fe129420-8c16-4f1f-9172-422c2a9182c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:30.615269 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1472/2907] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:41:30.625617 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fffd28-5431-4826-8107-3c97c42b493e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:30.628087 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c2fffd28-5431-4826-8107-3c97c42b493e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:30.696215 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fffd28-5431-4826-8107-3c97c42b493e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:30.699833 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7965c-38d5-43c5-b741-5553a4e793d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:30.700482 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7965c-38d5-43c5-b741-5553a4e793d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:30.700756 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7965c-38d5-43c5-b741-5553a4e793d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:30.701037 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7965c-38d5-43c5-b741-5553a4e793d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:30.710403 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7965c-38d5-43c5-b741-5553a4e793d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:30.711831 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7965c-38d5-43c5-b741-5553a4e793d2 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:30.721382 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1436/2908] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:41:30.920529 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe129420-8c16-4f1f-9172-422c2a9182c6 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:30.922409 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fe129420-8c16-4f1f-9172-422c2a9182c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:30.934580 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe129420-8c16-4f1f-9172-422c2a9182c6 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:30.939286 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f116fc5-adfa-4dba-aa9f-aafd59f9a3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:30.940191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f116fc5-adfa-4dba-aa9f-aafd59f9a3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:30.940473 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f116fc5-adfa-4dba-aa9f-aafd59f9a3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:30.940748 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f116fc5-adfa-4dba-aa9f-aafd59f9a3b9 admin admin] PATH_INFO: `/v3/projects/4f99a86c522e4efb92d2c2a5bb790eb8` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:30.942199 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f116fc5-adfa-4dba-aa9f-aafd59f9a3b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f99a86c522e4efb92d2c2a5bb790eb8)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:30.944143 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f116fc5-adfa-4dba-aa9f-aafd59f9a3b9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:30.958067 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:31.000826 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3f116fc5-adfa-4dba-aa9f-aafd59f9a3b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f99a86c522e4efb92d2c2a5bb790eb8', 'request_id': 'req-3f116fc5-adfa-4dba-aa9f-aafd59f9a3b9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:31.010483 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3f116fc5-adfa-4dba-aa9f-aafd59f9a3b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f99a86c522e4efb92d2c2a5bb790eb8', 'request_id': 'req-3f116fc5-adfa-4dba-aa9f-aafd59f9a3b9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:31.017247 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3f116fc5-adfa-4dba-aa9f-aafd59f9a3b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f99a86c522e4efb92d2c2a5bb790eb8', 'request_id': 'req-3f116fc5-adfa-4dba-aa9f-aafd59f9a3b9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:31.028198 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3f116fc5-adfa-4dba-aa9f-aafd59f9a3b9 admin admin] The token cache is being invalidate because project 4f99a86c522e4efb92d2c2a5bb790eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:41:31.028480 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3f116fc5-adfa-4dba-aa9f-aafd59f9a3b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:31.029117 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3f116fc5-adfa-4dba-aa9f-aafd59f9a3b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:31.031161 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1473/2909] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:41:30 2022] DELETE /identity/v3/projects/4f99a86c522e4efb92d2c2a5bb790eb8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:41:31.035910 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b7953-95a9-48e5-8f3e-432e22a29846 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:31.036351 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b7953-95a9-48e5-8f3e-432e22a29846 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:31.036627 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b7953-95a9-48e5-8f3e-432e22a29846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:31.056356 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-772b7953-95a9-48e5-8f3e-432e22a29846 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:41:31.057689 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-772b7953-95a9-48e5-8f3e-432e22a29846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:31.110514 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:31.126353 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1437/2910] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:41:31.135464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec0ec3-6b9e-4f2b-93b0-6f93934eed88 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:31.135931 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec0ec3-6b9e-4f2b-93b0-6f93934eed88 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:31.136316 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec0ec3-6b9e-4f2b-93b0-6f93934eed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:31.163742 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-3cec0ec3-6b9e-4f2b-93b0-6f93934eed88 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:41:31.164880 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3cec0ec3-6b9e-4f2b-93b0-6f93934eed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:31.174725 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1474/2911] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:41:31.179191 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b7953-95a9-48e5-8f3e-432e22a29846 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:31.189210 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b7953-95a9-48e5-8f3e-432e22a29846 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:31.194578 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88841184-b6e1-4598-8bcf-ed74b548701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:31.195239 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88841184-b6e1-4598-8bcf-ed74b548701a admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:31.195518 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88841184-b6e1-4598-8bcf-ed74b548701a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:31.195792 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88841184-b6e1-4598-8bcf-ed74b548701a admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:31.196523 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88841184-b6e1-4598-8bcf-ed74b548701a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:41:31.196877 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88841184-b6e1-4598-8bcf-ed74b548701a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:31.198542 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88841184-b6e1-4598-8bcf-ed74b548701a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:31.211918 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1438/2912] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:41:31.216885 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec0ec3-6b9e-4f2b-93b0-6f93934eed88 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:31.229001 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec0ec3-6b9e-4f2b-93b0-6f93934eed88 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:31.235047 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9ea3c-5ed0-4fb8-b9da-4fc1e4f1084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:31.235702 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9ea3c-5ed0-4fb8-b9da-4fc1e4f1084f admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:31.235951 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9ea3c-5ed0-4fb8-b9da-4fc1e4f1084f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:31.236244 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9ea3c-5ed0-4fb8-b9da-4fc1e4f1084f admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:31.236935 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9ea3c-5ed0-4fb8-b9da-4fc1e4f1084f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:31.238913 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9ea3c-5ed0-4fb8-b9da-4fc1e4f1084f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:31.268065 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1475/2913] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:41:31 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:41:31.272609 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88841184-b6e1-4598-8bcf-ed74b548701a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:31.282816 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88841184-b6e1-4598-8bcf-ed74b548701a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:31.341568 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b07c1-cf70-48b9-a26d-7a2f8d17b358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:31.342264 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b07c1-cf70-48b9-a26d-7a2f8d17b358 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:31.342539 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b07c1-cf70-48b9-a26d-7a2f8d17b358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:31.342811 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b07c1-cf70-48b9-a26d-7a2f8d17b358 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:31.343519 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b07c1-cf70-48b9-a26d-7a2f8d17b358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:31.345434 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b07c1-cf70-48b9-a26d-7a2f8d17b358 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:31.369693 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1439/2914] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:41:31 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:41:31.374223 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9ea3c-5ed0-4fb8-b9da-4fc1e4f1084f admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:31.384891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9ea3c-5ed0-4fb8-b9da-4fc1e4f1084f admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:31.390122 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77570515-de3f-4409-a534-9d016a83dd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:31.390791 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77570515-de3f-4409-a534-9d016a83dd38 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:31.391070 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77570515-de3f-4409-a534-9d016a83dd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:31.391344 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77570515-de3f-4409-a534-9d016a83dd38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:31.392074 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77570515-de3f-4409-a534-9d016a83dd38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:31.393681 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77570515-de3f-4409-a534-9d016a83dd38 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:31.406315 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1476/2915] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:41:31.412167 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b07c1-cf70-48b9-a26d-7a2f8d17b358 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:31.423480 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b07c1-cf70-48b9-a26d-7a2f8d17b358 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:31.429481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a2d3e-0ff7-4261-bc63-87270ef6ec51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:31.430186 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a2d3e-0ff7-4261-bc63-87270ef6ec51 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:31.430468 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a2d3e-0ff7-4261-bc63-87270ef6ec51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:31.430762 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a2d3e-0ff7-4261-bc63-87270ef6ec51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:31.431499 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a2d3e-0ff7-4261-bc63-87270ef6ec51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:31.433090 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a2d3e-0ff7-4261-bc63-87270ef6ec51 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:31.444017 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1440/2916] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:41:31.448605 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77570515-de3f-4409-a534-9d016a83dd38 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:31.459604 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77570515-de3f-4409-a534-9d016a83dd38 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:31.465255 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ab18a-40d0-4fbc-84e3-9d83208f8215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:31.466191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ab18a-40d0-4fbc-84e3-9d83208f8215 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:31.466501 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ab18a-40d0-4fbc-84e3-9d83208f8215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:31.466776 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ab18a-40d0-4fbc-84e3-9d83208f8215 admin admin] PATH_INFO: `/v3/projects/bee52aa7c12c41999876555019a097cc/users/829eb88910c941319bd551998d3dc479/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:31.483707 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ab18a-40d0-4fbc-84e3-9d83208f8215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bee52aa7c12c41999876555019a097cc, user_id=829eb88910c941319bd551998d3dc479, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:31.486478 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ab18a-40d0-4fbc-84e3-9d83208f8215 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:31.503294 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1477/2917] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:41:31 2022] PUT /identity/v3/projects/bee52aa7c12c41999876555019a097cc/users/829eb88910c941319bd551998d3dc479/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:41:31.513982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735eb20-69f3-4188-a669-96948c7bf392 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:31.514272 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735eb20-69f3-4188-a669-96948c7bf392 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:31.514548 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735eb20-69f3-4188-a669-96948c7bf392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:31.544463 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0735eb20-69f3-4188-a669-96948c7bf392 None None] MFA Rules not processed for user `829eb88910c941319bd551998d3dc479`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:41:31.546069 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0735eb20-69f3-4188-a669-96948c7bf392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:31.617866 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1441/2918] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:41:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:41:31.631613 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ab18a-40d0-4fbc-84e3-9d83208f8215 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:31.633714 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2b5ab18a-40d0-4fbc-84e3-9d83208f8215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:31.699989 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ab18a-40d0-4fbc-84e3-9d83208f8215 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:31.704536 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae43ce7-bfaa-4d8d-b9dd-8dbcc099b9d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:31.705187 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae43ce7-bfaa-4d8d-b9dd-8dbcc099b9d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:31.705493 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae43ce7-bfaa-4d8d-b9dd-8dbcc099b9d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:31.705758 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae43ce7-bfaa-4d8d-b9dd-8dbcc099b9d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:31.715837 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae43ce7-bfaa-4d8d-b9dd-8dbcc099b9d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:31.717352 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae43ce7-bfaa-4d8d-b9dd-8dbcc099b9d7 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:31.726991 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1478/2919] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:41:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:41:41.615151 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:41.722302 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:49.358387 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735eb20-69f3-4188-a669-96948c7bf392 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:49.421608 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735eb20-69f3-4188-a669-96948c7bf392 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:49.426181 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e74f1-ba0b-4e9c-9401-b9513d09c2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:49.427154 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e74f1-ba0b-4e9c-9401-b9513d09c2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:49.427440 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e74f1-ba0b-4e9c-9401-b9513d09c2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:49.427710 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e74f1-ba0b-4e9c-9401-b9513d09c2f2 admin admin] PATH_INFO: `/v3/users/829eb88910c941319bd551998d3dc479` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:49.428900 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e74f1-ba0b-4e9c-9401-b9513d09c2f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=829eb88910c941319bd551998d3dc479)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:49.430940 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e74f1-ba0b-4e9c-9401-b9513d09c2f2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:49.494071 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-963e74f1-ba0b-4e9c-9401-b9513d09c2f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '829eb88910c941319bd551998d3dc479'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:49.494723 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-963e74f1-ba0b-4e9c-9401-b9513d09c2f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '829eb88910c941319bd551998d3dc479'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:49.501606 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-963e74f1-ba0b-4e9c-9401-b9513d09c2f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '829eb88910c941319bd551998d3dc479'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:49.513837 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-963e74f1-ba0b-4e9c-9401-b9513d09c2f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '829eb88910c941319bd551998d3dc479'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:49.514529 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-963e74f1-ba0b-4e9c-9401-b9513d09c2f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '829eb88910c941319bd551998d3dc479'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:49.529569 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1442/2920] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:41:49 2022] DELETE /identity/v3/users/829eb88910c941319bd551998d3dc479 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:41:49.534167 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a42843-19be-47d5-9e0e-465d1180a3dc None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:49.534618 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a42843-19be-47d5-9e0e-465d1180a3dc None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:49.534700 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a42843-19be-47d5-9e0e-465d1180a3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:49.552591 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-29a42843-19be-47d5-9e0e-465d1180a3dc None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:41:49.553843 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-29a42843-19be-47d5-9e0e-465d1180a3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:49.613661 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1479/2921] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:41:49.623289 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e74f1-ba0b-4e9c-9401-b9513d09c2f2 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:49.624809 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-963e74f1-ba0b-4e9c-9401-b9513d09c2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:49.689665 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e74f1-ba0b-4e9c-9401-b9513d09c2f2 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:49.693835 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8795b-26de-401d-99b7-2d38be76592b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:49.694506 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8795b-26de-401d-99b7-2d38be76592b service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:49.694787 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8795b-26de-401d-99b7-2d38be76592b service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:49.695062 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8795b-26de-401d-99b7-2d38be76592b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:49.705260 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8795b-26de-401d-99b7-2d38be76592b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:49.706752 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8795b-26de-401d-99b7-2d38be76592b service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:49.716634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1443/2922] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:41:50.012972 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a42843-19be-47d5-9e0e-465d1180a3dc None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:50.014455 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-29a42843-19be-47d5-9e0e-465d1180a3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:50.026977 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a42843-19be-47d5-9e0e-465d1180a3dc None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:50.033598 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54881d28-bf80-4224-bdbc-ac23ac8e675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:50.034550 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54881d28-bf80-4224-bdbc-ac23ac8e675b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:50.034831 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54881d28-bf80-4224-bdbc-ac23ac8e675b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:50.035099 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54881d28-bf80-4224-bdbc-ac23ac8e675b admin admin] PATH_INFO: `/v3/projects/bee52aa7c12c41999876555019a097cc` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:50.036297 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54881d28-bf80-4224-bdbc-ac23ac8e675b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bee52aa7c12c41999876555019a097cc)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:50.038296 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54881d28-bf80-4224-bdbc-ac23ac8e675b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:50.092651 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-54881d28-bf80-4224-bdbc-ac23ac8e675b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bee52aa7c12c41999876555019a097cc', 'request_id': 'req-54881d28-bf80-4224-bdbc-ac23ac8e675b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:50.101523 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-54881d28-bf80-4224-bdbc-ac23ac8e675b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bee52aa7c12c41999876555019a097cc', 'request_id': 'req-54881d28-bf80-4224-bdbc-ac23ac8e675b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:50.109050 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-54881d28-bf80-4224-bdbc-ac23ac8e675b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bee52aa7c12c41999876555019a097cc', 'request_id': 'req-54881d28-bf80-4224-bdbc-ac23ac8e675b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:50.122576 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-54881d28-bf80-4224-bdbc-ac23ac8e675b admin admin] The token cache is being invalidate because project bee52aa7c12c41999876555019a097cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:41:50.122766 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-54881d28-bf80-4224-bdbc-ac23ac8e675b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:50.123540 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-54881d28-bf80-4224-bdbc-ac23ac8e675b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:50.125270 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1480/2923] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:41:50 2022] DELETE /identity/v3/projects/bee52aa7c12c41999876555019a097cc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 19:41:50.130333 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac578e-4aaf-4083-b07e-57792c339f5a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:50.130626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac578e-4aaf-4083-b07e-57792c339f5a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:50.130901 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac578e-4aaf-4083-b07e-57792c339f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:50.150988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-22ac578e-4aaf-4083-b07e-57792c339f5a None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:41:50.152233 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-22ac578e-4aaf-4083-b07e-57792c339f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:50.173413 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:50.220598 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1444/2924] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:41:50.228953 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5e834-2db0-4b40-b59c-203f53361953 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:50.229240 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5e834-2db0-4b40-b59c-203f53361953 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:50.229519 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5e834-2db0-4b40-b59c-203f53361953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:50.250417 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-46e5e834-2db0-4b40-b59c-203f53361953 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:41:50.251644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-46e5e834-2db0-4b40-b59c-203f53361953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:50.260156 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1481/2925] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:41:50.264876 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac578e-4aaf-4083-b07e-57792c339f5a None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:50.275085 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac578e-4aaf-4083-b07e-57792c339f5a None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:50.280055 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9be0c5-6143-49a1-91ac-018ac55c411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:50.280720 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9be0c5-6143-49a1-91ac-018ac55c411c admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:50.281033 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9be0c5-6143-49a1-91ac-018ac55c411c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:50.281313 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9be0c5-6143-49a1-91ac-018ac55c411c admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:50.282071 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9be0c5-6143-49a1-91ac-018ac55c411c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 19:41:50.282378 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9be0c5-6143-49a1-91ac-018ac55c411c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:50.283991 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9be0c5-6143-49a1-91ac-018ac55c411c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:50.298028 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1445/2926] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 2 19:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 19:41:50.304801 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5e834-2db0-4b40-b59c-203f53361953 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:50.319833 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5e834-2db0-4b40-b59c-203f53361953 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:50.326108 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d208d3c-b9a5-451b-809d-94d18eee45b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:50.326716 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d208d3c-b9a5-451b-809d-94d18eee45b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:50.326995 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d208d3c-b9a5-451b-809d-94d18eee45b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:50.327280 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d208d3c-b9a5-451b-809d-94d18eee45b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:50.327971 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d208d3c-b9a5-451b-809d-94d18eee45b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:50.329927 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d208d3c-b9a5-451b-809d-94d18eee45b9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:50.363694 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1482/2927] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 2 19:41:50 2022] POST /identity/v3/projects => generated 399 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:41:50.368278 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9be0c5-6143-49a1-91ac-018ac55c411c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:50.379121 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9be0c5-6143-49a1-91ac-018ac55c411c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:50.439503 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c144b-c195-4bd5-ba38-2304fdd4da33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:50.440194 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c144b-c195-4bd5-ba38-2304fdd4da33 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:50.440493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c144b-c195-4bd5-ba38-2304fdd4da33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:50.440766 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c144b-c195-4bd5-ba38-2304fdd4da33 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:50.441449 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c144b-c195-4bd5-ba38-2304fdd4da33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:50.443430 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c144b-c195-4bd5-ba38-2304fdd4da33 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:50.464930 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1446/2928] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 2 19:41:50 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 19:41:50.469318 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d208d3c-b9a5-451b-809d-94d18eee45b9 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:50.480418 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d208d3c-b9a5-451b-809d-94d18eee45b9 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:50.485900 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc510e-e075-4432-9a32-fda1fc5f51ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:50.486567 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc510e-e075-4432-9a32-fda1fc5f51ac admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:50.486846 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc510e-e075-4432-9a32-fda1fc5f51ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:50.487118 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc510e-e075-4432-9a32-fda1fc5f51ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:50.487856 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc510e-e075-4432-9a32-fda1fc5f51ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:50.489464 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc510e-e075-4432-9a32-fda1fc5f51ac admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:50.501259 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1483/2929] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:41:50.505527 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c144b-c195-4bd5-ba38-2304fdd4da33 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:50.516907 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c144b-c195-4bd5-ba38-2304fdd4da33 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:50.522770 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9a00c-9d0e-4b32-90a8-3db943d61755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:50.523444 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9a00c-9d0e-4b32-90a8-3db943d61755 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:50.523732 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9a00c-9d0e-4b32-90a8-3db943d61755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:50.524001 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9a00c-9d0e-4b32-90a8-3db943d61755 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:50.525417 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9a00c-9d0e-4b32-90a8-3db943d61755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:50.527061 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9a00c-9d0e-4b32-90a8-3db943d61755 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:50.538108 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1447/2930] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 2 19:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 19:41:50.544151 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc510e-e075-4432-9a32-fda1fc5f51ac admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:50.556728 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc510e-e075-4432-9a32-fda1fc5f51ac admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:50.562678 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ed94f-a1d3-4372-8e8f-730a2277877c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:50.564035 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ed94f-a1d3-4372-8e8f-730a2277877c admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:50.564325 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ed94f-a1d3-4372-8e8f-730a2277877c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:50.564657 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ed94f-a1d3-4372-8e8f-730a2277877c admin admin] PATH_INFO: `/v3/projects/6d15ec52096546f1a436d88d1904e33e/users/9972f177cc3140f7b602a52e0135d534/roles/3e320079a5ce471e863ad87a36be46b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:50.582327 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ed94f-a1d3-4372-8e8f-730a2277877c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d15ec52096546f1a436d88d1904e33e, user_id=9972f177cc3140f7b602a52e0135d534, role_id=3e320079a5ce471e863ad87a36be46b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:50.586469 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ed94f-a1d3-4372-8e8f-730a2277877c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:50.606356 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1484/2931] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 2 19:41:50 2022] PUT /identity/v3/projects/6d15ec52096546f1a436d88d1904e33e/users/9972f177cc3140f7b602a52e0135d534/roles/3e320079a5ce471e863ad87a36be46b1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:41:50.616978 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fe17b-6377-40ea-9e67-f9964478bea3 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:50.617264 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fe17b-6377-40ea-9e67-f9964478bea3 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:50.617568 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fe17b-6377-40ea-9e67-f9964478bea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:50.645991 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d14fe17b-6377-40ea-9e67-f9964478bea3 None None] MFA Rules not processed for user `9972f177cc3140f7b602a52e0135d534`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:41:50.647104 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d14fe17b-6377-40ea-9e67-f9964478bea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:50.722497 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1448/2932] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:41:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:41:50.737923 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ed94f-a1d3-4372-8e8f-730a2277877c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:50.741001 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fe5ed94f-a1d3-4372-8e8f-730a2277877c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:50.767010 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:50.807254 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ed94f-a1d3-4372-8e8f-730a2277877c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:50.811369 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd57eb-f76f-4ed7-b266-fb64d3ddd670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0141329b2cd4f668803a192d2b6cedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:50.812105 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd57eb-f76f-4ed7-b266-fb64d3ddd670 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:50.812384 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd57eb-f76f-4ed7-b266-fb64d3ddd670 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:50.812637 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd57eb-f76f-4ed7-b266-fb64d3ddd670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:50.821520 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd57eb-f76f-4ed7-b266-fb64d3ddd670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:50.823061 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd57eb-f76f-4ed7-b266-fb64d3ddd670 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:50.832052 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1485/2933] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:41:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:41:57.443113 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fe17b-6377-40ea-9e67-f9964478bea3 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:57.444648 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d14fe17b-6377-40ea-9e67-f9964478bea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:57.469579 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:57.541060 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fe17b-6377-40ea-9e67-f9964478bea3 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:57.547564 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3e83e-4e4b-4964-bfbf-8d8ea96696e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b8ff9f5032e498db3c70c79cc11989b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:57.548217 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3e83e-4e4b-4964-bfbf-8d8ea96696e7 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:57.548493 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3e83e-4e4b-4964-bfbf-8d8ea96696e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:57.548764 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3e83e-4e4b-4964-bfbf-8d8ea96696e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:57.550545 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a4b3e83e-4e4b-4964-bfbf-8d8ea96696e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:57.564013 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3e83e-4e4b-4964-bfbf-8d8ea96696e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:57.565731 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3e83e-4e4b-4964-bfbf-8d8ea96696e7 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:57.578470 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1449/2934] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:41:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:41:58.981214 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd57eb-f76f-4ed7-b266-fb64d3ddd670 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:59.048655 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd57eb-f76f-4ed7-b266-fb64d3ddd670 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:59.055973 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efce062-143e-46ec-81e1-b758e3c88073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:59.057224 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efce062-143e-46ec-81e1-b758e3c88073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:59.057587 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efce062-143e-46ec-81e1-b758e3c88073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:59.058132 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efce062-143e-46ec-81e1-b758e3c88073 admin admin] PATH_INFO: `/v3/users/9972f177cc3140f7b602a52e0135d534` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:59.060184 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efce062-143e-46ec-81e1-b758e3c88073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9972f177cc3140f7b602a52e0135d534)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:59.062203 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efce062-143e-46ec-81e1-b758e3c88073 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:59.115376 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7efce062-143e-46ec-81e1-b758e3c88073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9972f177cc3140f7b602a52e0135d534'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:59.116050 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7efce062-143e-46ec-81e1-b758e3c88073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9972f177cc3140f7b602a52e0135d534'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:59.124342 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7efce062-143e-46ec-81e1-b758e3c88073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9972f177cc3140f7b602a52e0135d534'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:59.134121 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7efce062-143e-46ec-81e1-b758e3c88073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9972f177cc3140f7b602a52e0135d534'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:59.135082 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7efce062-143e-46ec-81e1-b758e3c88073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9972f177cc3140f7b602a52e0135d534'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:59.156173 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1486/2935] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:41:58 2022] DELETE /identity/v3/users/9972f177cc3140f7b602a52e0135d534 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:41:59.161027 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579f361-2ebc-4bed-904f-3f22df55d979 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:59.161542 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579f361-2ebc-4bed-904f-3f22df55d979 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:59.161542 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579f361-2ebc-4bed-904f-3f22df55d979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:59.192627 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8579f361-2ebc-4bed-904f-3f22df55d979 None None] MFA Rules not processed for user `f2f2aaa398bb4bba874340ea4e3288dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 19:41:59.193994 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8579f361-2ebc-4bed-904f-3f22df55d979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:59.258847 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1450/2936] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 2 19:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 19:41:59.275238 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efce062-143e-46ec-81e1-b758e3c88073 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:59.278030 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7efce062-143e-46ec-81e1-b758e3c88073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:59.341892 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:41:59.356317 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efce062-143e-46ec-81e1-b758e3c88073 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:59.361579 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa7190-9527-4c5b-ba61-a61e7aee58b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7714d3ad1d849f5a398fc1843f22e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:59.362437 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa7190-9527-4c5b-ba61-a61e7aee58b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:59.362942 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa7190-9527-4c5b-ba61-a61e7aee58b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:59.363575 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa7190-9527-4c5b-ba61-a61e7aee58b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:59.375610 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa7190-9527-4c5b-ba61-a61e7aee58b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:59.377191 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa7190-9527-4c5b-ba61-a61e7aee58b0 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:59.389430 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1487/2937] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:41:59.817384 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579f361-2ebc-4bed-904f-3f22df55d979 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:41:59.818988 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8579f361-2ebc-4bed-904f-3f22df55d979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:41:59.831585 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579f361-2ebc-4bed-904f-3f22df55d979 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:41:59.836292 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738789c-d15b-4fbe-8944-2106fc9c3050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:41:59.837156 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738789c-d15b-4fbe-8944-2106fc9c3050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:41:59.837433 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738789c-d15b-4fbe-8944-2106fc9c3050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:41:59.837704 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738789c-d15b-4fbe-8944-2106fc9c3050 admin admin] PATH_INFO: `/v3/projects/6d15ec52096546f1a436d88d1904e33e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:41:59.838916 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738789c-d15b-4fbe-8944-2106fc9c3050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d15ec52096546f1a436d88d1904e33e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:41:59.840982 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738789c-d15b-4fbe-8944-2106fc9c3050 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:41:59.889376 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5738789c-d15b-4fbe-8944-2106fc9c3050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d15ec52096546f1a436d88d1904e33e', 'request_id': 'req-5738789c-d15b-4fbe-8944-2106fc9c3050'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:59.895063 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5738789c-d15b-4fbe-8944-2106fc9c3050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d15ec52096546f1a436d88d1904e33e', 'request_id': 'req-5738789c-d15b-4fbe-8944-2106fc9c3050'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:59.904443 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5738789c-d15b-4fbe-8944-2106fc9c3050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d15ec52096546f1a436d88d1904e33e', 'request_id': 'req-5738789c-d15b-4fbe-8944-2106fc9c3050'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:59.916595 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5738789c-d15b-4fbe-8944-2106fc9c3050 admin admin] The token cache is being invalidate because project 6d15ec52096546f1a436d88d1904e33e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:41:59.916862 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5738789c-d15b-4fbe-8944-2106fc9c3050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:59.917634 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5738789c-d15b-4fbe-8944-2106fc9c3050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:41:59.919584 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1451/2938] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:41:59 2022] DELETE /identity/v3/projects/6d15ec52096546f1a436d88d1904e33e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:42:04.320484 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa7190-9527-4c5b-ba61-a61e7aee58b0 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:42:04.321937 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-17aa7190-9527-4c5b-ba61-a61e7aee58b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:42:04.415340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa7190-9527-4c5b-ba61-a61e7aee58b0 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:42:04.477990 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0acd5-f7e0-4c76-93f0-c4164fac2de6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:42:04.478644 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0acd5-f7e0-4c76-93f0-c4164fac2de6 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:42:04.478925 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0acd5-f7e0-4c76-93f0-c4164fac2de6 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:42:04.479198 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0acd5-f7e0-4c76-93f0-c4164fac2de6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:42:04.481188 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a1b0acd5-f7e0-4c76-93f0-c4164fac2de6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:42:04.493503 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0acd5-f7e0-4c76-93f0-c4164fac2de6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:42:04.495163 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0acd5-f7e0-4c76-93f0-c4164fac2de6 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:42:04.505340 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1488/2939] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:42:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:42:07.541081 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738789c-d15b-4fbe-8944-2106fc9c3050 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:42:07.542714 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5738789c-d15b-4fbe-8944-2106fc9c3050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:42:07.567481 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738789c-d15b-4fbe-8944-2106fc9c3050 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:42:07.576140 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db93f1-e608-48b0-a746-ef71c92ddfc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:42:07.576953 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db93f1-e608-48b0-a746-ef71c92ddfc2 service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:42:07.577263 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db93f1-e608-48b0-a746-ef71c92ddfc2 service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:42:07.577626 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db93f1-e608-48b0-a746-ef71c92ddfc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:42:07.579658 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-27db93f1-e608-48b0-a746-ef71c92ddfc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:42:07.599924 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db93f1-e608-48b0-a746-ef71c92ddfc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:42:07.600819 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db93f1-e608-48b0-a746-ef71c92ddfc2 service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:42:07.613102 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1452/2940] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:42:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:42:07.627399 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0acd5-f7e0-4c76-93f0-c4164fac2de6 service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:42:07.628978 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a1b0acd5-f7e0-4c76-93f0-c4164fac2de6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:42:07.700198 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0acd5-f7e0-4c76-93f0-c4164fac2de6 service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:42:07.704874 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e546111-c20a-4fb7-923e-4f2354b698ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:42:07.705918 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e546111-c20a-4fb7-923e-4f2354b698ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:42:07.706201 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e546111-c20a-4fb7-923e-4f2354b698ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:42:07.706476 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e546111-c20a-4fb7-923e-4f2354b698ef admin admin] PATH_INFO: `/v3/users/5f92f1059a8b481aa5d44ebac5a7819d` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:42:07.707684 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e546111-c20a-4fb7-923e-4f2354b698ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f92f1059a8b481aa5d44ebac5a7819d)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:42:07.709645 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e546111-c20a-4fb7-923e-4f2354b698ef admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:42:07.732439 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:42:07.768706 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1e546111-c20a-4fb7-923e-4f2354b698ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f92f1059a8b481aa5d44ebac5a7819d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:07.769509 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1e546111-c20a-4fb7-923e-4f2354b698ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f92f1059a8b481aa5d44ebac5a7819d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:07.776646 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1e546111-c20a-4fb7-923e-4f2354b698ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f92f1059a8b481aa5d44ebac5a7819d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:07.786544 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1e546111-c20a-4fb7-923e-4f2354b698ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f92f1059a8b481aa5d44ebac5a7819d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:07.787098 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1e546111-c20a-4fb7-923e-4f2354b698ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f92f1059a8b481aa5d44ebac5a7819d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:07.805125 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1489/2941] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:42:07 2022] DELETE /identity/v3/users/5f92f1059a8b481aa5d44ebac5a7819d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:42:08.010138 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db93f1-e608-48b0-a746-ef71c92ddfc2 service placement] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:42:08.021919 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db93f1-e608-48b0-a746-ef71c92ddfc2 service placement] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:42:08.026167 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:42:08.084111 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a79c0a-82a4-4450-aaf8-5d3f57cbdc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:42:08.085034 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a79c0a-82a4-4450-aaf8-5d3f57cbdc3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:42:08.085317 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a79c0a-82a4-4450-aaf8-5d3f57cbdc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:42:08.085596 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a79c0a-82a4-4450-aaf8-5d3f57cbdc3e admin admin] PATH_INFO: `/v3/projects/7d83706590a34c76b0315e6a5e0ee931` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:42:08.086823 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a79c0a-82a4-4450-aaf8-5d3f57cbdc3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d83706590a34c76b0315e6a5e0ee931)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:42:08.088755 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a79c0a-82a4-4450-aaf8-5d3f57cbdc3e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:42:08.138533 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a1a79c0a-82a4-4450-aaf8-5d3f57cbdc3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d83706590a34c76b0315e6a5e0ee931', 'request_id': 'req-a1a79c0a-82a4-4450-aaf8-5d3f57cbdc3e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:08.144698 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a1a79c0a-82a4-4450-aaf8-5d3f57cbdc3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d83706590a34c76b0315e6a5e0ee931', 'request_id': 'req-a1a79c0a-82a4-4450-aaf8-5d3f57cbdc3e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:08.154035 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a1a79c0a-82a4-4450-aaf8-5d3f57cbdc3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d83706590a34c76b0315e6a5e0ee931', 'request_id': 'req-a1a79c0a-82a4-4450-aaf8-5d3f57cbdc3e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:08.165398 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a1a79c0a-82a4-4450-aaf8-5d3f57cbdc3e admin admin] The token cache is being invalidate because project 7d83706590a34c76b0315e6a5e0ee931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:42:08.165681 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a1a79c0a-82a4-4450-aaf8-5d3f57cbdc3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:08.166415 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a1a79c0a-82a4-4450-aaf8-5d3f57cbdc3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:08.168402 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1453/2942] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:42:08 2022] DELETE /identity/v3/projects/7d83706590a34c76b0315e6a5e0ee931 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:42:08.173123 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e546111-c20a-4fb7-923e-4f2354b698ef admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:42:08.174956 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1e546111-c20a-4fb7-923e-4f2354b698ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:42:08.189336 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e546111-c20a-4fb7-923e-4f2354b698ef admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:42:08.255787 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416406d3-5508-49b2-91b1-7fff2c662747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:42:08.257055 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416406d3-5508-49b2-91b1-7fff2c662747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:42:08.257417 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416406d3-5508-49b2-91b1-7fff2c662747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:42:08.257774 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416406d3-5508-49b2-91b1-7fff2c662747 admin admin] PATH_INFO: `/v3/users/8b3d58d84a5946d59f3fce12ef720109` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:42:08.259738 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416406d3-5508-49b2-91b1-7fff2c662747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b3d58d84a5946d59f3fce12ef720109)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:42:08.262500 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416406d3-5508-49b2-91b1-7fff2c662747 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:42:08.325457 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-416406d3-5508-49b2-91b1-7fff2c662747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b3d58d84a5946d59f3fce12ef720109'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:08.326148 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-416406d3-5508-49b2-91b1-7fff2c662747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b3d58d84a5946d59f3fce12ef720109'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:08.333955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-416406d3-5508-49b2-91b1-7fff2c662747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b3d58d84a5946d59f3fce12ef720109'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:08.344882 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-416406d3-5508-49b2-91b1-7fff2c662747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b3d58d84a5946d59f3fce12ef720109'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:08.345616 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-416406d3-5508-49b2-91b1-7fff2c662747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b3d58d84a5946d59f3fce12ef720109'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:08.363853 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1490/2943] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 2 19:42:08 2022] DELETE /identity/v3/users/8b3d58d84a5946d59f3fce12ef720109 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:42:08.549436 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a79c0a-82a4-4450-aaf8-5d3f57cbdc3e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:42:08.551004 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a1a79c0a-82a4-4450-aaf8-5d3f57cbdc3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:42:08.566325 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a79c0a-82a4-4450-aaf8-5d3f57cbdc3e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:42:08.628021 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3160fd2-1b19-439f-9797-6f5800e798af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f2aaa398bb4bba874340ea4e3288dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b970ca87a411459db54f4a7b6d487f4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:42:08.628966 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3160fd2-1b19-439f-9797-6f5800e798af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:42:08.629245 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3160fd2-1b19-439f-9797-6f5800e798af admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:42:08.629516 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3160fd2-1b19-439f-9797-6f5800e798af admin admin] PATH_INFO: `/v3/projects/3afbc5f8793f4425b6de15427e7b7db4` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:42:08.630886 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3160fd2-1b19-439f-9797-6f5800e798af admin admin] RBAC: Authorizing `identity:delete_project(project_id=3afbc5f8793f4425b6de15427e7b7db4)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:42:08.632895 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3160fd2-1b19-439f-9797-6f5800e798af admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:42:08.676012 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:42:08.683575 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a3160fd2-1b19-439f-9797-6f5800e798af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3afbc5f8793f4425b6de15427e7b7db4', 'request_id': 'req-a3160fd2-1b19-439f-9797-6f5800e798af'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:08.690143 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a3160fd2-1b19-439f-9797-6f5800e798af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3afbc5f8793f4425b6de15427e7b7db4', 'request_id': 'req-a3160fd2-1b19-439f-9797-6f5800e798af'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:08.699130 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a3160fd2-1b19-439f-9797-6f5800e798af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3afbc5f8793f4425b6de15427e7b7db4', 'request_id': 'req-a3160fd2-1b19-439f-9797-6f5800e798af'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:08.710839 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a3160fd2-1b19-439f-9797-6f5800e798af admin admin] The token cache is being invalidate because project 3afbc5f8793f4425b6de15427e7b7db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 19:42:08.711128 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a3160fd2-1b19-439f-9797-6f5800e798af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:08.711753 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a3160fd2-1b19-439f-9797-6f5800e798af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 19:42:08.713382 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1454/2944] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 2 19:42:08 2022] DELETE /identity/v3/projects/3afbc5f8793f4425b6de15427e7b7db4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 19:42:18.360379 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:DELETE=18,keystone:SELECT=73,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:42:18.707925 dv-cinder-797608-28-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=10,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 19:46:02.003070 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416406d3-5508-49b2-91b1-7fff2c662747 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 19:46:02.004741 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-416406d3-5508-49b2-91b1-7fff2c662747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:46:02.149955 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416406d3-5508-49b2-91b1-7fff2c662747 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 19:46:02.222388 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055e569-51a7-40ab-8e53-4a2580b32244 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4152a82e1486887541afab2d4e5cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3d8f5b51ff4201b3968c9173ae06a7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 19:46:02.223051 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055e569-51a7-40ab-8e53-4a2580b32244 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 19:46:02.223334 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055e569-51a7-40ab-8e53-4a2580b32244 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 19:46:02.223606 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055e569-51a7-40ab-8e53-4a2580b32244 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 19:46:02.225891 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e055e569-51a7-40ab-8e53-4a2580b32244 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 19:46:02.238826 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055e569-51a7-40ab-8e53-4a2580b32244 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 19:46:02.240429 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055e569-51a7-40ab-8e53-4a2580b32244 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 19:46:02.251404 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1491/2945] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 2 19:46:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 19:46:12.246619 dv-cinder-797608-28-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}